-- Logs begin at Thu 2022-08-11 15:36:39 UTC, end at Thu 2022-08-11 16:40:05 UTC. -- Aug 11 16:11:20.896342 dv-cinder-852208-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 11 16:11:20.904305 dv-cinder-852208-4-smb devstack@keystone.service[81398]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 11 16:11:20 2022] *** Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: nodename: dv-cinder-852208-4-smb Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: machine: x86_64 Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: clock source: unix Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: pcre jit disabled Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: detected number of CPU cores: 4 Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: current working directory: / Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: detected binary path: /usr/bin/uwsgi-core Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: your processes number limit is 47680 Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: your memory page size is 4096 bytes Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: detected max file descriptor number: 2048 Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: lock engine: pthread robust mutexes Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: thunder lock: enabled Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 11 16:11:20.911444 dv-cinder-852208-4-smb devstack@keystone.service[81398]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 11 16:11:20.946885 dv-cinder-852208-4-smb devstack@keystone.service[81398]: Python main interpreter initialized at 0x563f11a1f9c0 Aug 11 16:11:20.946885 dv-cinder-852208-4-smb devstack@keystone.service[81398]: python threads support enabled Aug 11 16:11:20.946885 dv-cinder-852208-4-smb devstack@keystone.service[81398]: your server socket listen backlog is limited to 100 connections Aug 11 16:11:20.946885 dv-cinder-852208-4-smb devstack@keystone.service[81398]: your mercy for graceful operations on workers is 90 seconds Aug 11 16:11:20.947214 dv-cinder-852208-4-smb devstack@keystone.service[81398]: mapped 403077 bytes (393 KB) for 2 cores Aug 11 16:11:20.947309 dv-cinder-852208-4-smb devstack@keystone.service[81398]: *** Operational MODE: preforking *** Aug 11 16:11:20.947583 dv-cinder-852208-4-smb devstack@keystone.service[81398]: *** uWSGI is running in multiple interpreter mode *** Aug 11 16:11:20.947583 dv-cinder-852208-4-smb devstack@keystone.service[81398]: spawned uWSGI master process (pid: 81398) Aug 11 16:11:20.947786 dv-cinder-852208-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 11 16:11:20.952609 dv-cinder-852208-4-smb devstack@keystone.service[81398]: spawned uWSGI worker 1 (pid: 81408, cores: 1) Aug 11 16:11:20.952609 dv-cinder-852208-4-smb devstack@keystone.service[81398]: spawned uWSGI worker 2 (pid: 81409, cores: 1) Aug 11 16:11:20.952609 dv-cinder-852208-4-smb devstack@keystone.service[81398]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 11 16:11:26.445239 dv-cinder-852208-4-smb devstack@keystone.service[81409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 16:11:26.445239 dv-cinder-852208-4-smb devstack@keystone.service[81409]: from cryptography.utils import int_from_bytes Aug 11 16:11:26.446050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 16:11:26.446050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: from cryptography.utils import int_from_bytes Aug 11 16:11:26.458701 dv-cinder-852208-4-smb devstack@keystone.service[81408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 16:11:26.458701 dv-cinder-852208-4-smb devstack@keystone.service[81408]: from cryptography.utils import int_from_bytes Aug 11 16:11:26.459211 dv-cinder-852208-4-smb devstack@keystone.service[81408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 16:11:26.459211 dv-cinder-852208-4-smb devstack@keystone.service[81408]: from cryptography.utils import int_from_bytes Aug 11 16:11:26.495700 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 16:11:26.495887 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 16:11:26.496081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] command line args: [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 16:11:26.496346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 16:11:26.496522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ================================================================================ {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 16:11:26.496811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] admin_token = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.497062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] config_dir = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.497249 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.497432 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] config_source = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.497611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] debug = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.497810 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.498993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.498993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.498993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.498993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.499240 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.499240 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_config_append = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.499418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.499550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_dir = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.499726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_file = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.499962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.500208 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.500454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.500724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.500902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.501077 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.501320 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.501564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.501797 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.502030 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.502262 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.502497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.502739 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.503003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.503269 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.503743 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.503919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] publish_errors = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.504143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.504377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.504555 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.504827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.505059 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.505295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] standard_threads = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.505526 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.505768 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.505942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.506118 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] use_journal = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.506292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] use_json = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.506465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] use_stderr = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.506638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] use_syslog = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.506868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.507125 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.507362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.507619 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.507857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.508130 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.508368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.508633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.508875 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.509121 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.509365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.509610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.509844 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.510090 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.510327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.510572 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.510817 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.511054 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.511307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.511559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.511805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.511969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 16:11:26.512089 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.512202 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 16:11:26.512322 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.512447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] command line args: [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 16:11:26.512567 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.512729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 16:11:26.512858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.512973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ================================================================================ {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 16:11:26.513097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.513233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.513359 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] admin_token = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.513474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.513587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] config_dir = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.513708 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.513863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.513988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.514109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] config_source = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.514229 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.514349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] debug = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.514529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.514648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.514786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.514786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.515009 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.515133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.515247 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.515365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.515485 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.515599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.515712 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.515834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.515955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.516103 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.516228 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.516348 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_config_append = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.516462 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.516614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.516733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.516847 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_dir = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.516959 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.517072 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_file = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.517185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.517311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.517427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.517540 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.517652 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.517765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.517886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.518012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.518132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.518245 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.518367 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.518481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.518602 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.518717 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.518835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.518957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.519076 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.519190 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.519316 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.519436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.519555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.519670 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.519782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.519894 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.520114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.520234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.520348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.520500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.520656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.520834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.520964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.521086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.521292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.521415 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.521536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.521767 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.521897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.522014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.522220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.522456 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.522574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.522696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.522810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] publish_errors = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.522923 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.523060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.523179 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.523363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.523482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.524096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.524263 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.524458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.524576 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.524762 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.524878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.524991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.525104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] standard_threads = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.525218 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.525395 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.525522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.525661 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.525785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.525900 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.526012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.526131 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] use_journal = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.526322 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.526445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] use_json = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.526560 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.526673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] use_stderr = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.526786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.526899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] use_syslog = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.527020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.527134 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:11:26.527247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.527247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.527460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.527581 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.527695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.527808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.527926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.528047 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.528160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.528280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.528395 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.528543 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.528686 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.528838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.528956 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.529080 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.529219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.529337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.529499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.529622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.529736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.529857 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.529971 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.530172 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.530289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.530402 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.530546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.530673 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.530817 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.530935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.531103 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.531207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.531359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.531473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.531599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.531754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.531904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.external = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.532076 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.532247 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.532427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.532681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.532857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.533036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.533207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.password = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.533207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.token = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.533506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.533685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.533830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.534000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.534000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.534305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.534482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.534665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.534836 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.535006 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.535183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.535183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.535483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.535662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.535841 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.536011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.536011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.536307 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.536456 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.536669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.536818 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.536936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.537050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.537050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.537298 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.537421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.537537 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.537650 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.537764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.537908 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.538026 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.538148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.538148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.538369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.538484 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.538597 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.538717 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.538841 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.538957 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.538957 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.539169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.539865 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.539990 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.540114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.540231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.540345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.540459 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.540573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.540573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.540839 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.540956 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.541070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.541190 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.541305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.541419 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.541419 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.541724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.541847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.541992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.542145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.542260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.542374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.542374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.542598 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.542711 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.542825 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.542938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.543053 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.543174 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.543290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.543410 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.543410 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.543625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.543738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.543860 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.543980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.543980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.544202 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.544317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.544431 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.544556 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.544556 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.545035 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.545150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.545150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.545394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.545519 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.545635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.545761 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.545883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.546003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.546146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.546266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.546381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.546504 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.546621 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.546736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.546849 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.546964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.547146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.547277 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.547394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.547508 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.547628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.547816 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.547935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.548064 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.548286 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.548406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.548522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.548701 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.548822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.548993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.549120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.549237 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.549353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.549468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.549605 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.549733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.549912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.550032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.550147 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.550261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.550377 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.550500 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.550616 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.550761 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.550881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.551045 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.551170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.551300 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.551418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.551534 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.551649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.551763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.551908 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.552040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.552157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.552277 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.552394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.552509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.552643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.552838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.552960 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.553075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.553188 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.553302 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.553417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.553541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.553687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.553808 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.553985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.554104 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.554220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.554343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.554459 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.554575 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.554690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.554865 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.554985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.555139 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.555259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.555374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.555495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.555612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.555779 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.555973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.556092 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.556206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.556322 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.556436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.556560 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.556711 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.556828 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.556943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.557067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.557184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.557307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.557423 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.557538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.557652 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.557796 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.557917 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.external = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.558040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.558156 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.558325 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.558446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.558562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.558677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.558801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.password = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.558917 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.559032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.token = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.559197 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.559316 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.559431 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.559554 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.559671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.559786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.559901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.560074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.560194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.560318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.560433 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.560549 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.560693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.560809 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.560965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.561098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.561249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.561368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.561483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.561598 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.561714 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.561837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.561955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.562110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.562230 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.562404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.562524 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.562647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.562771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.562887 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.563003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.563118 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.563268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.563396 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.563573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.563694 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.563842 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.563961 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.564083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.564207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.564332 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.564448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.564563 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.564744 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.564861 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.565028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.565148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.565264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.565378 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.565496 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.565611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.565735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.565880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.566000 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.566168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.566287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.566402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.566526 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.566642 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.566758 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.566872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.567050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.567171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.567295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.567411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.567526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.567640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.567755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.567929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.568058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.568201 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.568320 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.568434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.568549 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.568696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.568814 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] role.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.568929 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.569105 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] role.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.569226 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.569382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.569509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.569626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.569748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.569864 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.569979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.570095 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.570249 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.570371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.570525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.570644 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.570760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.570875 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.570998 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.571163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.571283 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.571483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.571602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.571718 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.571841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.571957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.572118 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.572238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.572354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.572469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.572653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.572773 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.572889 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.573042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.573161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.573276 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.573465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.573588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.573703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.573944 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.574062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.574177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.574299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.574416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.574530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.574645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.574760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.574874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.575000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.575117 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.575232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.575346 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.575462 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.575577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.575700 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.575817 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.575931 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.576049 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.576164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.576279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.576402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.576519 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.576654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.576771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.576886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.577000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.577127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.577244 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.577359 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.577474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.577588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.577716 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.577834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.577949 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.578064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.578179 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.578294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.578417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.578533 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.578649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.578764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.578879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.578994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.579116 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.579233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.579347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.579462 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.579577 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.579693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.579883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.580002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.580117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.580231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.580347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.580469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.580611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.580730 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.580892 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.581011 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.581136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.581253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.581377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.581493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.581609 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.581722 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.581838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.581952 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.582075 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.582191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.582306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.582421 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.582536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.582650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.582773 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.582890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.583004 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.connection = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.583127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.583252 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.583368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.583368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.583593 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.583709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.583824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.583940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.584055 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.584169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.584292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.584408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.584522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.584662 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.584779 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.584894 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.585021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.585138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.585252 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.585366 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.585480 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.585596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.585718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.585834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.585948 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.586602 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.586731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.586847 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.586971 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.587089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.587205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.587319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.587442 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.587558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.587682 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.587798 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.587913 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.588028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.588144 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 16:11:26.588267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.588267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.588267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.588612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.588612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.588829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.589032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.589276 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.589510 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.589747 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.589981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] role.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.590228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] role.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.590454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.590699 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.590941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.591182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.591422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.591663 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.591901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.592141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.592382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.592631 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.592876 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.593116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.593358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.593600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.593988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.594223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.594468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.594715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.594961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.595207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.595437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.595791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.596045 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.596284 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.596514 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.596769 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.596998 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.597248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.597498 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.597742 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.597976 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.598208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.598435 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.598668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.598902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.599144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.599376 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.599627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.599869 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.600102 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.600346 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.600647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.600852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.601086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.601325 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.601609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.601902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.602148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.602375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.602680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.603014 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.603331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.connection = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.603661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.603968 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.604283 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.604636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.604955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.605256 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.605582 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.605907 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.606237 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.606543 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.606867 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.607185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.607510 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.607811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.608129 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.608426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.608758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.609036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:11:26.609273 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 16:11:26.615985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.616215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.616438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.626089 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.636391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.636655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.636880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.646796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.654733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.654964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.667254 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.667480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.706741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.709070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.756417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.756672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.762671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.762946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.820421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.821204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.821429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.821648 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.821861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.822071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.822613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.822863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.823087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.823311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.823529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.823743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.844773 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.845005 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.845233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.845453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.845555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.845667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.845750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.845877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.845959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.846086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.846171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.846356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.846571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.846848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.857649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.858552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.870931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.871164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.871387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.871604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.871816 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.871898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.872026 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.872106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.872238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.872330 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.872494 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.872739 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.872996 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.873212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 16:11:26.889032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.889242 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 16:11:26.889583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.889857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 16:11:26.889948 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.890022 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 16:11:26.890108 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.890304 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.890386 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.890532 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 16:11:26.890612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.890804 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.890886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.891060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.891316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.891571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.902162 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.902440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.902711 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.902995 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.903799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.904077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.904430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.904858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.909916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.911945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.912979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.913262 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.913547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.913830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.914114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.914908 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.915177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.915449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.915630 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.915711 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.915910 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.915991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.916190 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.916273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.916471 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.916774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.917037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.917305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.917575 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.917840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.918112 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.918379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.939776 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.941288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.941575 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.944369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.945941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.946182 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.946278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.946465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.946750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.950935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.951218 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.951575 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.953322 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.953609 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.957753 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.958003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.958290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.958381 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.958594 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.958677 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.958888 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.959175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.959462 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.959733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.963785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.964163 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.964514 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.964913 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.965207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.965524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.965849 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.966193 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.976031 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.976312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.980507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.983002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.983280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.983647 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.983945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.987461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.988288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.991474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:26.991623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.991928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.995155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.995458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.995749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.996044 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.996334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.996641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:26.997579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.000742 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.003873 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.004170 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.004457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.004846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.005126 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.005405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.012517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.012840 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.013113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.013380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.020312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.021449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.021737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.021900 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.022007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.022182 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.022265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.025533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.025818 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.026112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.026405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.026685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.029787 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.031764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.032111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.035308 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.035666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.036038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.036407 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.036901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.038027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.038312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.038593 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.038872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.039152 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.039496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.039777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.051419 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.051701 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.051981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.052262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.052542 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.052843 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.053119 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.057009 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.059957 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.062901 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.064467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.065982 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.066277 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.066573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.070048 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.073023 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.073129 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.074624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.075938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.077550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.077634 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.077858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.078147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.078428 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.079029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.079317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.079595 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.085972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.087014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.087349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.087631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.088083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.091006 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.091291 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.091570 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.091842 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.094465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.094751 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.095036 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.095314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.095586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.095857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.096128 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.096395 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.096811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.097096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.097381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.097647 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.097922 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.098183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.099784 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.100070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.100344 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.107226 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 16:11:27.107506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.107781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.108051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.108319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.108609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.108879 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.109162 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.109546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.109822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.110091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.110353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.110623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.110890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 16:11:27.131674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563f11a1f9c0 pid: 81409 (default app) Aug 11 16:11:27.134971 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c3655-7726-4e71-b91d-db35b9de7a80 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:27.135257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c3655-7726-4e71-b91d-db35b9de7a80 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:27.135531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c3655-7726-4e71-b91d-db35b9de7a80 None None] PATH_INFO: `/v3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:27.140288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Thu Aug 11 16:11:27 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:27.149376 dv-cinder-852208-4-smb devstack@keystone.service[81408]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563f11a1f9c0 pid: 81408 (default app) Aug 11 16:11:34.728959 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653159d7-d03d-4554-ac52-49b831193386 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:34.729499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653159d7-d03d-4554-ac52-49b831193386 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:34.729499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653159d7-d03d-4554-ac52-49b831193386 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:34.730723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:11:34.738005 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a198913-d5b4-4d78-821f-cbb37b3ede37 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:34.738447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a198913-d5b4-4d78-821f-cbb37b3ede37 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:34.738545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a198913-d5b4-4d78-821f-cbb37b3ede37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:34.810064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: INFO dbcounter [None req-4a198913-d5b4-4d78-821f-cbb37b3ede37 None None] Registered counter for database keystone Aug 11 16:11:34.829719 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG oslo_db.sqlalchemy.engines [None req-4a198913-d5b4-4d78-821f-cbb37b3ede37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:11:34.835887 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writer thread running {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:11:35.013021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG passlib.handlers.bcrypt [None req-4a198913-d5b4-4d78-821f-cbb37b3ede37 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81408) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 11 16:11:35.013365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG passlib.handlers.bcrypt [None req-4a198913-d5b4-4d78-821f-cbb37b3ede37 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81408) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 11 16:11:35.067219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4a198913-d5b4-4d78-821f-cbb37b3ede37 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:35.068848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4a198913-d5b4-4d78-821f-cbb37b3ede37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:35.200513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1/3] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 11 16:11:35.333536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653159d7-d03d-4554-ac52-49b831193386 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:35.401614 dv-cinder-852208-4-smb devstack@keystone.service[81409]: INFO dbcounter [None req-653159d7-d03d-4554-ac52-49b831193386 None None] Registered counter for database keystone Aug 11 16:11:35.422566 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG oslo_db.sqlalchemy.engines [None req-653159d7-d03d-4554-ac52-49b831193386 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:11:35.428663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writer thread running {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:11:35.546900 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653159d7-d03d-4554-ac52-49b831193386 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:35.551162 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eaaeab-9ffd-48e2-88ad-812b7312a98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:35.551777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaaeab-9ffd-48e2-88ad-812b7312a98d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:35.552057 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaaeab-9ffd-48e2-88ad-812b7312a98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:35.552329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaaeab-9ffd-48e2-88ad-812b7312a98d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:35.560862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eaaeab-9ffd-48e2-88ad-812b7312a98d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:35.612151 dv-cinder-852208-4-smb devstack@keystone.service[81409]: WARNING keystone.common.rbac_enforcer.enforcer [None req-43eaaeab-9ffd-48e2-88ad-812b7312a98d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 11 16:11:35.612441 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eaaeab-9ffd-48e2-88ad-812b7312a98d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:35.621924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 3/4] 10.222.0.40 () {58 vars in 1324 bytes} [Thu Aug 11 16:11:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 11 16:11:35.629210 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a198913-d5b4-4d78-821f-cbb37b3ede37 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:35.645901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a198913-d5b4-4d78-821f-cbb37b3ede37 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:35.650848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225856c-41e6-41ca-9225-680abbc4599b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:35.651932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225856c-41e6-41ca-9225-680abbc4599b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:35.652209 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225856c-41e6-41ca-9225-680abbc4599b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:35.652481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225856c-41e6-41ca-9225-680abbc4599b admin admin] PATH_INFO: `/v3/projects/bc786cd53c124382a4c7cfd8b7e41636` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:35.653931 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225856c-41e6-41ca-9225-680abbc4599b admin admin] RBAC: Authorizing `identity:get_project(project_id=bc786cd53c124382a4c7cfd8b7e41636)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:35.706454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7225856c-41e6-41ca-9225-680abbc4599b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 11 16:11:35.706799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225856c-41e6-41ca-9225-680abbc4599b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:35.712028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 2/5] 10.222.0.40 () {56 vars in 1207 bytes} [Thu Aug 11 16:11:35 2022] GET /identity/v3/projects/bc786cd53c124382a4c7cfd8b7e41636 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:37.684231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b518e2-0ad3-41dd-8c2b-a1f335a4e04f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:37.684800 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b518e2-0ad3-41dd-8c2b-a1f335a4e04f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:37.684800 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b518e2-0ad3-41dd-8c2b-a1f335a4e04f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:37.688924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 4/6] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:37.694322 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b82e0-67d8-4a28-af84-63ee0c7796d5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:37.694728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b82e0-67d8-4a28-af84-63ee0c7796d5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:37.694902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b82e0-67d8-4a28-af84-63ee0c7796d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:37.716096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5e4b82e0-67d8-4a28-af84-63ee0c7796d5 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:37.717616 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5e4b82e0-67d8-4a28-af84-63ee0c7796d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:37.725297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 3/7] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 11 16:11:37.747147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b518e2-0ad3-41dd-8c2b-a1f335a4e04f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:37.759670 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b518e2-0ad3-41dd-8c2b-a1f335a4e04f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:37.763845 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80ab1b-4d94-4aca-a3fb-92538967fca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:37.764425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80ab1b-4d94-4aca-a3fb-92538967fca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:37.764737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80ab1b-4d94-4aca-a3fb-92538967fca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:37.765014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80ab1b-4d94-4aca-a3fb-92538967fca7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:37.772538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80ab1b-4d94-4aca-a3fb-92538967fca7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:37.774317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80ab1b-4d94-4aca-a3fb-92538967fca7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:37.782953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 5/8] 10.222.0.40 () {58 vars in 1324 bytes} [Thu Aug 11 16:11:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:11:37.788233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b82e0-67d8-4a28-af84-63ee0c7796d5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:37.797287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b82e0-67d8-4a28-af84-63ee0c7796d5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:37.801557 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a12fd-468f-4ec3-bedb-78c1b985a859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:37.802156 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a12fd-468f-4ec3-bedb-78c1b985a859 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:37.802430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a12fd-468f-4ec3-bedb-78c1b985a859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:37.802698 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a12fd-468f-4ec3-bedb-78c1b985a859 admin admin] PATH_INFO: `/v3/users/c190c69c93f440c9b6a6c24b62b15091` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:37.803981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a12fd-468f-4ec3-bedb-78c1b985a859 admin admin] RBAC: Authorizing `identity:get_user(user_id=c190c69c93f440c9b6a6c24b62b15091)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:37.806338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a12fd-468f-4ec3-bedb-78c1b985a859 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:37.807810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 4/9] 10.222.0.40 () {56 vars in 1198 bytes} [Thu Aug 11 16:11:37 2022] GET /identity/v3/users/c190c69c93f440c9b6a6c24b62b15091 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:39.884579 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea079649-8f84-433c-8bd6-abd660e30bd9 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:39.885165 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea079649-8f84-433c-8bd6-abd660e30bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:39.885165 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea079649-8f84-433c-8bd6-abd660e30bd9 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:39.886467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:39.891578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7d53c-f1ac-4bc7-b5d9-68c6136ec1df None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:39.891962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7d53c-f1ac-4bc7-b5d9-68c6136ec1df None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:39.892254 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7d53c-f1ac-4bc7-b5d9-68c6136ec1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:39.905660 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afb9b0-b362-4d6f-9e62-a87adf08ba3a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:39.905946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afb9b0-b362-4d6f-9e62-a87adf08ba3a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:39.906222 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afb9b0-b362-4d6f-9e62-a87adf08ba3a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:39.907502 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 7/11] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:11:39.911258 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e2c7d53c-f1ac-4bc7-b5d9-68c6136ec1df None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:39.912401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d85f0c-8aa2-469e-90f6-94513e1f2221 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:39.912508 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e2c7d53c-f1ac-4bc7-b5d9-68c6136ec1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:39.912716 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d85f0c-8aa2-469e-90f6-94513e1f2221 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:39.912993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d85f0c-8aa2-469e-90f6-94513e1f2221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:39.955506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG passlib.handlers.bcrypt [None req-36d85f0c-8aa2-469e-90f6-94513e1f2221 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81409) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 11 16:11:39.955929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG passlib.handlers.bcrypt [None req-36d85f0c-8aa2-469e-90f6-94513e1f2221 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81409) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 11 16:11:39.991123 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 5/12] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:11:40.009157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-36d85f0c-8aa2-469e-90f6-94513e1f2221 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:40.010748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-36d85f0c-8aa2-469e-90f6-94513e1f2221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:40.013722 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7d53c-f1ac-4bc7-b5d9-68c6136ec1df None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:40.037115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:40.111265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 8/13] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:11:40.121010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7d53c-f1ac-4bc7-b5d9-68c6136ec1df None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:40.133822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d85f0c-8aa2-469e-90f6-94513e1f2221 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:40.154989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c1433-b458-45b8-be73-cc7f5a7de38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:40.155550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c1433-b458-45b8-be73-cc7f5a7de38f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:40.155827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c1433-b458-45b8-be73-cc7f5a7de38f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:40.156096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c1433-b458-45b8-be73-cc7f5a7de38f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:40.167029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c1433-b458-45b8-be73-cc7f5a7de38f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-6a9c1433-b458-45b8-be73-cc7f5a7de38f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:11:40.175958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:11:40.176940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:11:40.177753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:11:40.177753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:11:40.177753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:11:40.177753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:11:40.177753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:11:40.177753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:11:40.177753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:11:40.177753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:11:40.177753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:11:40.177753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:11:40.177753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:11:40.177753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:11:40.177753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 6/14] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:11:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:11:40.183018 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c1433-b458-45b8-be73-cc7f5a7de38f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:40.235956 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d85f0c-8aa2-469e-90f6-94513e1f2221 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:40.238267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:40.264059 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:40.274196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5589d-dac3-4dcc-ab26-a3dff2caa242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:40.275039 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5589d-dac3-4dcc-ab26-a3dff2caa242 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:40.275316 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5589d-dac3-4dcc-ab26-a3dff2caa242 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:40.275588 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5589d-dac3-4dcc-ab26-a3dff2caa242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:40.283314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c1433-b458-45b8-be73-cc7f5a7de38f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:40.316736 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c92b60-1753-419d-8510-62836987bae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:40.317332 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c92b60-1753-419d-8510-62836987bae8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:40.317612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c92b60-1753-419d-8510-62836987bae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:40.317884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c92b60-1753-419d-8510-62836987bae8 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:40.318545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c92b60-1753-419d-8510-62836987bae8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:40.318843 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c92b60-1753-419d-8510-62836987bae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:40.320793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c92b60-1753-419d-8510-62836987bae8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:40.332270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 7/15] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:11:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:11:40.337920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c92b60-1753-419d-8510-62836987bae8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:40.341691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5589d-dac3-4dcc-ab26-a3dff2caa242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:40.343214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5589d-dac3-4dcc-ab26-a3dff2caa242 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:40.442371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 9/16] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 16:11:40.448973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5589d-dac3-4dcc-ab26-a3dff2caa242 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:40.452183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:40.542680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c92b60-1753-419d-8510-62836987bae8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:40.552383 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5589d-dac3-4dcc-ab26-a3dff2caa242 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:40.576881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa4edf-6ce8-401a-8a07-14e20dcd7a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:40.577508 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa4edf-6ce8-401a-8a07-14e20dcd7a81 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:40.577790 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa4edf-6ce8-401a-8a07-14e20dcd7a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:40.578061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa4edf-6ce8-401a-8a07-14e20dcd7a81 None admin] PATH_INFO: `/v3/users/c190c69c93f440c9b6a6c24b62b15091` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:40.579179 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa4edf-6ce8-401a-8a07-14e20dcd7a81 None admin] RBAC: Authorizing `identity:get_user(user_id=c190c69c93f440c9b6a6c24b62b15091)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:40.580677 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa4edf-6ce8-401a-8a07-14e20dcd7a81 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:40.582238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 8/17] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:11:40 2022] GET /identity/v3/users/c190c69c93f440c9b6a6c24b62b15091 => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:11:40.587253 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4149d-9e53-4286-b2a7-19336798270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:40.587792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa4edf-6ce8-401a-8a07-14e20dcd7a81 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:40.588297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4149d-9e53-4286-b2a7-19336798270c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:40.588710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4149d-9e53-4286-b2a7-19336798270c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:40.588981 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4149d-9e53-4286-b2a7-19336798270c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:40.602641 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:40.606896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4149d-9e53-4286-b2a7-19336798270c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:40.608368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4149d-9e53-4286-b2a7-19336798270c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-aba4149d-9e53-4286-b2a7-19336798270c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:11:40.633344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:11:40.634297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:11:40.635110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:11:40.635110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:11:40.635110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:11:40.635110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 10/18] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:11:40.641198 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4149d-9e53-4286-b2a7-19336798270c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:40.688250 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa4edf-6ce8-401a-8a07-14e20dcd7a81 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:40.698274 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:40.720901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5954f-2696-490a-b8ff-313ef1daeb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:40.721522 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5954f-2696-490a-b8ff-313ef1daeb8a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:40.721795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5954f-2696-490a-b8ff-313ef1daeb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:40.722062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5954f-2696-490a-b8ff-313ef1daeb8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:40.723166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5954f-2696-490a-b8ff-313ef1daeb8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:40.724624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5954f-2696-490a-b8ff-313ef1daeb8a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:40.731290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 9/19] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:11:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:11:40.732335 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5954f-2696-490a-b8ff-313ef1daeb8a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:40.743223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4149d-9e53-4286-b2a7-19336798270c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:40.776128 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b24583-38d7-481c-9821-8dd5513ec065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:40.776762 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b24583-38d7-481c-9821-8dd5513ec065 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:40.777053 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b24583-38d7-481c-9821-8dd5513ec065 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:40.777313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b24583-38d7-481c-9821-8dd5513ec065 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:40.777949 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b24583-38d7-481c-9821-8dd5513ec065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:40.778248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b24583-38d7-481c-9821-8dd5513ec065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:40.779607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b24583-38d7-481c-9821-8dd5513ec065 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:40.796443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 11/20] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:11:40.817706 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:40.838729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5954f-2696-490a-b8ff-313ef1daeb8a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:40.874172 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb31f1-5a99-436b-9e5c-e5be9dc54a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:40.874794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb31f1-5a99-436b-9e5c-e5be9dc54a0e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:40.875075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb31f1-5a99-436b-9e5c-e5be9dc54a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:40.875348 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb31f1-5a99-436b-9e5c-e5be9dc54a0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:40.876098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb31f1-5a99-436b-9e5c-e5be9dc54a0e None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.domain.id=default, user.id=c190c69c93f440c9b6a6c24b62b15091) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:40.876404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb31f1-5a99-436b-9e5c-e5be9dc54a0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:40.877910 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb31f1-5a99-436b-9e5c-e5be9dc54a0e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:40.885771 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 10/21] 10.222.0.40 () {56 vars in 1322 bytes} [Thu Aug 11 16:11:40 2022] GET /identity/v3/role_assignments?user.id=c190c69c93f440c9b6a6c24b62b15091&scope.domain.id=default&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:11:43.055922 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10c96-be7c-433c-8bf1-eefa5cf9f17a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:43.056956 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10c96-be7c-433c-8bf1-eefa5cf9f17a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:43.057454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10c96-be7c-433c-8bf1-eefa5cf9f17a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:43.058992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 12/22] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:43.064401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8b1d9-e21d-4f36-bec3-c542fcf0565c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:43.065237 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8b1d9-e21d-4f36-bec3-c542fcf0565c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:43.065708 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8b1d9-e21d-4f36-bec3-c542fcf0565c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:43.089222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9bc8b1d9-e21d-4f36-bec3-c542fcf0565c None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:43.090725 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9bc8b1d9-e21d-4f36-bec3-c542fcf0565c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:43.124378 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce27ba-acc1-4cd6-b2e7-c734e414fbcf None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:43.124696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce27ba-acc1-4cd6-b2e7-c734e414fbcf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:43.125387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce27ba-acc1-4cd6-b2e7-c734e414fbcf None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:43.127193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 13/23] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:43.133692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95423ce6-ab12-4860-a9eb-10e84672d547 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:43.134360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95423ce6-ab12-4860-a9eb-10e84672d547 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:43.134856 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95423ce6-ab12-4860-a9eb-10e84672d547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:43.172835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 11/24] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:11:43.173911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-95423ce6-ab12-4860-a9eb-10e84672d547 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:43.175150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-95423ce6-ab12-4860-a9eb-10e84672d547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:43.212539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8b1d9-e21d-4f36-bec3-c542fcf0565c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:43.281375 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 14/25] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:11:43.315848 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95423ce6-ab12-4860-a9eb-10e84672d547 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:43.352403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:43.389511 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8b1d9-e21d-4f36-bec3-c542fcf0565c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:43.401144 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:43.441281 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a1da1-b464-47f3-86ec-e8423e23656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:43.441931 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a1da1-b464-47f3-86ec-e8423e23656e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:43.442211 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a1da1-b464-47f3-86ec-e8423e23656e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:43.442488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a1da1-b464-47f3-86ec-e8423e23656e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:43.463743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a1da1-b464-47f3-86ec-e8423e23656e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:43.466647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a1da1-b464-47f3-86ec-e8423e23656e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:43.471126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95423ce6-ab12-4860-a9eb-10e84672d547 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5d9a1da1-b464-47f3-86ec-e8423e23656e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:11:43.495555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:11:43.496490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:11:43.497303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:11:43.497303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:11:43.497303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:11:43.497303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 12/26] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:11:43.503440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26008b-a507-491e-90c3-b3a71a71b7f1 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:43.503718 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26008b-a507-491e-90c3-b3a71a71b7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:43.503988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26008b-a507-491e-90c3-b3a71a71b7f1 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:43.505376 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:43.506394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26008b-a507-491e-90c3-b3a71a71b7f1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:43.577938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4bc84-4242-4880-97b6-34f225bd521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:43.578803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4bc84-4242-4880-97b6-34f225bd521c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:43.579225 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4bc84-4242-4880-97b6-34f225bd521c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:43.579645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4bc84-4242-4880-97b6-34f225bd521c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:43.618041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4bc84-4242-4880-97b6-34f225bd521c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-74d4bc84-4242-4880-97b6-34f225bd521c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:11:43.633411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:11:43.635380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:11:43.636827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:11:43.636827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:11:43.636827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:11:43.636827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:11:43.636827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:11:43.636827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:11:43.636827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:11:43.636827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:11:43.636827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:11:43.636827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:11:43.636827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:11:43.636827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:11:43.637553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26008b-a507-491e-90c3-b3a71a71b7f1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:43.637710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 15/28] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:11:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:11:43.637710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fe8b4-5e42-4753-b3f0-17605dd49b0e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:43.637710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fe8b4-5e42-4753-b3f0-17605dd49b0e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:43.637710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fe8b4-5e42-4753-b3f0-17605dd49b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:43.664210 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:43.678604 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb880e3-511c-41ef-87f2-9493ea0b5feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:43.679999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb880e3-511c-41ef-87f2-9493ea0b5feb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:43.680816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb880e3-511c-41ef-87f2-9493ea0b5feb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:43.681681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb880e3-511c-41ef-87f2-9493ea0b5feb None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:43.682464 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb880e3-511c-41ef-87f2-9493ea0b5feb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:43.682917 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb880e3-511c-41ef-87f2-9493ea0b5feb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:43.684434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb880e3-511c-41ef-87f2-9493ea0b5feb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:43.705679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 14/29] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:43.705990 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c92fe8b4-5e42-4753-b3f0-17605dd49b0e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:43.707185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c92fe8b4-5e42-4753-b3f0-17605dd49b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:43.707848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb880e3-511c-41ef-87f2-9493ea0b5feb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:43.839344 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb880e3-511c-41ef-87f2-9493ea0b5feb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:43.887625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0627734-9084-4aad-a2d1-68db5f305eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:43.888643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0627734-9084-4aad-a2d1-68db5f305eaa None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:43.889113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0627734-9084-4aad-a2d1-68db5f305eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:43.889637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0627734-9084-4aad-a2d1-68db5f305eaa None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:43.890546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0627734-9084-4aad-a2d1-68db5f305eaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:43.891036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0627734-9084-4aad-a2d1-68db5f305eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:43.892622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0627734-9084-4aad-a2d1-68db5f305eaa None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:43.902683 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 15/30] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:11:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:43.904755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0627734-9084-4aad-a2d1-68db5f305eaa None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:43.939805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 16/31] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:11:43.940653 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fe8b4-5e42-4753-b3f0-17605dd49b0e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:43.989164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:43.991386 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:44.049680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0627734-9084-4aad-a2d1-68db5f305eaa None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:44.065477 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fe8b4-5e42-4753-b3f0-17605dd49b0e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:44.091665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf1077-6f11-45b6-b18b-b0e2e14a3e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:44.092198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf1077-6f11-45b6-b18b-b0e2e14a3e0c None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:44.092482 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf1077-6f11-45b6-b18b-b0e2e14a3e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:44.092786 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf1077-6f11-45b6-b18b-b0e2e14a3e0c None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:44.093719 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf1077-6f11-45b6-b18b-b0e2e14a3e0c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:44.095357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf1077-6f11-45b6-b18b-b0e2e14a3e0c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:44.108632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afd980-10cc-4ce6-be4c-e99b7b963dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:44.109940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afd980-10cc-4ce6-be4c-e99b7b963dce None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:44.110361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afd980-10cc-4ce6-be4c-e99b7b963dce None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:44.110799 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afd980-10cc-4ce6-be4c-e99b7b963dce None admin] PATH_INFO: `/v3/users/c190c69c93f440c9b6a6c24b62b15091` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:44.113139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afd980-10cc-4ce6-be4c-e99b7b963dce None admin] RBAC: Authorizing `identity:get_user(user_id=c190c69c93f440c9b6a6c24b62b15091)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:44.116044 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afd980-10cc-4ce6-be4c-e99b7b963dce None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:44.120599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 17/32] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:11:43 2022] GET /identity/v3/users/c190c69c93f440c9b6a6c24b62b15091 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:44.122141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb04b48-c02c-478e-9d07-9c0bcf3398c7 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:44.122425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb04b48-c02c-478e-9d07-9c0bcf3398c7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:44.122720 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb04b48-c02c-478e-9d07-9c0bcf3398c7 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:44.123999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 18/33] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:44.124913 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb04b48-c02c-478e-9d07-9c0bcf3398c7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:44.247888 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb04b48-c02c-478e-9d07-9c0bcf3398c7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:44.256757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 16/34] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Aug 11 16:11:43 2022] POST /identity/v3/projects => generated 301 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:11:44.256967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:44.257043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845717d-db56-4353-87b6-f94533d6f36e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:44.257043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845717d-db56-4353-87b6-f94533d6f36e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:44.257043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845717d-db56-4353-87b6-f94533d6f36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:44.293761 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6845717d-db56-4353-87b6-f94533d6f36e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:44.295605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6845717d-db56-4353-87b6-f94533d6f36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:44.331275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06ce3b-e176-47fa-a7e4-4f8630c6658f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:44.331901 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06ce3b-e176-47fa-a7e4-4f8630c6658f None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:44.332178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06ce3b-e176-47fa-a7e4-4f8630c6658f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:44.332448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06ce3b-e176-47fa-a7e4-4f8630c6658f None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:44.333149 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06ce3b-e176-47fa-a7e4-4f8630c6658f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:44.334544 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06ce3b-e176-47fa-a7e4-4f8630c6658f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:44.476368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 17/35] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:11:44.478395 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845717d-db56-4353-87b6-f94533d6f36e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:44.513313 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:44.525427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 19/36] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Aug 11 16:11:44 2022] POST /identity/v3/roles => generated 219 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:11:44.526479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06ce3b-e176-47fa-a7e4-4f8630c6658f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:44.598904 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845717d-db56-4353-87b6-f94533d6f36e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:44.640550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210a824-defa-4dd0-9510-ef7a4811425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:44.641606 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210a824-defa-4dd0-9510-ef7a4811425a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:44.642088 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210a824-defa-4dd0-9510-ef7a4811425a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:44.642640 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210a824-defa-4dd0-9510-ef7a4811425a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:44.644776 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210a824-defa-4dd0-9510-ef7a4811425a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:44.646664 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210a824-defa-4dd0-9510-ef7a4811425a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:44.648784 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 18/37] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:11:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:44.652327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06ce3b-e176-47fa-a7e4-4f8630c6658f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:44.655724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210a824-defa-4dd0-9510-ef7a4811425a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:44.765293 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532d76a-8500-4313-b6ac-9a568c2437f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:44.765842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532d76a-8500-4313-b6ac-9a568c2437f0 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:44.766125 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532d76a-8500-4313-b6ac-9a568c2437f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:44.766400 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532d76a-8500-4313-b6ac-9a568c2437f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:44.766933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:44.767110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532d76a-8500-4313-b6ac-9a568c2437f0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:44.768610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532d76a-8500-4313-b6ac-9a568c2437f0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:44.771009 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210a824-defa-4dd0-9510-ef7a4811425a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:44.792116 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 20/38] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Aug 11 16:11:44 2022] POST /identity/v3/roles => generated 225 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:11:44.793808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80630df-dba2-490a-8e9f-fd5f8c144633 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:44.794369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80630df-dba2-490a-8e9f-fd5f8c144633 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:44.795107 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80630df-dba2-490a-8e9f-fd5f8c144633 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:44.796745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 21/39] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:44.803353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cde008-0f2c-4164-a348-3c13058cba54 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:44.803676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cde008-0f2c-4164-a348-3c13058cba54 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:44.803915 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cde008-0f2c-4164-a348-3c13058cba54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:44.822051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9e2e8-2204-44df-be4a-6601f06b0fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:44.823241 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9e2e8-2204-44df-be4a-6601f06b0fb7 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:44.823821 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9e2e8-2204-44df-be4a-6601f06b0fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:44.824294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9e2e8-2204-44df-be4a-6601f06b0fb7 None admin] PATH_INFO: `/v3/domains/default/users/c190c69c93f440c9b6a6c24b62b15091/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:44.826691 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9e2e8-2204-44df-be4a-6601f06b0fb7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c190c69c93f440c9b6a6c24b62b15091, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:44.828663 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9e2e8-2204-44df-be4a-6601f06b0fb7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:44.829523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-11cde008-0f2c-4164-a348-3c13058cba54 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:44.831377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-11cde008-0f2c-4164-a348-3c13058cba54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:44.847331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 19/40] 10.222.0.40 () {58 vars in 1361 bytes} [Thu Aug 11 16:11:44 2022] PUT /identity/v3/domains/default/users/c190c69c93f440c9b6a6c24b62b15091/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:11:44.856709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:44.924997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 22/41] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:11:44.951897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9e2e8-2204-44df-be4a-6601f06b0fb7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:45.013568 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbda6eb-97ce-44f8-81c3-5e22887ec61f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:45.013885 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbda6eb-97ce-44f8-81c3-5e22887ec61f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:45.014138 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbda6eb-97ce-44f8-81c3-5e22887ec61f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:45.015620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 23/42] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:45.021330 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a0630-a78c-457a-bb7c-b5eb48f939ff None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:45.021628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a0630-a78c-457a-bb7c-b5eb48f939ff None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:45.021891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a0630-a78c-457a-bb7c-b5eb48f939ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:45.041460 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d41a0630-a78c-457a-bb7c-b5eb48f939ff None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:45.044909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d41a0630-a78c-457a-bb7c-b5eb48f939ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:45.091793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9e2e8-2204-44df-be4a-6601f06b0fb7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:45.129177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123c341-1fe1-4c4f-a01c-e043f018f3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:45.130024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123c341-1fe1-4c4f-a01c-e043f018f3a9 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:45.130451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123c341-1fe1-4c4f-a01c-e043f018f3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:45.130869 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123c341-1fe1-4c4f-a01c-e043f018f3a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:45.131178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 24/43] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:11:45.132208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123c341-1fe1-4c4f-a01c-e043f018f3a9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:45.133776 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123c341-1fe1-4c4f-a01c-e043f018f3a9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:45.150045 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 20/44] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Aug 11 16:11:44 2022] POST /identity/v3/roles => generated 223 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:11:45.155965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a0630-a78c-457a-bb7c-b5eb48f939ff None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:45.245052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:45.262106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a0630-a78c-457a-bb7c-b5eb48f939ff None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:45.298429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd5f83-c98c-4a49-b119-783df03aaef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:45.298981 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd5f83-c98c-4a49-b119-783df03aaef3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:45.299258 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd5f83-c98c-4a49-b119-783df03aaef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:45.299531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd5f83-c98c-4a49-b119-783df03aaef3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:45.300679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd5f83-c98c-4a49-b119-783df03aaef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:45.302423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd5f83-c98c-4a49-b119-783df03aaef3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:45.304551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 25/45] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:11:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:45.310533 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123c341-1fe1-4c4f-a01c-e043f018f3a9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:45.332199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:45.415519 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123c341-1fe1-4c4f-a01c-e043f018f3a9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:45.448361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b45f5-b87e-410b-8ec8-6f2c9618eb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:45.449001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b45f5-b87e-410b-8ec8-6f2c9618eb6d None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:45.449280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b45f5-b87e-410b-8ec8-6f2c9618eb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:45.449553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b45f5-b87e-410b-8ec8-6f2c9618eb6d None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:45.450195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b45f5-b87e-410b-8ec8-6f2c9618eb6d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:45.451666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b45f5-b87e-410b-8ec8-6f2c9618eb6d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:45.481374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 21/46] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Aug 11 16:11:45 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:11:46.921994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5af27-fb93-463f-a046-882e12cb48cf None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:46.922538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5af27-fb93-463f-a046-882e12cb48cf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:46.922538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5af27-fb93-463f-a046-882e12cb48cf None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:46.923886 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 26/47] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:46.929610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d190d-08e5-4fa8-b619-a3d61c20d46b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:46.929993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d190d-08e5-4fa8-b619-a3d61c20d46b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:46.930229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d190d-08e5-4fa8-b619-a3d61c20d46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:46.947574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-db2d190d-08e5-4fa8-b619-a3d61c20d46b None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:46.948769 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-db2d190d-08e5-4fa8-b619-a3d61c20d46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:47.009614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:47.014701 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 22/48] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:11:47.036748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5af27-fb93-463f-a046-882e12cb48cf None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:47.137590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5af27-fb93-463f-a046-882e12cb48cf None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:47.170912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb1638-a1a3-4f67-a1f6-940e375e484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:47.171528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb1638-a1a3-4f67-a1f6-940e375e484e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:47.171803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb1638-a1a3-4f67-a1f6-940e375e484e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:47.172117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb1638-a1a3-4f67-a1f6-940e375e484e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:47.182527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb1638-a1a3-4f67-a1f6-940e375e484e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e8cb1638-a1a3-4f67-a1f6-940e375e484e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:11:47.187173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:11:47.188027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:11:47.188815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:11:47.188815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:11:47.188815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:11:47.188815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:11:47.188815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:11:47.188815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:11:47.188815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:11:47.188815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:11:47.188815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:11:47.188815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:11:47.188815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:11:47.188815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:11:47.188815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 27/49] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:11:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:11:47.194229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d190d-08e5-4fa8-b619-a3d61c20d46b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:47.288912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d190d-08e5-4fa8-b619-a3d61c20d46b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:47.325614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbf160-48ce-43ce-b341-be3ecc67314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:47.326227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbf160-48ce-43ce-b341-be3ecc67314c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:47.326511 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbf160-48ce-43ce-b341-be3ecc67314c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:47.326791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbf160-48ce-43ce-b341-be3ecc67314c None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:47.327462 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbf160-48ce-43ce-b341-be3ecc67314c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:47.327769 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbf160-48ce-43ce-b341-be3ecc67314c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:47.329187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbf160-48ce-43ce-b341-be3ecc67314c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:47.337522 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 23/50] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:11:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:47.342976 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb1638-a1a3-4f67-a1f6-940e375e484e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:47.357962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:47.440977 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb1638-a1a3-4f67-a1f6-940e375e484e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:47.476156 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab20fe-2a85-4be3-b308-60c879a125de None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:47.476444 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab20fe-2a85-4be3-b308-60c879a125de None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:47.476753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab20fe-2a85-4be3-b308-60c879a125de None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:47.477359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f00228-0fea-459e-aa7d-f4b62ae2d7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:47.477995 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f00228-0fea-459e-aa7d-f4b62ae2d7ac None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:47.478077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 24/51] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:11:47.478279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f00228-0fea-459e-aa7d-f4b62ae2d7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:47.478554 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f00228-0fea-459e-aa7d-f4b62ae2d7ac None admin] PATH_INFO: `/v3/users/c190c69c93f440c9b6a6c24b62b15091` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:47.479682 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f00228-0fea-459e-aa7d-f4b62ae2d7ac None admin] RBAC: Authorizing `identity:get_user(user_id=c190c69c93f440c9b6a6c24b62b15091)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:47.481186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f00228-0fea-459e-aa7d-f4b62ae2d7ac None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:47.483722 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 28/52] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:11:47 2022] GET /identity/v3/users/c190c69c93f440c9b6a6c24b62b15091 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:47.483862 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e182ab9-19ee-46b7-9bb7-d0cc83dc9aa3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:47.483862 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e182ab9-19ee-46b7-9bb7-d0cc83dc9aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:47.483862 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e182ab9-19ee-46b7-9bb7-d0cc83dc9aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:47.487884 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f00228-0fea-459e-aa7d-f4b62ae2d7ac None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:47.501527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4e182ab9-19ee-46b7-9bb7-d0cc83dc9aa3 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:47.502709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4e182ab9-19ee-46b7-9bb7-d0cc83dc9aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:47.558559 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:47.568967 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 25/53] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:11:47.570020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:47.589418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f00228-0fea-459e-aa7d-f4b62ae2d7ac None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:47.591841 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e182ab9-19ee-46b7-9bb7-d0cc83dc9aa3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:47.625183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19eff23-3e50-4319-8d14-a77054ada9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:47.625809 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eff23-3e50-4319-8d14-a77054ada9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:47.626087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eff23-3e50-4319-8d14-a77054ada9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:47.626361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eff23-3e50-4319-8d14-a77054ada9a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:47.627481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19eff23-3e50-4319-8d14-a77054ada9a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:47.628942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19eff23-3e50-4319-8d14-a77054ada9a3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:47.630500 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 29/54] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:11:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:11:47.636629 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19eff23-3e50-4319-8d14-a77054ada9a3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:47.689671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e182ab9-19ee-46b7-9bb7-d0cc83dc9aa3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:47.722257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499254a-8be6-4548-8d96-4f14bbcf6971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:47.722812 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499254a-8be6-4548-8d96-4f14bbcf6971 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:47.723089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499254a-8be6-4548-8d96-4f14bbcf6971 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:47.723360 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499254a-8be6-4548-8d96-4f14bbcf6971 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:47.724470 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499254a-8be6-4548-8d96-4f14bbcf6971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:47.726563 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499254a-8be6-4548-8d96-4f14bbcf6971 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:47.728147 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 26/55] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:11:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:11:47.733610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499254a-8be6-4548-8d96-4f14bbcf6971 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:47.733726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19eff23-3e50-4319-8d14-a77054ada9a3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:47.766919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1882d93-7b0f-4c0a-b2a4-00c1544ed0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:47.767508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1882d93-7b0f-4c0a-b2a4-00c1544ed0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:47.767789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1882d93-7b0f-4c0a-b2a4-00c1544ed0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:47.768061 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1882d93-7b0f-4c0a-b2a4-00c1544ed0c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:47.768806 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1882d93-7b0f-4c0a-b2a4-00c1544ed0c0 None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.domain.id=default, user.id=c190c69c93f440c9b6a6c24b62b15091) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:47.769113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1882d93-7b0f-4c0a-b2a4-00c1544ed0c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:47.770527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1882d93-7b0f-4c0a-b2a4-00c1544ed0c0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:47.778905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 30/56] 10.222.0.40 () {56 vars in 1322 bytes} [Thu Aug 11 16:11:47 2022] GET /identity/v3/role_assignments?user.id=c190c69c93f440c9b6a6c24b62b15091&scope.domain.id=default&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:11:47.789918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:47.833587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499254a-8be6-4548-8d96-4f14bbcf6971 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:47.869666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8695579-2c71-42e3-88ee-830482ff6033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:47.870285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8695579-2c71-42e3-88ee-830482ff6033 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:47.870742 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8695579-2c71-42e3-88ee-830482ff6033 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:47.871019 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8695579-2c71-42e3-88ee-830482ff6033 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:47.871673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8695579-2c71-42e3-88ee-830482ff6033 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:47.873184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8695579-2c71-42e3-88ee-830482ff6033 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:47.900481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 27/57] 10.222.0.40 () {60 vars in 1140 bytes} [Thu Aug 11 16:11:47 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:11:49.886033 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108465d-66df-40f8-af4f-6a08767017f4 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:49.886561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108465d-66df-40f8-af4f-6a08767017f4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:49.886561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108465d-66df-40f8-af4f-6a08767017f4 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:49.887940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 31/58] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:49.893067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db43f8-08df-4b03-8b43-271cbb2eb953 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:49.893478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db43f8-08df-4b03-8b43-271cbb2eb953 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:49.893624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db43f8-08df-4b03-8b43-271cbb2eb953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:49.911697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-33db43f8-08df-4b03-8b43-271cbb2eb953 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:49.912910 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-33db43f8-08df-4b03-8b43-271cbb2eb953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:49.976815 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 28/59] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:11:49.999882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108465d-66df-40f8-af4f-6a08767017f4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:50.015301 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:50.109813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108465d-66df-40f8-af4f-6a08767017f4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:50.147041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a0371-77e0-4cf3-866c-a61182966b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:50.147607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a0371-77e0-4cf3-866c-a61182966b97 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:50.147902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a0371-77e0-4cf3-866c-a61182966b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:50.148176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a0371-77e0-4cf3-866c-a61182966b97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:50.149918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a0371-77e0-4cf3-866c-a61182966b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:50.151357 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a0371-77e0-4cf3-866c-a61182966b97 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:50.152940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 32/60] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:11:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:50.158518 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db43f8-08df-4b03-8b43-271cbb2eb953 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:50.199820 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:50.254143 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db43f8-08df-4b03-8b43-271cbb2eb953 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:50.286874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e00220-52f5-4a57-9827-4fee5424dd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:50.287463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e00220-52f5-4a57-9827-4fee5424dd64 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:50.287741 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e00220-52f5-4a57-9827-4fee5424dd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:50.288012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e00220-52f5-4a57-9827-4fee5424dd64 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:50.288695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e00220-52f5-4a57-9827-4fee5424dd64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:50.290130 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e00220-52f5-4a57-9827-4fee5424dd64 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:50.315494 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 29/61] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:11:50 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:11:53.606992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86acb3-aac4-4248-93b0-dd34210010fe None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:53.608472 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86acb3-aac4-4248-93b0-dd34210010fe None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:53.609279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86acb3-aac4-4248-93b0-dd34210010fe None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:53.612014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 33/62] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:53.617961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77ec5a-2fae-4a1c-8bb2-fdb0afebd269 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:53.618558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77ec5a-2fae-4a1c-8bb2-fdb0afebd269 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:53.618558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77ec5a-2fae-4a1c-8bb2-fdb0afebd269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:53.631162 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c8b95-3fdd-4547-b4ad-a33ba2987082 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:53.631464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c8b95-3fdd-4547-b4ad-a33ba2987082 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:53.631747 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c8b95-3fdd-4547-b4ad-a33ba2987082 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:53.633254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 34/63] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:53.638565 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda79691-6d03-42ff-a5cb-180d26b2715a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:53.638851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda79691-6d03-42ff-a5cb-180d26b2715a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:53.639128 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda79691-6d03-42ff-a5cb-180d26b2715a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:53.641924 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7f77ec5a-2fae-4a1c-8bb2-fdb0afebd269 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:53.643318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7f77ec5a-2fae-4a1c-8bb2-fdb0afebd269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:53.673191 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-dda79691-6d03-42ff-a5cb-180d26b2715a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:53.674398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dda79691-6d03-42ff-a5cb-180d26b2715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:53.773614 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 35/64] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:11:53.798737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda79691-6d03-42ff-a5cb-180d26b2715a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:53.805310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 30/65] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:11:53.832473 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:53.837523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77ec5a-2fae-4a1c-8bb2-fdb0afebd269 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:53.910843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda79691-6d03-42ff-a5cb-180d26b2715a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:53.915282 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:53.953400 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092437a-a67a-4a59-a1f9-7ee68f6eb52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:53.954043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092437a-a67a-4a59-a1f9-7ee68f6eb52b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:53.954320 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092437a-a67a-4a59-a1f9-7ee68f6eb52b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:53.954587 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092437a-a67a-4a59-a1f9-7ee68f6eb52b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:53.974348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092437a-a67a-4a59-a1f9-7ee68f6eb52b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-1092437a-a67a-4a59-a1f9-7ee68f6eb52b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:11:53.982617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:11:53.983455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:11:53.984185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:11:53.984185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:11:53.984185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:11:53.984185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:11:53.984185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:11:53.984185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:11:53.984185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:11:53.984185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:11:53.984185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:11:53.984185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:11:53.984185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:11:53.984185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:11:53.984185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 36/66] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:11:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:11:53.991319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092437a-a67a-4a59-a1f9-7ee68f6eb52b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:54.065371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77ec5a-2fae-4a1c-8bb2-fdb0afebd269 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:54.102500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee88e8d-ce6f-412c-b4fc-72d17cd29458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:54.103145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee88e8d-ce6f-412c-b4fc-72d17cd29458 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:54.103424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee88e8d-ce6f-412c-b4fc-72d17cd29458 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:54.103696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee88e8d-ce6f-412c-b4fc-72d17cd29458 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:54.104995 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:54.117734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee88e8d-ce6f-412c-b4fc-72d17cd29458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-6ee88e8d-ce6f-412c-b4fc-72d17cd29458 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:11:54.122934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:11:54.123779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:11:54.124531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:11:54.124531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:11:54.124531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:11:54.124531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:11:54.124531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:11:54.124531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:11:54.124531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:11:54.124531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:11:54.124531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:11:54.124531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:11:54.124531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:11:54.124531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:11:54.124531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 31/67] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:11:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:11:54.126541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcf2a3-8d84-4163-84c3-bd3d5e348da7 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:54.126886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcf2a3-8d84-4163-84c3-bd3d5e348da7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:54.127222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcf2a3-8d84-4163-84c3-bd3d5e348da7 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:54.128696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 32/68] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:54.133457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcf2a3-8d84-4163-84c3-bd3d5e348da7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:54.146109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092437a-a67a-4a59-a1f9-7ee68f6eb52b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:54.191299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0bf47-b372-4b31-9eea-bba3e5811352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:54.192712 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0bf47-b372-4b31-9eea-bba3e5811352 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:54.193440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0bf47-b372-4b31-9eea-bba3e5811352 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:54.193890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0bf47-b372-4b31-9eea-bba3e5811352 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:54.195020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0bf47-b372-4b31-9eea-bba3e5811352 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:54.195876 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0bf47-b372-4b31-9eea-bba3e5811352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:54.197494 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0bf47-b372-4b31-9eea-bba3e5811352 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:54.215370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 37/69] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:11:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:54.216994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4c806-14e1-4a3a-b0ee-86a3b50f357d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:54.217438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4c806-14e1-4a3a-b0ee-86a3b50f357d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:54.217868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4c806-14e1-4a3a-b0ee-86a3b50f357d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:54.240358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-10e4c806-14e1-4a3a-b0ee-86a3b50f357d None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:54.241679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:54.244189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-10e4c806-14e1-4a3a-b0ee-86a3b50f357d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:54.256104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcf2a3-8d84-4163-84c3-bd3d5e348da7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:54.295174 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad094daa-2865-4d77-a836-a5b5b38225ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:54.295875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad094daa-2865-4d77-a836-a5b5b38225ce None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:54.296220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad094daa-2865-4d77-a836-a5b5b38225ce None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:54.296573 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad094daa-2865-4d77-a836-a5b5b38225ce None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:54.297333 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad094daa-2865-4d77-a836-a5b5b38225ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:54.297698 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad094daa-2865-4d77-a836-a5b5b38225ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:54.299169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad094daa-2865-4d77-a836-a5b5b38225ce None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:54.309011 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 33/70] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:11:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:54.310371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad094daa-2865-4d77-a836-a5b5b38225ce None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:54.336561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 38/71] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:11:54.337859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4c806-14e1-4a3a-b0ee-86a3b50f357d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:54.416341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:54.447578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad094daa-2865-4d77-a836-a5b5b38225ce None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:54.459457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4c806-14e1-4a3a-b0ee-86a3b50f357d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:54.484448 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2cf41-8f6e-42fe-881f-a0220dbd52f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:54.485111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2cf41-8f6e-42fe-881f-a0220dbd52f4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:54.485393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2cf41-8f6e-42fe-881f-a0220dbd52f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:54.485667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2cf41-8f6e-42fe-881f-a0220dbd52f4 None admin] PATH_INFO: `/v3/users/25ba51db172e4f3bba446da546398dbd` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:54.493673 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f71684-929b-4bbb-981f-c480f2aa2ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:54.494291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f71684-929b-4bbb-981f-c480f2aa2ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:54.494572 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f71684-929b-4bbb-981f-c480f2aa2ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:54.494845 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f71684-929b-4bbb-981f-c480f2aa2ac3 None admin] PATH_INFO: `/v3/users/c190c69c93f440c9b6a6c24b62b15091` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:54.495953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f71684-929b-4bbb-981f-c480f2aa2ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=c190c69c93f440c9b6a6c24b62b15091)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:54.497407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f71684-929b-4bbb-981f-c480f2aa2ac3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:54.498912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2cf41-8f6e-42fe-881f-a0220dbd52f4 None admin] RBAC: Authorizing `identity:get_user(user_id=25ba51db172e4f3bba446da546398dbd)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:54.498998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 39/72] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:11:54 2022] GET /identity/v3/users/c190c69c93f440c9b6a6c24b62b15091 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:54.500778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f71684-929b-4bbb-981f-c480f2aa2ac3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:54.500864 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2cf41-8f6e-42fe-881f-a0220dbd52f4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:54.502172 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 34/73] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:11:54 2022] GET /identity/v3/users/25ba51db172e4f3bba446da546398dbd => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:54.503206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de38cfa-9007-436b-b6d4-86d51131b724 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:54.503720 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de38cfa-9007-436b-b6d4-86d51131b724 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:54.503823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de38cfa-9007-436b-b6d4-86d51131b724 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:54.504976 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 35/74] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:54.505984 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9accf-cc6d-443e-a325-e17949fbb2ed None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:54.506249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9accf-cc6d-443e-a325-e17949fbb2ed None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:54.506523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9accf-cc6d-443e-a325-e17949fbb2ed None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:54.508250 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 36/75] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:54.508986 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9accf-cc6d-443e-a325-e17949fbb2ed None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:54.519225 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:54.608921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f71684-929b-4bbb-981f-c480f2aa2ac3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:54.610723 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9accf-cc6d-443e-a325-e17949fbb2ed None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:54.637189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:54.643177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45454f0-96a4-414c-9d77-029ac5b7be07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:54.643801 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45454f0-96a4-414c-9d77-029ac5b7be07 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:54.644049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c9dfb-3db9-4283-8924-7f9830676f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:54.644504 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45454f0-96a4-414c-9d77-029ac5b7be07 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:54.644504 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45454f0-96a4-414c-9d77-029ac5b7be07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:54.644715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c9dfb-3db9-4283-8924-7f9830676f14 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:54.644941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c9dfb-3db9-4283-8924-7f9830676f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:54.645209 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c9dfb-3db9-4283-8924-7f9830676f14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:54.654699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45454f0-96a4-414c-9d77-029ac5b7be07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e45454f0-96a4-414c-9d77-029ac5b7be07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:11:54.659295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:11:54.660112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:11:54.660912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:11:54.660912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:11:54.660912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:11:54.660912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:11:54.660912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:11:54.660912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:11:54.660912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:11:54.660912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:11:54.660912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:11:54.660912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:11:54.660912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:11:54.660912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:11:54.660912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 40/76] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:11:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:11:54.662781 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45454f0-96a4-414c-9d77-029ac5b7be07 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:54.710962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c9dfb-3db9-4283-8924-7f9830676f14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:54.712436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c9dfb-3db9-4283-8924-7f9830676f14 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:54.721566 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:54.763337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45454f0-96a4-414c-9d77-029ac5b7be07 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:54.800263 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc3065-775c-4d23-a4aa-3577820b4c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:54.800895 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc3065-775c-4d23-a4aa-3577820b4c65 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:54.801175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc3065-775c-4d23-a4aa-3577820b4c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:54.801447 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc3065-775c-4d23-a4aa-3577820b4c65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:54.824494 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 37/77] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:11:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:11:54.824494 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cb5c2-bb1d-4fe1-a75e-8b469180c00d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:54.824494 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cb5c2-bb1d-4fe1-a75e-8b469180c00d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:54.824494 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cb5c2-bb1d-4fe1-a75e-8b469180c00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:54.843071 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-336cb5c2-bb1d-4fe1-a75e-8b469180c00d None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:54.844262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-336cb5c2-bb1d-4fe1-a75e-8b469180c00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:54.864184 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:54.875183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc3065-775c-4d23-a4aa-3577820b4c65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:54.876640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc3065-775c-4d23-a4aa-3577820b4c65 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:54.909769 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 38/78] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:11:54.910986 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1865ff-5b47-4708-b15b-3884a1c28fee None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:54.911270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1865ff-5b47-4708-b15b-3884a1c28fee None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:54.911540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1865ff-5b47-4708-b15b-3884a1c28fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:54.929047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5e1865ff-5b47-4708-b15b-3884a1c28fee None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:54.930251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5e1865ff-5b47-4708-b15b-3884a1c28fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:54.958898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:54.983204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 41/79] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:11:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:11:54.984058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc3065-775c-4d23-a4aa-3577820b4c65 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:54.996672 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 39/80] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:11:55.008748 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1865ff-5b47-4708-b15b-3884a1c28fee None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:55.072864 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:55.084137 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc3065-775c-4d23-a4aa-3577820b4c65 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:55.115071 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1865ff-5b47-4708-b15b-3884a1c28fee None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:55.124354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a642c-80be-4ff5-9c0b-d597b95105ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:55.125007 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a642c-80be-4ff5-9c0b-d597b95105ee None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:55.125287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a642c-80be-4ff5-9c0b-d597b95105ee None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:55.125561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a642c-80be-4ff5-9c0b-d597b95105ee None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:55.126207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a642c-80be-4ff5-9c0b-d597b95105ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:55.126513 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a642c-80be-4ff5-9c0b-d597b95105ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:55.127861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a642c-80be-4ff5-9c0b-d597b95105ee None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:55.136259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 42/81] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:11:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:55.137097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a642c-80be-4ff5-9c0b-d597b95105ee None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:55.153666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374007bc-ebd6-4620-91b7-467b6b9ba524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:55.154292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374007bc-ebd6-4620-91b7-467b6b9ba524 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:55.154569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374007bc-ebd6-4620-91b7-467b6b9ba524 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:55.154834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374007bc-ebd6-4620-91b7-467b6b9ba524 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:55.155934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374007bc-ebd6-4620-91b7-467b6b9ba524 None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:55.157436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374007bc-ebd6-4620-91b7-467b6b9ba524 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:55.163645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 40/82] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:11:54 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:55.163645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374007bc-ebd6-4620-91b7-467b6b9ba524 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:55.196159 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:55.237554 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a642c-80be-4ff5-9c0b-d597b95105ee None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:55.261770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374007bc-ebd6-4620-91b7-467b6b9ba524 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:55.270618 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74451251-7d53-4f72-b2c3-34abc8da2961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:55.271235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74451251-7d53-4f72-b2c3-34abc8da2961 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:55.271517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74451251-7d53-4f72-b2c3-34abc8da2961 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:55.271789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74451251-7d53-4f72-b2c3-34abc8da2961 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:55.273446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74451251-7d53-4f72-b2c3-34abc8da2961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:55.274882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74451251-7d53-4f72-b2c3-34abc8da2961 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:55.276431 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 43/83] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:11:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:55.277215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74451251-7d53-4f72-b2c3-34abc8da2961 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:55.298739 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:55.300955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8486dd-0d62-49f0-8147-d774597f0dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:55.301579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8486dd-0d62-49f0-8147-d774597f0dfa None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:55.301863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8486dd-0d62-49f0-8147-d774597f0dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:55.302134 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8486dd-0d62-49f0-8147-d774597f0dfa None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:55.303241 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8486dd-0d62-49f0-8147-d774597f0dfa None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:55.304745 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8486dd-0d62-49f0-8147-d774597f0dfa None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:55.306348 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 41/84] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:11:55 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:55.307103 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8486dd-0d62-49f0-8147-d774597f0dfa None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:55.375778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74451251-7d53-4f72-b2c3-34abc8da2961 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:55.404089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8486dd-0d62-49f0-8147-d774597f0dfa None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:55.406355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:55.409213 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e0894-8f0b-41c1-9fd9-2c2591698e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:55.409838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e0894-8f0b-41c1-9fd9-2c2591698e33 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:55.410118 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e0894-8f0b-41c1-9fd9-2c2591698e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:55.410399 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e0894-8f0b-41c1-9fd9-2c2591698e33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:55.420778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e0894-8f0b-41c1-9fd9-2c2591698e33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-dc5e0894-8f0b-41c1-9fd9-2c2591698e33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:11:55.425853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:11:55.426871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:11:55.427823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:11:55.427823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:11:55.427823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:11:55.427823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:11:55.427823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:11:55.427823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:11:55.427823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:11:55.427823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:11:55.427823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:11:55.427823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:11:55.427823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:11:55.427823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:11:55.427823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 44/85] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:11:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:11:55.427823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e0894-8f0b-41c1-9fd9-2c2591698e33 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:55.440018 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413226a-45d3-4687-a078-edbc7ab71590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:55.440676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413226a-45d3-4687-a078-edbc7ab71590 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:55.440956 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413226a-45d3-4687-a078-edbc7ab71590 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:55.441230 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413226a-45d3-4687-a078-edbc7ab71590 None admin] PATH_INFO: `/v3/users/25ba51db172e4f3bba446da546398dbd` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:55.442340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413226a-45d3-4687-a078-edbc7ab71590 None admin] RBAC: Authorizing `identity:get_user(user_id=25ba51db172e4f3bba446da546398dbd)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:55.443797 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413226a-45d3-4687-a078-edbc7ab71590 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:55.446066 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 42/86] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:11:55 2022] GET /identity/v3/users/25ba51db172e4f3bba446da546398dbd => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:55.446823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413226a-45d3-4687-a078-edbc7ab71590 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:55.512405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:55.531054 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e0894-8f0b-41c1-9fd9-2c2591698e33 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:55.548140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413226a-45d3-4687-a078-edbc7ab71590 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:55.563536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5653e-5601-413c-80d0-4d764b2b070a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:55.564131 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5653e-5601-413c-80d0-4d764b2b070a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:55.564406 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5653e-5601-413c-80d0-4d764b2b070a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:55.564711 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5653e-5601-413c-80d0-4d764b2b070a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:55.565425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5653e-5601-413c-80d0-4d764b2b070a None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=c22b8f7f1cc4484180061823f1584623, user.id=c190c69c93f440c9b6a6c24b62b15091) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:55.565753 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5653e-5601-413c-80d0-4d764b2b070a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:55.567187 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5653e-5601-413c-80d0-4d764b2b070a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:55.573074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 45/87] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:11:55 2022] GET /identity/v3/role_assignments?user.id=c190c69c93f440c9b6a6c24b62b15091&scope.project.id=c22b8f7f1cc4484180061823f1584623&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:55.573848 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5653e-5601-413c-80d0-4d764b2b070a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:55.583831 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be17f3-3532-4850-8c35-651ca595a364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:55.584460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be17f3-3532-4850-8c35-651ca595a364 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:55.584873 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be17f3-3532-4850-8c35-651ca595a364 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:55.585154 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be17f3-3532-4850-8c35-651ca595a364 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:55.585808 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be17f3-3532-4850-8c35-651ca595a364 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:55.587314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be17f3-3532-4850-8c35-651ca595a364 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:55.613897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 43/88] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:11:55 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:11:55.614671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be17f3-3532-4850-8c35-651ca595a364 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:55.655585 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:55.728602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5653e-5601-413c-80d0-4d764b2b070a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:55.751993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be17f3-3532-4850-8c35-651ca595a364 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:55.776191 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9da3f-6579-4c49-b693-ea9aac419374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:55.776858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9da3f-6579-4c49-b693-ea9aac419374 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:55.777141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9da3f-6579-4c49-b693-ea9aac419374 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:55.777411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9da3f-6579-4c49-b693-ea9aac419374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:55.778190 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9da3f-6579-4c49-b693-ea9aac419374 None admin] RBAC: Adding query filter params (role.id=87abba8d76c2420c97d9d5f2dbb6b540, scope.project.id=c22b8f7f1cc4484180061823f1584623, user.id=25ba51db172e4f3bba446da546398dbd) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:55.778545 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9da3f-6579-4c49-b693-ea9aac419374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:55.779983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9da3f-6579-4c49-b693-ea9aac419374 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:55.785821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 46/89] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:11:55 2022] GET /identity/v3/role_assignments?user.id=25ba51db172e4f3bba446da546398dbd&scope.project.id=c22b8f7f1cc4484180061823f1584623&role.id=87abba8d76c2420c97d9d5f2dbb6b540 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:55.786728 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9da3f-6579-4c49-b693-ea9aac419374 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:55.799169 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:55.808359 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf25aa5-8da7-4a40-aa46-c61f12549da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:55.809714 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf25aa5-8da7-4a40-aa46-c61f12549da4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:55.810654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf25aa5-8da7-4a40-aa46-c61f12549da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:55.811137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf25aa5-8da7-4a40-aa46-c61f12549da4 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:55.812050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf25aa5-8da7-4a40-aa46-c61f12549da4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:55.812579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf25aa5-8da7-4a40-aa46-c61f12549da4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:55.814948 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf25aa5-8da7-4a40-aa46-c61f12549da4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:55.828574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 44/90] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:11:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:55.834643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf25aa5-8da7-4a40-aa46-c61f12549da4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:55.911126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9da3f-6579-4c49-b693-ea9aac419374 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:55.953155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b33bd-062e-4b2a-a10d-7bccad85806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:55.954250 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b33bd-062e-4b2a-a10d-7bccad85806e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:55.954731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b33bd-062e-4b2a-a10d-7bccad85806e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:55.955201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b33bd-062e-4b2a-a10d-7bccad85806e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:55.956599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:55.971121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf25aa5-8da7-4a40-aa46-c61f12549da4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:56.019612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e69293-534a-464d-9d54-20e10aafd88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:56.021803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e69293-534a-464d-9d54-20e10aafd88f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:56.022104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e69293-534a-464d-9d54-20e10aafd88f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:56.022645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e69293-534a-464d-9d54-20e10aafd88f None admin] PATH_INFO: `/v3/users/25ba51db172e4f3bba446da546398dbd` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:56.023839 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e69293-534a-464d-9d54-20e10aafd88f None admin] RBAC: Authorizing `identity:get_user(user_id=25ba51db172e4f3bba446da546398dbd)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:56.025790 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e69293-534a-464d-9d54-20e10aafd88f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:56.027473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 45/91] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:11:55 2022] GET /identity/v3/users/25ba51db172e4f3bba446da546398dbd => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:56.034042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e69293-534a-464d-9d54-20e10aafd88f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:56.051247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b33bd-062e-4b2a-a10d-7bccad85806e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:56.053025 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b33bd-062e-4b2a-a10d-7bccad85806e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:56.064300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:56.160804 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 47/92] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:11:56.167033 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b33bd-062e-4b2a-a10d-7bccad85806e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:56.183694 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e69293-534a-464d-9d54-20e10aafd88f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:56.229210 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c339687-b55a-42ac-9c60-4e2f295944e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:56.230770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c339687-b55a-42ac-9c60-4e2f295944e0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:56.231228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c339687-b55a-42ac-9c60-4e2f295944e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:56.231947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c339687-b55a-42ac-9c60-4e2f295944e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:56.268305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:56.284816 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b33bd-062e-4b2a-a10d-7bccad85806e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:56.295444 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:56.316153 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c339687-b55a-42ac-9c60-4e2f295944e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:56.317680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c339687-b55a-42ac-9c60-4e2f295944e0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:56.325538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecb3f8-64a0-46d1-8075-aa38f2ce5b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:56.326435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecb3f8-64a0-46d1-8075-aa38f2ce5b46 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:56.326888 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecb3f8-64a0-46d1-8075-aa38f2ce5b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:56.327361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecb3f8-64a0-46d1-8075-aa38f2ce5b46 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:56.328699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecb3f8-64a0-46d1-8075-aa38f2ce5b46 None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:56.330332 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecb3f8-64a0-46d1-8075-aa38f2ce5b46 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:56.332162 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 48/93] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:11:56 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:11:56.338149 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecb3f8-64a0-46d1-8075-aa38f2ce5b46 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:56.441468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 46/94] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 16:11:56.448826 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c339687-b55a-42ac-9c60-4e2f295944e0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:56.470300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecb3f8-64a0-46d1-8075-aa38f2ce5b46 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:56.524290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:56.528279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020d346-2747-4b85-8f11-16542625d3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:56.529142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020d346-2747-4b85-8f11-16542625d3ee None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:56.529598 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020d346-2747-4b85-8f11-16542625d3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:56.530026 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020d346-2747-4b85-8f11-16542625d3ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:56.530910 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020d346-2747-4b85-8f11-16542625d3ee None admin] RBAC: Adding query filter params (role.id=a507b36f2493428fbb8fcdc4fbad6911, scope.project.id=c22b8f7f1cc4484180061823f1584623, user.id=25ba51db172e4f3bba446da546398dbd) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:56.531389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020d346-2747-4b85-8f11-16542625d3ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:56.533094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020d346-2747-4b85-8f11-16542625d3ee None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:56.547825 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 49/95] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:11:56 2022] GET /identity/v3/role_assignments?user.id=25ba51db172e4f3bba446da546398dbd&scope.project.id=c22b8f7f1cc4484180061823f1584623&role.id=a507b36f2493428fbb8fcdc4fbad6911 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:56.567377 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c339687-b55a-42ac-9c60-4e2f295944e0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:56.605628 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35674a45-8b14-4fe7-a1ae-b3beeef1f2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:56.606262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35674a45-8b14-4fe7-a1ae-b3beeef1f2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:56.606542 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35674a45-8b14-4fe7-a1ae-b3beeef1f2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:56.606815 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35674a45-8b14-4fe7-a1ae-b3beeef1f2f3 None admin] PATH_INFO: `/v3/projects/3f6c7f6f1b0e4f7c9d02114dee6b0889` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:56.607935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35674a45-8b14-4fe7-a1ae-b3beeef1f2f3 None admin] RBAC: Authorizing `identity:get_project(project_id=3f6c7f6f1b0e4f7c9d02114dee6b0889)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:56.609400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35674a45-8b14-4fe7-a1ae-b3beeef1f2f3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:56.611029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 47/96] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:11:56 2022] GET /identity/v3/projects/3f6c7f6f1b0e4f7c9d02114dee6b0889 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:56.618023 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020d346-2747-4b85-8f11-16542625d3ee None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:56.687783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:56.776235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020d346-2747-4b85-8f11-16542625d3ee None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:56.823226 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8faf5f0-4b87-4131-bfc6-60e09638a07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:56.823841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8faf5f0-4b87-4131-bfc6-60e09638a07d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:56.824116 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8faf5f0-4b87-4131-bfc6-60e09638a07d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:56.824383 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8faf5f0-4b87-4131-bfc6-60e09638a07d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:56.825139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8faf5f0-4b87-4131-bfc6-60e09638a07d None admin] RBAC: Adding query filter params (role.id=87abba8d76c2420c97d9d5f2dbb6b540, scope.project.id=3f6c7f6f1b0e4f7c9d02114dee6b0889, user.id=25ba51db172e4f3bba446da546398dbd) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:56.825443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8faf5f0-4b87-4131-bfc6-60e09638a07d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:56.826882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8faf5f0-4b87-4131-bfc6-60e09638a07d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:56.833014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 50/97] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:11:56 2022] GET /identity/v3/role_assignments?user.id=25ba51db172e4f3bba446da546398dbd&scope.project.id=3f6c7f6f1b0e4f7c9d02114dee6b0889&role.id=87abba8d76c2420c97d9d5f2dbb6b540 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:58.248024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe6aff-c9f9-40bf-8119-c7f8841af398 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:58.249050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe6aff-c9f9-40bf-8119-c7f8841af398 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:58.249589 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe6aff-c9f9-40bf-8119-c7f8841af398 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:58.251169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 48/98] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:58.257213 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a014ed-9142-4b01-a36b-8824741e9d1a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:58.258019 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a014ed-9142-4b01-a36b-8824741e9d1a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:58.258490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a014ed-9142-4b01-a36b-8824741e9d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:58.276722 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-65a014ed-9142-4b01-a36b-8824741e9d1a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:58.278232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-65a014ed-9142-4b01-a36b-8824741e9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:58.320121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b1d35-9f74-4597-abaf-264b6d7a3a5b None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:58.320735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b1d35-9f74-4597-abaf-264b6d7a3a5b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:58.321263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b1d35-9f74-4597-abaf-264b6d7a3a5b None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:58.323056 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 49/99] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:58.328094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c33e94-6fee-4f32-b361-95b5b4827afe None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:58.328618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c33e94-6fee-4f32-b361-95b5b4827afe None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:58.329091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c33e94-6fee-4f32-b361-95b5b4827afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:58.347177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c2c33e94-6fee-4f32-b361-95b5b4827afe None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:58.348668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c2c33e94-6fee-4f32-b361-95b5b4827afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:58.354143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 51/100] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:11:58.428148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a014ed-9142-4b01-a36b-8824741e9d1a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:58.450846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 50/101] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:11:58.492972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:58.508067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c33e94-6fee-4f32-b361-95b5b4827afe None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:58.577364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:58.599914 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a014ed-9142-4b01-a36b-8824741e9d1a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:58.638560 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd67026-02bd-44af-b889-66aa489c7eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:58.639195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd67026-02bd-44af-b889-66aa489c7eeb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:58.639474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd67026-02bd-44af-b889-66aa489c7eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:58.639745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd67026-02bd-44af-b889-66aa489c7eeb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:58.660025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c33e94-6fee-4f32-b361-95b5b4827afe None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:58.669182 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd67026-02bd-44af-b889-66aa489c7eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6dd67026-02bd-44af-b889-66aa489c7eeb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:11:58.674534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:11:58.675356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:11:58.676087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:11:58.676087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:11:58.676087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:11:58.676087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:11:58.676087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:11:58.676087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:11:58.676087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:11:58.676087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:11:58.676087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:11:58.676087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:11:58.676087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:11:58.676087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:11:58.678426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 52/102] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:11:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:11:58.684150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd67026-02bd-44af-b889-66aa489c7eeb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:58.696764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792569b-1547-48a6-be14-dab9ad373d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:58.697676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792569b-1547-48a6-be14-dab9ad373d8b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:58.698587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792569b-1547-48a6-be14-dab9ad373d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:58.699083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792569b-1547-48a6-be14-dab9ad373d8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:58.711317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792569b-1547-48a6-be14-dab9ad373d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-b792569b-1547-48a6-be14-dab9ad373d8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:11:58.717115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:11:58.717965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:11:58.718689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:11:58.718689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:11:58.718689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:11:58.718689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:11:58.718689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:11:58.718689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:11:58.718689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:11:58.718689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:11:58.718689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:11:58.718689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:11:58.718689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:11:58.718689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:11:58.720915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 51/103] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:11:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:11:58.730214 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792569b-1547-48a6-be14-dab9ad373d8b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:58.888917 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:58.908808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd67026-02bd-44af-b889-66aa489c7eeb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:58.963165 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792569b-1547-48a6-be14-dab9ad373d8b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:58.991989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae882b-6657-4adb-a7f1-adc4463d6a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:58.992986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae882b-6657-4adb-a7f1-adc4463d6a40 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:58.994122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae882b-6657-4adb-a7f1-adc4463d6a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:58.994592 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae882b-6657-4adb-a7f1-adc4463d6a40 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:58.995607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae882b-6657-4adb-a7f1-adc4463d6a40 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:58.997459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae882b-6657-4adb-a7f1-adc4463d6a40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:58.999063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae882b-6657-4adb-a7f1-adc4463d6a40 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:59.011665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:59.015844 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 53/104] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:11:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:11:59.021300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae882b-6657-4adb-a7f1-adc4463d6a40 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:59.044569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f403658-a4b9-4a58-83cf-d4c25e9c385d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:59.045594 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f403658-a4b9-4a58-83cf-d4c25e9c385d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:59.046065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f403658-a4b9-4a58-83cf-d4c25e9c385d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:59.046703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f403658-a4b9-4a58-83cf-d4c25e9c385d None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:59.047595 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f403658-a4b9-4a58-83cf-d4c25e9c385d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:11:59.048198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f403658-a4b9-4a58-83cf-d4c25e9c385d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:59.049793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f403658-a4b9-4a58-83cf-d4c25e9c385d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:59.063738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 52/105] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:11:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:59.068830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f403658-a4b9-4a58-83cf-d4c25e9c385d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:59.189371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f403658-a4b9-4a58-83cf-d4c25e9c385d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:59.221523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae882b-6657-4adb-a7f1-adc4463d6a40 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:59.232906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77818b7c-7f28-41e9-859c-dd8964cec8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:59.233668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77818b7c-7f28-41e9-859c-dd8964cec8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:59.233945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77818b7c-7f28-41e9-859c-dd8964cec8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:59.234215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77818b7c-7f28-41e9-859c-dd8964cec8e0 None admin] PATH_INFO: `/v3/users/c190c69c93f440c9b6a6c24b62b15091` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:59.235352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77818b7c-7f28-41e9-859c-dd8964cec8e0 None admin] RBAC: Authorizing `identity:get_user(user_id=c190c69c93f440c9b6a6c24b62b15091)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:59.237089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77818b7c-7f28-41e9-859c-dd8964cec8e0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:59.239035 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 53/106] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:11:59 2022] GET /identity/v3/users/c190c69c93f440c9b6a6c24b62b15091 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:11:59.240271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280bdc2-b580-4ddb-9e45-34de1a612c0a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:59.240554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280bdc2-b580-4ddb-9e45-34de1a612c0a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:59.241384 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280bdc2-b580-4ddb-9e45-34de1a612c0a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:59.246634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 54/107] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:59.247898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2aa10-fdfc-4c68-9d52-2ebbb13ada68 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:59.248186 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2aa10-fdfc-4c68-9d52-2ebbb13ada68 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:59.248757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2aa10-fdfc-4c68-9d52-2ebbb13ada68 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:59.253517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 55/108] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:59.254670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03870eee-75a6-4654-b528-aa102259a77a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:59.254959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03870eee-75a6-4654-b528-aa102259a77a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:59.255236 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03870eee-75a6-4654-b528-aa102259a77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:59.263400 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f97a4d-708d-4a3e-9f35-18c87841d472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:59.264041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f97a4d-708d-4a3e-9f35-18c87841d472 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:59.264325 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f97a4d-708d-4a3e-9f35-18c87841d472 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:59.264622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f97a4d-708d-4a3e-9f35-18c87841d472 None admin] PATH_INFO: `/v3/users/25ba51db172e4f3bba446da546398dbd` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:59.265764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f97a4d-708d-4a3e-9f35-18c87841d472 None admin] RBAC: Authorizing `identity:get_user(user_id=25ba51db172e4f3bba446da546398dbd)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:59.267221 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f97a4d-708d-4a3e-9f35-18c87841d472 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:59.268877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 54/109] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:11:59 2022] GET /identity/v3/users/25ba51db172e4f3bba446da546398dbd => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:59.269737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f97a4d-708d-4a3e-9f35-18c87841d472 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:59.274828 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-03870eee-75a6-4654-b528-aa102259a77a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:59.276006 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-03870eee-75a6-4654-b528-aa102259a77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:59.300576 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:59.320158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:59.346468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 56/110] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:11:59.353832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d383e1-964e-4a41-a764-f4f9bb05b117 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:59.354126 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d383e1-964e-4a41-a764-f4f9bb05b117 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:59.354409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d383e1-964e-4a41-a764-f4f9bb05b117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:59.378895 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f97a4d-708d-4a3e-9f35-18c87841d472 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:59.379687 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-59d383e1-964e-4a41-a764-f4f9bb05b117 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:11:59.389030 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-59d383e1-964e-4a41-a764-f4f9bb05b117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:11:59.413713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979ee67-8e6c-4dba-add7-57f2f69921ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:59.414345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979ee67-8e6c-4dba-add7-57f2f69921ed None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:59.414626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979ee67-8e6c-4dba-add7-57f2f69921ed None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:59.414960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979ee67-8e6c-4dba-add7-57f2f69921ed None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:59.416133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979ee67-8e6c-4dba-add7-57f2f69921ed None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:59.417756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979ee67-8e6c-4dba-add7-57f2f69921ed None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:59.419983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 55/111] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:11:59 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:59.424976 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979ee67-8e6c-4dba-add7-57f2f69921ed None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:59.460452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 57/112] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:11:59.469467 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d383e1-964e-4a41-a764-f4f9bb05b117 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:59.549258 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979ee67-8e6c-4dba-add7-57f2f69921ed None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:59.584756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d383e1-964e-4a41-a764-f4f9bb05b117 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:59.585291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e5830-8aa5-44bb-99e6-3434b2cd4682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:59.586109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e5830-8aa5-44bb-99e6-3434b2cd4682 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:59.586532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e5830-8aa5-44bb-99e6-3434b2cd4682 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:59.586949 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e5830-8aa5-44bb-99e6-3434b2cd4682 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:59.588409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e5830-8aa5-44bb-99e6-3434b2cd4682 None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:59.590134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e5830-8aa5-44bb-99e6-3434b2cd4682 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:59.591944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 56/113] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:11:59 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:59.592570 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:59.596619 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e5830-8aa5-44bb-99e6-3434b2cd4682 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:59.612849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:59.623302 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e335435-7415-46b4-bd6c-2b5084ce42e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:59.623942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e335435-7415-46b4-bd6c-2b5084ce42e2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:59.624222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e335435-7415-46b4-bd6c-2b5084ce42e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:59.624495 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e335435-7415-46b4-bd6c-2b5084ce42e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:59.635706 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e335435-7415-46b4-bd6c-2b5084ce42e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-0e335435-7415-46b4-bd6c-2b5084ce42e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:11:59.640491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:11:59.641554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:11:59.642382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:11:59.642382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:11:59.642382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:11:59.642382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:11:59.642382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:11:59.642382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:11:59.642382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:11:59.642382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:11:59.642382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:11:59.642382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:11:59.642382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:11:59.642382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:11:59.642382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 58/114] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:11:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:11:59.647147 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e335435-7415-46b4-bd6c-2b5084ce42e2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:59.708554 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e5830-8aa5-44bb-99e6-3434b2cd4682 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:59.745884 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2331d9b-c277-401e-9a04-0758100984d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:59.746468 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2331d9b-c277-401e-9a04-0758100984d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:59.746787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2331d9b-c277-401e-9a04-0758100984d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:59.747025 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2331d9b-c277-401e-9a04-0758100984d0 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623/users/c190c69c93f440c9b6a6c24b62b15091/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:59.748935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2331d9b-c277-401e-9a04-0758100984d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c22b8f7f1cc4484180061823f1584623, user_id=c190c69c93f440c9b6a6c24b62b15091, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:59.750375 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2331d9b-c277-401e-9a04-0758100984d0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:59.751833 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e335435-7415-46b4-bd6c-2b5084ce42e2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:59.764618 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 57/115] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:11:59 2022] PUT /identity/v3/projects/c22b8f7f1cc4484180061823f1584623/users/c190c69c93f440c9b6a6c24b62b15091/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:11:59.765473 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2331d9b-c277-401e-9a04-0758100984d0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:59.791292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:59.800135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd4c19-03a9-4fb7-ac05-3a971995d35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:59.801062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd4c19-03a9-4fb7-ac05-3a971995d35a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:59.801562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd4c19-03a9-4fb7-ac05-3a971995d35a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:59.801979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd4c19-03a9-4fb7-ac05-3a971995d35a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:59.804076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd4c19-03a9-4fb7-ac05-3a971995d35a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:59.806079 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd4c19-03a9-4fb7-ac05-3a971995d35a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:59.807964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 59/116] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:11:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:11:59.808929 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd4c19-03a9-4fb7-ac05-3a971995d35a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:11:59.848845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:11:59.888211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2331d9b-c277-401e-9a04-0758100984d0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:59.926797 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cf872-457c-4d7d-a1a6-e6308cd4dbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:11:59.926797 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cf872-457c-4d7d-a1a6-e6308cd4dbb5 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:59.927315 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cf872-457c-4d7d-a1a6-e6308cd4dbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:59.927691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cf872-457c-4d7d-a1a6-e6308cd4dbb5 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623/users/25ba51db172e4f3bba446da546398dbd/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:59.930225 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd4c19-03a9-4fb7-ac05-3a971995d35a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:11:59.930635 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cf872-457c-4d7d-a1a6-e6308cd4dbb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c22b8f7f1cc4484180061823f1584623, user_id=25ba51db172e4f3bba446da546398dbd, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:11:59.932225 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cf872-457c-4d7d-a1a6-e6308cd4dbb5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:11:59.946559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 58/117] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:11:59 2022] PUT /identity/v3/projects/c22b8f7f1cc4484180061823f1584623/users/25ba51db172e4f3bba446da546398dbd/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:11:59.947904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44e69e-4872-4529-b1c1-b2578528751f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:11:59.948314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44e69e-4872-4529-b1c1-b2578528751f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:11:59.948840 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44e69e-4872-4529-b1c1-b2578528751f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:11:59.950170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 59/118] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:11:59.950990 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44e69e-4872-4529-b1c1-b2578528751f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:00.010288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9d3bb-02ad-4694-999b-6138ac905869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:00.010837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9d3bb-02ad-4694-999b-6138ac905869 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:00.011122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9d3bb-02ad-4694-999b-6138ac905869 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:00.011397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9d3bb-02ad-4694-999b-6138ac905869 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:00.012091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9d3bb-02ad-4694-999b-6138ac905869 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:00.012397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9d3bb-02ad-4694-999b-6138ac905869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:00.013830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9d3bb-02ad-4694-999b-6138ac905869 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:00.029701 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 60/119] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:11:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:00.031047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9455e6-ff50-460d-85ec-4ca0397ffacb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:00.031337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9455e6-ff50-460d-85ec-4ca0397ffacb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:00.031614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9455e6-ff50-460d-85ec-4ca0397ffacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:00.051991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cc9455e6-ff50-460d-85ec-4ca0397ffacb None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:00.053091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:00.053262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cc9455e6-ff50-460d-85ec-4ca0397ffacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:00.086271 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44e69e-4872-4529-b1c1-b2578528751f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:00.134006 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20626ba-0c18-4a1d-a04c-3ef67e36f022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:00.134632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20626ba-0c18-4a1d-a04c-3ef67e36f022 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:00.134914 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20626ba-0c18-4a1d-a04c-3ef67e36f022 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:00.135193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20626ba-0c18-4a1d-a04c-3ef67e36f022 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:00.135848 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20626ba-0c18-4a1d-a04c-3ef67e36f022 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:00.137359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20626ba-0c18-4a1d-a04c-3ef67e36f022 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:00.138406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 61/120] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:00.139870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334c6e5-4013-4c8b-bd8d-be8936d442bb None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:00.140311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334c6e5-4013-4c8b-bd8d-be8936d442bb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:00.144935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334c6e5-4013-4c8b-bd8d-be8936d442bb None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:00.146343 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 62/121] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:00.147626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334c6e5-4013-4c8b-bd8d-be8936d442bb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:00.179215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 60/122] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Aug 11 16:11:59 2022] POST /identity/v3/projects => generated 302 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:12:00.181254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d599769-13bd-4ff1-bf40-8654031f50a8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:00.181542 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d599769-13bd-4ff1-bf40-8654031f50a8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:00.181958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d599769-13bd-4ff1-bf40-8654031f50a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:00.182223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:00.210473 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0d599769-13bd-4ff1-bf40-8654031f50a8 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:00.211710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0d599769-13bd-4ff1-bf40-8654031f50a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:00.281671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334c6e5-4013-4c8b-bd8d-be8936d442bb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:00.323909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1121d4-bd31-4889-b762-0b99fd7749bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:00.325529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1121d4-bd31-4889-b762-0b99fd7749bf None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:00.325863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1121d4-bd31-4889-b762-0b99fd7749bf None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:00.326143 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1121d4-bd31-4889-b762-0b99fd7749bf None admin] PATH_INFO: `/v3/users/0bf9f132d0164305a3d3239c974ddd67` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:00.345098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1121d4-bd31-4889-b762-0b99fd7749bf None admin] RBAC: Authorizing `identity:get_user(user_id=0bf9f132d0164305a3d3239c974ddd67)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:00.346636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1121d4-bd31-4889-b762-0b99fd7749bf None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:00.348802 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 63/123] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:00 2022] GET /identity/v3/users/0bf9f132d0164305a3d3239c974ddd67 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:00.349659 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1121d4-bd31-4889-b762-0b99fd7749bf None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:00.367457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 61/124] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:00.368164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d599769-13bd-4ff1-bf40-8654031f50a8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:00.441266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:00.459931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:00.461752 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1121d4-bd31-4889-b762-0b99fd7749bf None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:00.508256 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43e01-8bf2-40a7-b1b0-d23cca02e0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:00.509200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43e01-8bf2-40a7-b1b0-d23cca02e0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:00.509645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43e01-8bf2-40a7-b1b0-d23cca02e0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:00.510050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43e01-8bf2-40a7-b1b0-d23cca02e0f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:00.516636 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d599769-13bd-4ff1-bf40-8654031f50a8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:00.523591 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a43e01-8bf2-40a7-b1b0-d23cca02e0f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c0a43e01-8bf2-40a7-b1b0-d23cca02e0f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:00.530189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:00.531125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:00.531973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:00.531973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:00.531973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:00.531973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:00.531973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:00.531973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:00.531973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:00.531973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:00.531973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:00.531973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:00.531973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:00.531973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:00.534050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 64/125] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:00.535049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43e01-8bf2-40a7-b1b0-d23cca02e0f9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:00.561653 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae357d4-7fed-4f45-8b14-1006445d58e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:00.562925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae357d4-7fed-4f45-8b14-1006445d58e2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:00.563621 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae357d4-7fed-4f45-8b14-1006445d58e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:00.564041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae357d4-7fed-4f45-8b14-1006445d58e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:00.647610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae357d4-7fed-4f45-8b14-1006445d58e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:00.649352 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae357d4-7fed-4f45-8b14-1006445d58e2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:00.718950 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:00.723241 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43e01-8bf2-40a7-b1b0-d23cca02e0f9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:00.767492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 62/126] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:00.768572 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae357d4-7fed-4f45-8b14-1006445d58e2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:00.821289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266dc30-c940-4cf9-8be5-e59639886f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:00.821933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266dc30-c940-4cf9-8be5-e59639886f33 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:00.822213 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266dc30-c940-4cf9-8be5-e59639886f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:00.822538 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266dc30-c940-4cf9-8be5-e59639886f33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:00.861224 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266dc30-c940-4cf9-8be5-e59639886f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-0266dc30-c940-4cf9-8be5-e59639886f33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:00.866713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:00.867552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:00.868726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:00.868726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:00.868726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:00.868726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:00.868726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:00.868726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:00.868726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:00.868726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:00.868726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:00.868726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:00.868726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:00.868726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:00.868726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 65/127] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:12:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:00.868726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266dc30-c940-4cf9-8be5-e59639886f33 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:00.882446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae357d4-7fed-4f45-8b14-1006445d58e2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:00.889759 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:00.922080 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88865ebe-34bd-4570-b386-15a2970daa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:00.922692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88865ebe-34bd-4570-b386-15a2970daa37 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:00.922987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88865ebe-34bd-4570-b386-15a2970daa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:00.923416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88865ebe-34bd-4570-b386-15a2970daa37 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:00.924205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88865ebe-34bd-4570-b386-15a2970daa37 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:00.924508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88865ebe-34bd-4570-b386-15a2970daa37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:00.926187 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88865ebe-34bd-4570-b386-15a2970daa37 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:00.935996 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 63/128] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:00.936840 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88865ebe-34bd-4570-b386-15a2970daa37 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:00.965531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:01.103052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88865ebe-34bd-4570-b386-15a2970daa37 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:01.108502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266dc30-c940-4cf9-8be5-e59639886f33 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:01.171879 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b129f-ab86-44c2-82f7-142234e1b3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:01.172513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b129f-ab86-44c2-82f7-142234e1b3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:01.172825 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b129f-ab86-44c2-82f7-142234e1b3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:01.173102 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b129f-ab86-44c2-82f7-142234e1b3c1 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:01.175457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b129f-ab86-44c2-82f7-142234e1b3c1 None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:01.176957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b129f-ab86-44c2-82f7-142234e1b3c1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:01.179301 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2342fa-be84-493b-a2ff-ca558a894d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:01.179915 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2342fa-be84-493b-a2ff-ca558a894d23 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:01.180195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2342fa-be84-493b-a2ff-ca558a894d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:01.180471 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2342fa-be84-493b-a2ff-ca558a894d23 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:01.181166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2342fa-be84-493b-a2ff-ca558a894d23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:01.181518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2342fa-be84-493b-a2ff-ca558a894d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:01.182882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2342fa-be84-493b-a2ff-ca558a894d23 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:01.184337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 66/129] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:00 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:01.185187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b129f-ab86-44c2-82f7-142234e1b3c1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:01.200931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 64/130] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:01.201833 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2342fa-be84-493b-a2ff-ca558a894d23 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:01.302479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:01.320034 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2342fa-be84-493b-a2ff-ca558a894d23 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:01.340941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:01.355683 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03091d-ddf3-4131-8547-36c11f51d174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:01.356222 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03091d-ddf3-4131-8547-36c11f51d174 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:01.356504 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03091d-ddf3-4131-8547-36c11f51d174 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:01.356810 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03091d-ddf3-4131-8547-36c11f51d174 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:01.357608 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03091d-ddf3-4131-8547-36c11f51d174 None admin] RBAC: Adding query filter params (role.id=3b85296a2d114d309360453dd73a3c22, scope.project.id=c22b8f7f1cc4484180061823f1584623, user.id=0bf9f132d0164305a3d3239c974ddd67) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:01.357850 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03091d-ddf3-4131-8547-36c11f51d174 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:01.359322 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03091d-ddf3-4131-8547-36c11f51d174 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:01.365140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 65/131] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:01 2022] GET /identity/v3/role_assignments?user.id=0bf9f132d0164305a3d3239c974ddd67&scope.project.id=c22b8f7f1cc4484180061823f1584623&role.id=3b85296a2d114d309360453dd73a3c22 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:01.365729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03091d-ddf3-4131-8547-36c11f51d174 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:01.377097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b129f-ab86-44c2-82f7-142234e1b3c1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:01.428164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb8c2c-a7b1-4513-bd5c-1064571cb0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:01.428890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb8c2c-a7b1-4513-bd5c-1064571cb0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:01.429170 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb8c2c-a7b1-4513-bd5c-1064571cb0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:01.429439 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb8c2c-a7b1-4513-bd5c-1064571cb0b0 None admin] PATH_INFO: `/v3/users/25ba51db172e4f3bba446da546398dbd` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:01.434023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb8c2c-a7b1-4513-bd5c-1064571cb0b0 None admin] RBAC: Authorizing `identity:get_user(user_id=25ba51db172e4f3bba446da546398dbd)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:01.435515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb8c2c-a7b1-4513-bd5c-1064571cb0b0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:01.437224 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 67/132] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:01 2022] GET /identity/v3/users/25ba51db172e4f3bba446da546398dbd => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:01.450669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb8c2c-a7b1-4513-bd5c-1064571cb0b0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:01.580442 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03091d-ddf3-4131-8547-36c11f51d174 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:01.642579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb8c2c-a7b1-4513-bd5c-1064571cb0b0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:01.656423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97341ba-7b66-419a-afce-1a06dc051a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:01.657376 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97341ba-7b66-419a-afce-1a06dc051a0d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:01.657929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97341ba-7b66-419a-afce-1a06dc051a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:01.658396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97341ba-7b66-419a-afce-1a06dc051a0d None admin] PATH_INFO: `/v3/users/25ba51db172e4f3bba446da546398dbd` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:01.661466 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97341ba-7b66-419a-afce-1a06dc051a0d None admin] RBAC: Authorizing `identity:get_user(user_id=25ba51db172e4f3bba446da546398dbd)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:01.663183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97341ba-7b66-419a-afce-1a06dc051a0d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:01.665023 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 66/133] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:01 2022] GET /identity/v3/users/25ba51db172e4f3bba446da546398dbd => generated 275 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:01.671120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97341ba-7b66-419a-afce-1a06dc051a0d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:01.703975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:01.719977 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af6eff-2867-488e-9cc4-d373c236ecca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:01.720967 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af6eff-2867-488e-9cc4-d373c236ecca None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:01.722696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af6eff-2867-488e-9cc4-d373c236ecca None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:01.723196 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af6eff-2867-488e-9cc4-d373c236ecca None admin] PATH_INFO: `/v3/projects/3f6c7f6f1b0e4f7c9d02114dee6b0889` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:01.729680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af6eff-2867-488e-9cc4-d373c236ecca None admin] RBAC: Authorizing `identity:get_project(project_id=3f6c7f6f1b0e4f7c9d02114dee6b0889)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:01.732113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af6eff-2867-488e-9cc4-d373c236ecca None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:01.735403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 68/134] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:01 2022] GET /identity/v3/projects/3f6c7f6f1b0e4f7c9d02114dee6b0889 => generated 312 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:01.741737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af6eff-2867-488e-9cc4-d373c236ecca None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:01.770234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:01.910633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97341ba-7b66-419a-afce-1a06dc051a0d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:01.919015 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af6eff-2867-488e-9cc4-d373c236ecca None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:01.962305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd74fb2-84b4-41a6-8f78-301daecf0031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:01.963161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd74fb2-84b4-41a6-8f78-301daecf0031 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:01.963451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd74fb2-84b4-41a6-8f78-301daecf0031 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:01.963729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd74fb2-84b4-41a6-8f78-301daecf0031 None admin] PATH_INFO: `/v3/projects/3f6c7f6f1b0e4f7c9d02114dee6b0889/users/25ba51db172e4f3bba446da546398dbd/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:01.966196 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd74fb2-84b4-41a6-8f78-301daecf0031 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f6c7f6f1b0e4f7c9d02114dee6b0889, user_id=25ba51db172e4f3bba446da546398dbd, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:01.967650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd74fb2-84b4-41a6-8f78-301daecf0031 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:01.995270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 69/135] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:12:01 2022] PUT /identity/v3/projects/3f6c7f6f1b0e4f7c9d02114dee6b0889/users/25ba51db172e4f3bba446da546398dbd/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:02.024106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c82610-602f-48e3-a8e1-208aa05f1f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:02.024802 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c82610-602f-48e3-a8e1-208aa05f1f9e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:02.025088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c82610-602f-48e3-a8e1-208aa05f1f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:02.025368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c82610-602f-48e3-a8e1-208aa05f1f9e None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:02.029416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c82610-602f-48e3-a8e1-208aa05f1f9e None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:02.030901 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c82610-602f-48e3-a8e1-208aa05f1f9e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:02.033039 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 67/136] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:01 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:02.039478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd74fb2-84b4-41a6-8f78-301daecf0031 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:02.122504 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:02.159709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd74fb2-84b4-41a6-8f78-301daecf0031 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:02.201895 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd3be7-a0b1-4ec9-9366-07d67a4808bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:02.202740 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd3be7-a0b1-4ec9-9366-07d67a4808bb None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:02.203024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd3be7-a0b1-4ec9-9366-07d67a4808bb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:02.203303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd3be7-a0b1-4ec9-9366-07d67a4808bb None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623/users/25ba51db172e4f3bba446da546398dbd/roles/a507b36f2493428fbb8fcdc4fbad6911` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:02.205675 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd3be7-a0b1-4ec9-9366-07d67a4808bb None admin] RBAC: Authorizing `identity:create_grant(project_id=c22b8f7f1cc4484180061823f1584623, user_id=25ba51db172e4f3bba446da546398dbd, role_id=a507b36f2493428fbb8fcdc4fbad6911)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:02.207242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd3be7-a0b1-4ec9-9366-07d67a4808bb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:02.234307 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 70/137] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:12:02 2022] PUT /identity/v3/projects/c22b8f7f1cc4484180061823f1584623/users/25ba51db172e4f3bba446da546398dbd/roles/a507b36f2493428fbb8fcdc4fbad6911 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:02.477402 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb789e0-9987-4ed9-85b9-6ec0603c9284 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:02.477708 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb789e0-9987-4ed9-85b9-6ec0603c9284 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:02.477963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb789e0-9987-4ed9-85b9-6ec0603c9284 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:02.479663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 68/138] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:02.485054 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dfe2d-fc12-4a78-b893-cbd55bc56d2c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:02.485511 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dfe2d-fc12-4a78-b893-cbd55bc56d2c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:02.485738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dfe2d-fc12-4a78-b893-cbd55bc56d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:02.513613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5f4dfe2d-fc12-4a78-b893-cbd55bc56d2c None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:02.514885 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5f4dfe2d-fc12-4a78-b893-cbd55bc56d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:02.596735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 71/139] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:02.620459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb789e0-9987-4ed9-85b9-6ec0603c9284 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:02.658981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1984ab-4756-4048-b44e-e6bed8b28ea2 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:02.659291 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1984ab-4756-4048-b44e-e6bed8b28ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:02.659554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1984ab-4756-4048-b44e-e6bed8b28ea2 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:02.661185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 72/140] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:12:02.667260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a3ac5-9890-4fa3-b66a-32492185703f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:02.667538 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a3ac5-9890-4fa3-b66a-32492185703f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:02.667866 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a3ac5-9890-4fa3-b66a-32492185703f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:02.696935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-097a3ac5-9890-4fa3-b66a-32492185703f None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:02.698262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-097a3ac5-9890-4fa3-b66a-32492185703f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:02.745068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:02.750244 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb789e0-9987-4ed9-85b9-6ec0603c9284 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:02.796952 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:02.818185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525fad5-cc4f-4ffc-b574-1379e1e52763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:02.818847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525fad5-cc4f-4ffc-b574-1379e1e52763 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:02.819135 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525fad5-cc4f-4ffc-b574-1379e1e52763 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:02.819411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525fad5-cc4f-4ffc-b574-1379e1e52763 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:02.821339 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 73/141] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:02.831872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525fad5-cc4f-4ffc-b574-1379e1e52763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-3525fad5-cc4f-4ffc-b574-1379e1e52763 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:02.836665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:02.837541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:02.838317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:02.838317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:02.838317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:02.838317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:02.838317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:02.838317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:02.838317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:02.838317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:02.838317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:02.838317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:02.838317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:12:02.838317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:02.838317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 69/142] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:12:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:02.845269 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a3ac5-9890-4fa3-b66a-32492185703f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:02.862753 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525fad5-cc4f-4ffc-b574-1379e1e52763 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:03.012134 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a3ac5-9890-4fa3-b66a-32492185703f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:03.019964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525fad5-cc4f-4ffc-b574-1379e1e52763 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:03.074701 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8f5bb-afc1-4c2b-b235-670e79df680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:03.076704 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8f5bb-afc1-4c2b-b235-670e79df680c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:03.076986 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8f5bb-afc1-4c2b-b235-670e79df680c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:03.077259 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8f5bb-afc1-4c2b-b235-670e79df680c None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:03.077935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8f5bb-afc1-4c2b-b235-670e79df680c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:03.078235 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8f5bb-afc1-4c2b-b235-670e79df680c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:03.079620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8f5bb-afc1-4c2b-b235-670e79df680c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:03.087890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7d6f5-cf63-48a6-a31a-da6e82cb495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:03.088539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7d6f5-cf63-48a6-a31a-da6e82cb495f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:03.088849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7d6f5-cf63-48a6-a31a-da6e82cb495f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:03.089131 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7d6f5-cf63-48a6-a31a-da6e82cb495f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:03.093436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7d6f5-cf63-48a6-a31a-da6e82cb495f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:03.096615 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7d6f5-cf63-48a6-a31a-da6e82cb495f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:03.098232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 70/143] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:03.099374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a63565-9c18-4c1c-8f5e-d480b39e8d73 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:03.099656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a63565-9c18-4c1c-8f5e-d480b39e8d73 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:03.099932 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a63565-9c18-4c1c-8f5e-d480b39e8d73 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:03.101714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 71/144] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:03.104061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 74/145] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:03.109142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8f5bb-afc1-4c2b-b235-670e79df680c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:03.110742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72001340-98e8-4203-b712-3b35b22f5ff3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:03.111033 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72001340-98e8-4203-b712-3b35b22f5ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:03.111312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72001340-98e8-4203-b712-3b35b22f5ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:03.155349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-72001340-98e8-4203-b712-3b35b22f5ff3 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:03.156546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-72001340-98e8-4203-b712-3b35b22f5ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:03.174674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:03.212703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:03.245413 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 72/146] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:03.246664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72001340-98e8-4203-b712-3b35b22f5ff3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:03.315175 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8f5bb-afc1-4c2b-b235-670e79df680c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:03.364275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72001340-98e8-4203-b712-3b35b22f5ff3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:03.392448 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a20a06-68ee-401f-a0cf-96d7016b0314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:03.393238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a20a06-68ee-401f-a0cf-96d7016b0314 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:03.393489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a20a06-68ee-401f-a0cf-96d7016b0314 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:03.393814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a20a06-68ee-401f-a0cf-96d7016b0314 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:03.394515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a20a06-68ee-401f-a0cf-96d7016b0314 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:03.396177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a20a06-68ee-401f-a0cf-96d7016b0314 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:03.404513 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124d9de-44b7-40f3-bb0f-cedb00fa3aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:03.405384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124d9de-44b7-40f3-bb0f-cedb00fa3aeb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:03.405847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124d9de-44b7-40f3-bb0f-cedb00fa3aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:03.406301 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124d9de-44b7-40f3-bb0f-cedb00fa3aeb None admin] PATH_INFO: `/v3/users/c190c69c93f440c9b6a6c24b62b15091` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:03.407612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124d9de-44b7-40f3-bb0f-cedb00fa3aeb None admin] RBAC: Authorizing `identity:get_user(user_id=c190c69c93f440c9b6a6c24b62b15091)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:03.409260 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124d9de-44b7-40f3-bb0f-cedb00fa3aeb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:03.411367 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 73/147] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:03 2022] GET /identity/v3/users/c190c69c93f440c9b6a6c24b62b15091 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:03.412317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124d9de-44b7-40f3-bb0f-cedb00fa3aeb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:03.434644 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:03.443087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 75/148] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:12:03 2022] POST /identity/v3/users => generated 283 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:12:03.443632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a20a06-68ee-401f-a0cf-96d7016b0314 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:03.591203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124d9de-44b7-40f3-bb0f-cedb00fa3aeb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:03.639561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b732d-e727-40c3-b43c-6b255ac029f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:03.640190 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b732d-e727-40c3-b43c-6b255ac029f9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:03.640454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b732d-e727-40c3-b43c-6b255ac029f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:03.640765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b732d-e727-40c3-b43c-6b255ac029f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:03.652092 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b732d-e727-40c3-b43c-6b255ac029f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-368b732d-e727-40c3-b43c-6b255ac029f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:03.656989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:03.657824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:03.658562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:03.658562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:03.658562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:03.658562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:03.658562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:03.658562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:03.658562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:03.658562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:03.658562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:03.658562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:03.658562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:03.658562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:03.658562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 74/149] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:03.665475 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b732d-e727-40c3-b43c-6b255ac029f9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:03.742457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:03.777210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b732d-e727-40c3-b43c-6b255ac029f9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:03.778699 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a20a06-68ee-401f-a0cf-96d7016b0314 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:03.790602 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:03.817509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb526a-62e8-4b56-80dd-5f35df33b533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:03.818171 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb526a-62e8-4b56-80dd-5f35df33b533 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:03.818454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb526a-62e8-4b56-80dd-5f35df33b533 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:03.818754 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb526a-62e8-4b56-80dd-5f35df33b533 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:03.820005 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb526a-62e8-4b56-80dd-5f35df33b533 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:03.820307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb526a-62e8-4b56-80dd-5f35df33b533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:03.821784 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb526a-62e8-4b56-80dd-5f35df33b533 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:03.830860 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 75/150] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:03.836381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb526a-62e8-4b56-80dd-5f35df33b533 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:03.889973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17132565-389c-41c1-8702-5c7aa1cc920a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:03.890523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17132565-389c-41c1-8702-5c7aa1cc920a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:03.890800 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17132565-389c-41c1-8702-5c7aa1cc920a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:03.891067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17132565-389c-41c1-8702-5c7aa1cc920a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:03.949984 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb526a-62e8-4b56-80dd-5f35df33b533 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:03.984731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccb029-8950-419f-b678-0e230018218e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:03.985365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb029-8950-419f-b678-0e230018218e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:03.985649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb029-8950-419f-b678-0e230018218e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:03.985925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb029-8950-419f-b678-0e230018218e None admin] PATH_INFO: `/v3/users/25ba51db172e4f3bba446da546398dbd` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:03.987061 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccb029-8950-419f-b678-0e230018218e None admin] RBAC: Authorizing `identity:get_user(user_id=25ba51db172e4f3bba446da546398dbd)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:03.988498 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccb029-8950-419f-b678-0e230018218e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:03.990111 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 76/151] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:03 2022] GET /identity/v3/users/25ba51db172e4f3bba446da546398dbd => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:03.996140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccb029-8950-419f-b678-0e230018218e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:04.008609 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:04.104599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccb029-8950-419f-b678-0e230018218e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:04.126572 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17132565-389c-41c1-8702-5c7aa1cc920a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:04.128062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17132565-389c-41c1-8702-5c7aa1cc920a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:04.154715 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647bb69-1bd0-4e0a-85ad-e062e7ca9d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:04.155271 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647bb69-1bd0-4e0a-85ad-e062e7ca9d23 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:04.155522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647bb69-1bd0-4e0a-85ad-e062e7ca9d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:04.155839 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647bb69-1bd0-4e0a-85ad-e062e7ca9d23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:04.235660 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647bb69-1bd0-4e0a-85ad-e062e7ca9d23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:04.237730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647bb69-1bd0-4e0a-85ad-e062e7ca9d23 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:04.240060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:04.359527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 77/152] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 16:12:04.366022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60af3a-1c87-445e-a184-b15721e69d3b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:04.366307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60af3a-1c87-445e-a184-b15721e69d3b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:04.366579 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60af3a-1c87-445e-a184-b15721e69d3b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:04.368089 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 78/153] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:04.368769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60af3a-1c87-445e-a184-b15721e69d3b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:04.376875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 76/154] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 933 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:04.379927 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07fdcd-671e-4f1e-8a15-45eed9092643 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:04.380315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07fdcd-671e-4f1e-8a15-45eed9092643 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:04.380616 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07fdcd-671e-4f1e-8a15-45eed9092643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:04.395451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:04.402960 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0b07fdcd-671e-4f1e-8a15-45eed9092643 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:04.405143 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0b07fdcd-671e-4f1e-8a15-45eed9092643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:04.476554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 77/155] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:04.484611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07fdcd-671e-4f1e-8a15-45eed9092643 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:04.574232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60af3a-1c87-445e-a184-b15721e69d3b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:04.576889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:04.607715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07fdcd-671e-4f1e-8a15-45eed9092643 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:04.643362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69add32c-14ef-416f-b19c-ae04b3a4735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:04.644031 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69add32c-14ef-416f-b19c-ae04b3a4735a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:04.644309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69add32c-14ef-416f-b19c-ae04b3a4735a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:04.644594 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69add32c-14ef-416f-b19c-ae04b3a4735a None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:04.645754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69add32c-14ef-416f-b19c-ae04b3a4735a None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:04.647905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69add32c-14ef-416f-b19c-ae04b3a4735a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:04.649904 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 78/156] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:04 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:04.650777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69add32c-14ef-416f-b19c-ae04b3a4735a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:04.654520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:04.682328 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0e5bf-c546-4408-b384-a19a8cec5dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:04.682943 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e5bf-c546-4408-b384-a19a8cec5dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:04.683160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e5bf-c546-4408-b384-a19a8cec5dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:04.683433 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e5bf-c546-4408-b384-a19a8cec5dd7 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:04.684619 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0e5bf-c546-4408-b384-a19a8cec5dd7 None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:04.690164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0e5bf-c546-4408-b384-a19a8cec5dd7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:04.692024 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 79/157] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:04 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:04.692725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0e5bf-c546-4408-b384-a19a8cec5dd7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:04.758845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69add32c-14ef-416f-b19c-ae04b3a4735a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:04.795707 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a34ef6-5e29-4e69-abaf-78ac0ea2bf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:04.797060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a34ef6-5e29-4e69-abaf-78ac0ea2bf7a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:04.797488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a34ef6-5e29-4e69-abaf-78ac0ea2bf7a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:04.798044 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a34ef6-5e29-4e69-abaf-78ac0ea2bf7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:04.809426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a34ef6-5e29-4e69-abaf-78ac0ea2bf7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-41a34ef6-5e29-4e69-abaf-78ac0ea2bf7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:04.814961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:04.816098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:04.817070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:04.817070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:04.817070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:04.817070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:04.817070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:04.817070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:04.817070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:04.817070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:04.817070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:04.817070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:04.817070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:04.817070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:04.819075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 79/158] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:04.820045 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a34ef6-5e29-4e69-abaf-78ac0ea2bf7a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:04.891119 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:04.933161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0e5bf-c546-4408-b384-a19a8cec5dd7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:04.934694 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a34ef6-5e29-4e69-abaf-78ac0ea2bf7a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:04.974402 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259877d9-2e10-47d5-89f8-8937e23478fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:04.975434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259877d9-2e10-47d5-89f8-8937e23478fe None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:04.975847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259877d9-2e10-47d5-89f8-8937e23478fe None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:04.975965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51c5ee-2dbc-45a8-a603-57450c855c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:04.976369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259877d9-2e10-47d5-89f8-8937e23478fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:04.976476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51c5ee-2dbc-45a8-a603-57450c855c69 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:04.977445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51c5ee-2dbc-45a8-a603-57450c855c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:04.977445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51c5ee-2dbc-45a8-a603-57450c855c69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:04.977728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51c5ee-2dbc-45a8-a603-57450c855c69 None admin] RBAC: Adding query filter params (role.id=87abba8d76c2420c97d9d5f2dbb6b540, scope.project.id=c22b8f7f1cc4484180061823f1584623, user.id=25ba51db172e4f3bba446da546398dbd) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:04.978027 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51c5ee-2dbc-45a8-a603-57450c855c69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:04.978673 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259877d9-2e10-47d5-89f8-8937e23478fe None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=c22b8f7f1cc4484180061823f1584623, user.id=c190c69c93f440c9b6a6c24b62b15091) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:04.979130 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259877d9-2e10-47d5-89f8-8937e23478fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:04.979625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51c5ee-2dbc-45a8-a603-57450c855c69 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:04.980871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259877d9-2e10-47d5-89f8-8937e23478fe None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:04.986721 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 80/159] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:04 2022] GET /identity/v3/role_assignments?user.id=25ba51db172e4f3bba446da546398dbd&scope.project.id=c22b8f7f1cc4484180061823f1584623&role.id=87abba8d76c2420c97d9d5f2dbb6b540 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:04.987545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51c5ee-2dbc-45a8-a603-57450c855c69 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:04.988644 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 80/160] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:04 2022] GET /identity/v3/role_assignments?user.id=c190c69c93f440c9b6a6c24b62b15091&scope.project.id=c22b8f7f1cc4484180061823f1584623&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:04.990265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e90d5-2029-4c18-b98f-c1b141d8ae2d None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:04.990728 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e90d5-2029-4c18-b98f-c1b141d8ae2d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:04.991231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e90d5-2029-4c18-b98f-c1b141d8ae2d None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:04.992648 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 81/161] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:04.998746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279a47c-c877-4651-aa50-17649ad8bed5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:04.999267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279a47c-c877-4651-aa50-17649ad8bed5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:04.999685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279a47c-c877-4651-aa50-17649ad8bed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:05.023545 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4279a47c-c877-4651-aa50-17649ad8bed5 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:05.025482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4279a47c-c877-4651-aa50-17649ad8bed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:05.087208 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:05.109587 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 82/162] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:05.116945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51c5ee-2dbc-45a8-a603-57450c855c69 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:05.136287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279a47c-c877-4651-aa50-17649ad8bed5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:05.153264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:05.165982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78d4f9-4e12-4f00-ac04-f56b373dfb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:05.166905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78d4f9-4e12-4f00-ac04-f56b373dfb89 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:05.167350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78d4f9-4e12-4f00-ac04-f56b373dfb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:05.167816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78d4f9-4e12-4f00-ac04-f56b373dfb89 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:05.169640 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78d4f9-4e12-4f00-ac04-f56b373dfb89 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:05.170149 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78d4f9-4e12-4f00-ac04-f56b373dfb89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:05.171863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78d4f9-4e12-4f00-ac04-f56b373dfb89 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:05.181667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 81/163] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:05.183420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63f3d8-90ca-4c6d-a5bc-4fcd727dfc6d None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:05.183889 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63f3d8-90ca-4c6d-a5bc-4fcd727dfc6d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:05.184329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63f3d8-90ca-4c6d-a5bc-4fcd727dfc6d None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:05.185886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 82/164] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:05.197304 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f80b6c-cae1-40ee-99bc-4f1f4cc936a3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:05.197896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f80b6c-cae1-40ee-99bc-4f1f4cc936a3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:05.198347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f80b6c-cae1-40ee-99bc-4f1f4cc936a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:05.233726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f9f80b6c-cae1-40ee-99bc-4f1f4cc936a3 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:05.235311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f9f80b6c-cae1-40ee-99bc-4f1f4cc936a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:05.278646 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279a47c-c877-4651-aa50-17649ad8bed5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:05.331405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06fbd9-bf07-4165-89d0-78051e238812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:05.332572 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06fbd9-bf07-4165-89d0-78051e238812 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:05.332870 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06fbd9-bf07-4165-89d0-78051e238812 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:05.333138 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06fbd9-bf07-4165-89d0-78051e238812 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:05.354270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06fbd9-bf07-4165-89d0-78051e238812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-0e06fbd9-bf07-4165-89d0-78051e238812 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:05.362014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:05.362904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:05.363656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:05.363656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:05.363656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:05.363656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:05.363656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:05.363656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:05.363656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:05.363656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:05.363656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:05.363656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:05.363656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:05.363656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:05.369918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 83/165] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:05.371401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 83/166] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:05.376240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f80b6c-cae1-40ee-99bc-4f1f4cc936a3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:05.382068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06fbd9-bf07-4165-89d0-78051e238812 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:05.458348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:05.576188 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f80b6c-cae1-40ee-99bc-4f1f4cc936a3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:05.578797 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06fbd9-bf07-4165-89d0-78051e238812 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:05.607299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:05.625010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b259c-a275-43cd-a287-5e74bf020a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:05.625652 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b259c-a275-43cd-a287-5e74bf020a8d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:05.625926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b259c-a275-43cd-a287-5e74bf020a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:05.626192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b259c-a275-43cd-a287-5e74bf020a8d None admin] PATH_INFO: `/v3/users/0bf9f132d0164305a3d3239c974ddd67` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:05.627327 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b259c-a275-43cd-a287-5e74bf020a8d None admin] RBAC: Authorizing `identity:get_user(user_id=0bf9f132d0164305a3d3239c974ddd67)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:05.628836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b259c-a275-43cd-a287-5e74bf020a8d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:05.630548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 84/167] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:05 2022] GET /identity/v3/users/0bf9f132d0164305a3d3239c974ddd67 => generated 289 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:05.631763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b259c-a275-43cd-a287-5e74bf020a8d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:05.657341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf64d4-41d8-4a8d-9c35-c4591155f8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:05.658045 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf64d4-41d8-4a8d-9c35-c4591155f8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:05.658366 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf64d4-41d8-4a8d-9c35-c4591155f8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:05.658647 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf64d4-41d8-4a8d-9c35-c4591155f8c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:05.659328 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf64d4-41d8-4a8d-9c35-c4591155f8c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:05.659626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf64d4-41d8-4a8d-9c35-c4591155f8c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:05.661113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf64d4-41d8-4a8d-9c35-c4591155f8c0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:05.673320 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 84/168] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:05.674006 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf64d4-41d8-4a8d-9c35-c4591155f8c0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:05.745426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b259c-a275-43cd-a287-5e74bf020a8d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:05.781370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425343f-c9ab-48fb-a073-a0bbb4c563c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:05.782002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425343f-c9ab-48fb-a073-a0bbb4c563c9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:05.782277 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425343f-c9ab-48fb-a073-a0bbb4c563c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:05.782544 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425343f-c9ab-48fb-a073-a0bbb4c563c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:05.793948 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425343f-c9ab-48fb-a073-a0bbb4c563c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-8425343f-c9ab-48fb-a073-a0bbb4c563c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:05.798919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:05.800227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:05.801040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:05.801040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:05.801040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:05.801040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:05.801040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:05.801040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:05.801040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:05.801040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:05.801040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:05.801040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:05.801040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:05.801040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:05.801040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 85/169] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:12:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:05.801040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425343f-c9ab-48fb-a073-a0bbb4c563c9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:05.854364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:05.905088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:05.908208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425343f-c9ab-48fb-a073-a0bbb4c563c9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:05.945303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2261bd-aaf3-4925-8c15-58420fd93da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:05.946099 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2261bd-aaf3-4925-8c15-58420fd93da4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:05.946374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2261bd-aaf3-4925-8c15-58420fd93da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:05.946640 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2261bd-aaf3-4925-8c15-58420fd93da4 None admin] PATH_INFO: `/v3/users/25ba51db172e4f3bba446da546398dbd` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:05.947787 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2261bd-aaf3-4925-8c15-58420fd93da4 None admin] RBAC: Authorizing `identity:get_user(user_id=25ba51db172e4f3bba446da546398dbd)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:05.949443 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2261bd-aaf3-4925-8c15-58420fd93da4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:05.951273 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 86/170] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:05 2022] GET /identity/v3/users/25ba51db172e4f3bba446da546398dbd => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:05.957229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2261bd-aaf3-4925-8c15-58420fd93da4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:05.966652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf64d4-41d8-4a8d-9c35-c4591155f8c0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:06.063591 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2261bd-aaf3-4925-8c15-58420fd93da4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:06.081002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:06.103082 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f499e-5ae6-4610-bf3b-5a52b833b0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:06.103696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f499e-5ae6-4610-bf3b-5a52b833b0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:06.103972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f499e-5ae6-4610-bf3b-5a52b833b0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:06.104238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f499e-5ae6-4610-bf3b-5a52b833b0c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:06.104942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f499e-5ae6-4610-bf3b-5a52b833b0c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:06.105227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f499e-5ae6-4610-bf3b-5a52b833b0c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:06.106582 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f499e-5ae6-4610-bf3b-5a52b833b0c8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:06.108862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35e313-30ce-4b7d-9dc6-6d25201d3e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:06.109494 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35e313-30ce-4b7d-9dc6-6d25201d3e91 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:06.109765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35e313-30ce-4b7d-9dc6-6d25201d3e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:06.110030 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35e313-30ce-4b7d-9dc6-6d25201d3e91 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:06.111144 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35e313-30ce-4b7d-9dc6-6d25201d3e91 None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:06.112616 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35e313-30ce-4b7d-9dc6-6d25201d3e91 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:06.115680 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 85/171] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:05 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:06.116445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35e313-30ce-4b7d-9dc6-6d25201d3e91 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:06.130648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 87/172] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:06.131558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f499e-5ae6-4610-bf3b-5a52b833b0c8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:06.310777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35e313-30ce-4b7d-9dc6-6d25201d3e91 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:06.317283 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f499e-5ae6-4610-bf3b-5a52b833b0c8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:06.367471 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564cbc6-b213-4618-a424-facc339475ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:06.368072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564cbc6-b213-4618-a424-facc339475ed None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:06.368354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564cbc6-b213-4618-a424-facc339475ed None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:06.368636 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564cbc6-b213-4618-a424-facc339475ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:06.385692 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb11793-eacb-4b9e-94bb-8cdfbe31d886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:06.386463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb11793-eacb-4b9e-94bb-8cdfbe31d886 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:06.386741 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb11793-eacb-4b9e-94bb-8cdfbe31d886 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:06.387009 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb11793-eacb-4b9e-94bb-8cdfbe31d886 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623/users/0bf9f132d0164305a3d3239c974ddd67/roles/3b85296a2d114d309360453dd73a3c22` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:06.389027 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb11793-eacb-4b9e-94bb-8cdfbe31d886 None admin] RBAC: Authorizing `identity:create_grant(project_id=c22b8f7f1cc4484180061823f1584623, user_id=0bf9f132d0164305a3d3239c974ddd67, role_id=3b85296a2d114d309360453dd73a3c22)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:06.390588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb11793-eacb-4b9e-94bb-8cdfbe31d886 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:06.397393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:06.422403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 88/173] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:12:06 2022] PUT /identity/v3/projects/c22b8f7f1cc4484180061823f1584623/users/0bf9f132d0164305a3d3239c974ddd67/roles/3b85296a2d114d309360453dd73a3c22 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:06.423355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb11793-eacb-4b9e-94bb-8cdfbe31d886 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:06.439879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564cbc6-b213-4618-a424-facc339475ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:06.441427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564cbc6-b213-4618-a424-facc339475ed None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:06.504612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:06.612204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb11793-eacb-4b9e-94bb-8cdfbe31d886 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:06.638270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 86/174] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:06.644001 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564cbc6-b213-4618-a424-facc339475ed None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:06.664853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15cfd4-bba9-4adc-8ae5-bab435cb0e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:06.665624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15cfd4-bba9-4adc-8ae5-bab435cb0e52 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:06.665903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15cfd4-bba9-4adc-8ae5-bab435cb0e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:06.666170 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15cfd4-bba9-4adc-8ae5-bab435cb0e52 None admin] PATH_INFO: `/v3/users/25ba51db172e4f3bba446da546398dbd` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:06.667367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15cfd4-bba9-4adc-8ae5-bab435cb0e52 None admin] RBAC: Authorizing `identity:get_user(user_id=25ba51db172e4f3bba446da546398dbd)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:06.668981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15cfd4-bba9-4adc-8ae5-bab435cb0e52 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:06.671035 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 89/175] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:06 2022] GET /identity/v3/users/25ba51db172e4f3bba446da546398dbd => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:06.676544 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15cfd4-bba9-4adc-8ae5-bab435cb0e52 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:06.763703 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:06.813779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15cfd4-bba9-4adc-8ae5-bab435cb0e52 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:06.826753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:06.848142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564cbc6-b213-4618-a424-facc339475ed None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:06.872878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74866f-9013-4263-9e46-1dcc161e9e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:06.873517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74866f-9013-4263-9e46-1dcc161e9e0e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:06.873800 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74866f-9013-4263-9e46-1dcc161e9e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:06.874070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74866f-9013-4263-9e46-1dcc161e9e0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:06.923264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632d125-6b42-42dc-93e0-ef7f51cc5cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:06.923936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632d125-6b42-42dc-93e0-ef7f51cc5cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:06.924173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632d125-6b42-42dc-93e0-ef7f51cc5cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:06.924440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632d125-6b42-42dc-93e0-ef7f51cc5cf3 None admin] PATH_INFO: `/v3/projects/3f6c7f6f1b0e4f7c9d02114dee6b0889` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:06.925656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632d125-6b42-42dc-93e0-ef7f51cc5cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=3f6c7f6f1b0e4f7c9d02114dee6b0889)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:06.927091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632d125-6b42-42dc-93e0-ef7f51cc5cf3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:06.928909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 87/176] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:06 2022] GET /identity/v3/projects/3f6c7f6f1b0e4f7c9d02114dee6b0889 => generated 312 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:06.938950 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632d125-6b42-42dc-93e0-ef7f51cc5cf3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:06.982839 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74866f-9013-4263-9e46-1dcc161e9e0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:06.984318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74866f-9013-4263-9e46-1dcc161e9e0e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:07.102206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632d125-6b42-42dc-93e0-ef7f51cc5cf3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:07.133924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:07.148081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd032dae-295a-427b-ad83-881eb548cbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:07.148705 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd032dae-295a-427b-ad83-881eb548cbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:07.149117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd032dae-295a-427b-ad83-881eb548cbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:07.149389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd032dae-295a-427b-ad83-881eb548cbf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:07.150260 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd032dae-295a-427b-ad83-881eb548cbf3 None admin] RBAC: Adding query filter params (role.id=87abba8d76c2420c97d9d5f2dbb6b540, scope.project.id=3f6c7f6f1b0e4f7c9d02114dee6b0889, user.id=25ba51db172e4f3bba446da546398dbd) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:07.150564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd032dae-295a-427b-ad83-881eb548cbf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:07.152002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd032dae-295a-427b-ad83-881eb548cbf3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:07.158517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 88/177] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:06 2022] GET /identity/v3/role_assignments?user.id=25ba51db172e4f3bba446da546398dbd&scope.project.id=3f6c7f6f1b0e4f7c9d02114dee6b0889&role.id=87abba8d76c2420c97d9d5f2dbb6b540 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:07.159688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f80cb1-830f-4aef-be52-c61f63b7a0e5 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:07.159794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 90/178] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:07.159969 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f80cb1-830f-4aef-be52-c61f63b7a0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:07.160240 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f80cb1-830f-4aef-be52-c61f63b7a0e5 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:07.161551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 89/179] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:07.171772 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74866f-9013-4263-9e46-1dcc161e9e0e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:07.178881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6424d57-4d29-4f3c-be2b-1e80db1b7ed8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:07.179163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6424d57-4d29-4f3c-be2b-1e80db1b7ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:07.179438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6424d57-4d29-4f3c-be2b-1e80db1b7ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:07.184978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:07.215852 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e6424d57-4d29-4f3c-be2b-1e80db1b7ed8 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:07.217457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e6424d57-4d29-4f3c-be2b-1e80db1b7ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:07.316677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 90/180] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:07.368013 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6424d57-4d29-4f3c-be2b-1e80db1b7ed8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:07.477757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74866f-9013-4263-9e46-1dcc161e9e0e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:07.508989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6424d57-4d29-4f3c-be2b-1e80db1b7ed8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:07.530003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630eea3-8de8-4c31-9691-4403b9036a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:07.530636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630eea3-8de8-4c31-9691-4403b9036a11 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:07.530935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630eea3-8de8-4c31-9691-4403b9036a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:07.531214 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630eea3-8de8-4c31-9691-4403b9036a11 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:07.532425 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630eea3-8de8-4c31-9691-4403b9036a11 None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:07.540052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630eea3-8de8-4c31-9691-4403b9036a11 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:07.540052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 91/181] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:07 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:07.540052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0679b-34dd-4513-b3c7-7cd4b8a76858 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:07.540052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0679b-34dd-4513-b3c7-7cd4b8a76858 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:07.540052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0679b-34dd-4513-b3c7-7cd4b8a76858 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:07.540052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 92/182] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:07.540993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:07.546833 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0679b-34dd-4513-b3c7-7cd4b8a76858 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:07.567492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c40b3-c45d-4337-bdcb-8d54aabfe0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:07.569787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c40b3-c45d-4337-bdcb-8d54aabfe0bd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:07.569959 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c40b3-c45d-4337-bdcb-8d54aabfe0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:07.570330 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c40b3-c45d-4337-bdcb-8d54aabfe0bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:07.582266 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c40b3-c45d-4337-bdcb-8d54aabfe0bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-359c40b3-c45d-4337-bdcb-8d54aabfe0bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:07.588947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:07.589978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:07.590756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:07.590756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:07.590756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:07.590756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:07.590756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:07.590756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:07.590756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:07.590756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:07.590756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:07.590756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:07.590756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:12:07.590756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:07.591358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 91/183] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:12:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:07.592553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0529147-f828-4497-9fcd-860e635a166c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:07.593035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0529147-f828-4497-9fcd-860e635a166c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:07.593474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0529147-f828-4497-9fcd-860e635a166c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:07.620733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e0529147-f828-4497-9fcd-860e635a166c None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:07.622283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e0529147-f828-4497-9fcd-860e635a166c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:07.665898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:07.699989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0679b-34dd-4513-b3c7-7cd4b8a76858 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:07.728431 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 92/184] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:07.732325 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0529147-f828-4497-9fcd-860e635a166c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:07.751407 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74309765-47d8-40e3-92c7-983cfea196d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:07.752987 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74309765-47d8-40e3-92c7-983cfea196d6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:07.753313 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74309765-47d8-40e3-92c7-983cfea196d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:07.753599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74309765-47d8-40e3-92c7-983cfea196d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:07.754367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74309765-47d8-40e3-92c7-983cfea196d6 None admin] RBAC: Adding query filter params (role.id=a507b36f2493428fbb8fcdc4fbad6911, scope.project.id=c22b8f7f1cc4484180061823f1584623, user.id=25ba51db172e4f3bba446da546398dbd) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:07.754684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74309765-47d8-40e3-92c7-983cfea196d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:07.756191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74309765-47d8-40e3-92c7-983cfea196d6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:07.763704 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 93/185] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:07 2022] GET /identity/v3/role_assignments?user.id=25ba51db172e4f3bba446da546398dbd&scope.project.id=c22b8f7f1cc4484180061823f1584623&role.id=a507b36f2493428fbb8fcdc4fbad6911 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:07.764509 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74309765-47d8-40e3-92c7-983cfea196d6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:07.926013 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74309765-47d8-40e3-92c7-983cfea196d6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:07.951296 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0529147-f828-4497-9fcd-860e635a166c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:07.961661 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:07.976940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cac0c-91fa-46a7-bdec-ba37254744cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:07.977836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cac0c-91fa-46a7-bdec-ba37254744cd None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:07.978116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cac0c-91fa-46a7-bdec-ba37254744cd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:07.978389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cac0c-91fa-46a7-bdec-ba37254744cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:07.987146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:07.994576 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cac0c-91fa-46a7-bdec-ba37254744cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:07.994787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b55ef-4c15-430d-ba45-aff499b3338d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:07.994787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b55ef-4c15-430d-ba45-aff499b3338d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:07.994787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b55ef-4c15-430d-ba45-aff499b3338d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:07.994787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b55ef-4c15-430d-ba45-aff499b3338d None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:07.995034 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b55ef-4c15-430d-ba45-aff499b3338d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:07.995299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b55ef-4c15-430d-ba45-aff499b3338d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:07.998316 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b55ef-4c15-430d-ba45-aff499b3338d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-001cac0c-91fa-46a7-bdec-ba37254744cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:07.998468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:07.999352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:08.001128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:08.001128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:08.001128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:08.001128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:08.001128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:08.001128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:08.001128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:08.001128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:08.001128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:08.001128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:08.001128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:08.001128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:08.001128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 94/186] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:12:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:08.003535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23018c-f0d5-4341-a6ac-6445e49305df None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:08.003535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23018c-f0d5-4341-a6ac-6445e49305df None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:08.003535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23018c-f0d5-4341-a6ac-6445e49305df None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:08.007578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 95/187] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:08.007578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23018c-f0d5-4341-a6ac-6445e49305df None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:08.011048 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 93/188] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:08.013820 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17185e-6742-4ce4-a7d9-993509c748f9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:08.014115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17185e-6742-4ce4-a7d9-993509c748f9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:08.014370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17185e-6742-4ce4-a7d9-993509c748f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:08.032728 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3f17185e-6742-4ce4-a7d9-993509c748f9 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:08.033899 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3f17185e-6742-4ce4-a7d9-993509c748f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:08.121483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 94/189] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:08.122354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17185e-6742-4ce4-a7d9-993509c748f9 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:08.144724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23018c-f0d5-4341-a6ac-6445e49305df None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:08.180335 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528808d5-9eb3-4ef9-a631-db15edbb2994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:08.180969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528808d5-9eb3-4ef9-a631-db15edbb2994 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:08.181240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528808d5-9eb3-4ef9-a631-db15edbb2994 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:08.181506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528808d5-9eb3-4ef9-a631-db15edbb2994 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:08.182168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528808d5-9eb3-4ef9-a631-db15edbb2994 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:08.182469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528808d5-9eb3-4ef9-a631-db15edbb2994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:08.183849 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528808d5-9eb3-4ef9-a631-db15edbb2994 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:08.192130 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 96/190] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:08.192777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528808d5-9eb3-4ef9-a631-db15edbb2994 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:08.236853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:08.241452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17185e-6742-4ce4-a7d9-993509c748f9 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:08.258744 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:08.279983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7afa36-5857-487e-acc4-7b15fcd7067b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:08.280931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7afa36-5857-487e-acc4-7b15fcd7067b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:08.281204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7afa36-5857-487e-acc4-7b15fcd7067b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:08.281479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7afa36-5857-487e-acc4-7b15fcd7067b None admin] PATH_INFO: `/v3/users/2028f2f4cd7b4ce7945f099fee29e813` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:08.298590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7afa36-5857-487e-acc4-7b15fcd7067b None admin] RBAC: Authorizing `identity:get_user(user_id=2028f2f4cd7b4ce7945f099fee29e813)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:08.300072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7afa36-5857-487e-acc4-7b15fcd7067b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:08.301919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 95/191] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:08 2022] GET /identity/v3/users/2028f2f4cd7b4ce7945f099fee29e813 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:08.305140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528808d5-9eb3-4ef9-a631-db15edbb2994 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:08.306954 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7afa36-5857-487e-acc4-7b15fcd7067b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:08.341532 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424f66f-21ec-4207-be18-eae54b19e33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:08.342638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424f66f-21ec-4207-be18-eae54b19e33e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:08.342638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424f66f-21ec-4207-be18-eae54b19e33e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:08.342827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424f66f-21ec-4207-be18-eae54b19e33e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:08.343769 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424f66f-21ec-4207-be18-eae54b19e33e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:08.345244 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424f66f-21ec-4207-be18-eae54b19e33e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:08.351923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 97/192] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:08.351923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424f66f-21ec-4207-be18-eae54b19e33e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:08.416429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7afa36-5857-487e-acc4-7b15fcd7067b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:08.449361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db925b31-45e3-41de-82a3-baf5f5170d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:08.449987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db925b31-45e3-41de-82a3-baf5f5170d61 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:08.450270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db925b31-45e3-41de-82a3-baf5f5170d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:08.450527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db925b31-45e3-41de-82a3-baf5f5170d61 None admin] PATH_INFO: `/v3/users/2028f2f4cd7b4ce7945f099fee29e813` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:08.451635 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db925b31-45e3-41de-82a3-baf5f5170d61 None admin] RBAC: Authorizing `identity:get_user(user_id=2028f2f4cd7b4ce7945f099fee29e813)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:08.453107 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db925b31-45e3-41de-82a3-baf5f5170d61 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:08.454690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 96/193] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:08 2022] GET /identity/v3/users/2028f2f4cd7b4ce7945f099fee29e813 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:08.455498 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db925b31-45e3-41de-82a3-baf5f5170d61 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:08.465330 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424f66f-21ec-4207-be18-eae54b19e33e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:08.484654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:08.500487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:08.509709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672e584-2d28-4efe-acbd-368fbee561cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:08.510516 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672e584-2d28-4efe-acbd-368fbee561cf None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:08.510791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672e584-2d28-4efe-acbd-368fbee561cf None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:08.511154 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672e584-2d28-4efe-acbd-368fbee561cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:08.564219 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db925b31-45e3-41de-82a3-baf5f5170d61 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:08.583382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672e584-2d28-4efe-acbd-368fbee561cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:08.585439 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672e584-2d28-4efe-acbd-368fbee561cf None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:08.600431 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901519c1-7d39-4ab9-aace-fc4ecd10a278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:08.601130 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901519c1-7d39-4ab9-aace-fc4ecd10a278 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:08.601407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901519c1-7d39-4ab9-aace-fc4ecd10a278 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:08.601707 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901519c1-7d39-4ab9-aace-fc4ecd10a278 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:08.602344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901519c1-7d39-4ab9-aace-fc4ecd10a278 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:08.603764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901519c1-7d39-4ab9-aace-fc4ecd10a278 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:08.631011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 97/194] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:12:08 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:12:08.631011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901519c1-7d39-4ab9-aace-fc4ecd10a278 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:08.727115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 98/195] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:08.732897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672e584-2d28-4efe-acbd-368fbee561cf None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:08.742200 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:08.768748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901519c1-7d39-4ab9-aace-fc4ecd10a278 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:08.775912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:08.814307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100ab3c-03e8-46b1-82f7-7c78518adf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:08.814947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100ab3c-03e8-46b1-82f7-7c78518adf19 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:08.815226 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100ab3c-03e8-46b1-82f7-7c78518adf19 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:08.815491 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100ab3c-03e8-46b1-82f7-7c78518adf19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:08.860854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672e584-2d28-4efe-acbd-368fbee561cf None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:08.897694 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100ab3c-03e8-46b1-82f7-7c78518adf19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:08.899285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100ab3c-03e8-46b1-82f7-7c78518adf19 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:08.915760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aea77-3490-4030-8b3a-d12c9d27f591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:08.916458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aea77-3490-4030-8b3a-d12c9d27f591 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:08.916789 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aea77-3490-4030-8b3a-d12c9d27f591 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:08.917063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aea77-3490-4030-8b3a-d12c9d27f591 None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:08.918414 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aea77-3490-4030-8b3a-d12c9d27f591 None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:08.920248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aea77-3490-4030-8b3a-d12c9d27f591 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:08.922280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 99/196] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:08 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:08.923310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11401ba-56e3-4f2f-93c7-b05a0e4edc10 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:08.923592 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11401ba-56e3-4f2f-93c7-b05a0e4edc10 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:08.923865 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11401ba-56e3-4f2f-93c7-b05a0e4edc10 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:08.927381 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 100/197] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:08.930246 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11401ba-56e3-4f2f-93c7-b05a0e4edc10 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:08.995283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:09.023179 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 98/198] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:09.025152 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc60c6-fc61-48f3-b119-c76b5f8a48b1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:09.025152 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc60c6-fc61-48f3-b119-c76b5f8a48b1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:09.025152 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc60c6-fc61-48f3-b119-c76b5f8a48b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:09.045734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9bcc60c6-fc61-48f3-b119-c76b5f8a48b1 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:09.047258 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9bcc60c6-fc61-48f3-b119-c76b5f8a48b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:09.051668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:09.056767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11401ba-56e3-4f2f-93c7-b05a0e4edc10 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:09.100826 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d8e7c-eabf-4935-bcd2-f36d29cc369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:09.101442 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d8e7c-eabf-4935-bcd2-f36d29cc369b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:09.101720 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d8e7c-eabf-4935-bcd2-f36d29cc369b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:09.101994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d8e7c-eabf-4935-bcd2-f36d29cc369b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:09.102740 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d8e7c-eabf-4935-bcd2-f36d29cc369b None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=75c18326de4348a5851e485deb998c36, user.id=2028f2f4cd7b4ce7945f099fee29e813) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:09.103051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d8e7c-eabf-4935-bcd2-f36d29cc369b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:09.104836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d8e7c-eabf-4935-bcd2-f36d29cc369b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:09.111313 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 101/199] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:08 2022] GET /identity/v3/role_assignments?user.id=2028f2f4cd7b4ce7945f099fee29e813&scope.project.id=75c18326de4348a5851e485deb998c36&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:09.111808 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d8e7c-eabf-4935-bcd2-f36d29cc369b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:09.144375 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 99/200] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:09.180415 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc60c6-fc61-48f3-b119-c76b5f8a48b1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:09.292398 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d8e7c-eabf-4935-bcd2-f36d29cc369b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:09.345295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc60c6-fc61-48f3-b119-c76b5f8a48b1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:09.358760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d9c0e-ab74-4ce3-92fc-cbfe5f5ffaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:09.359395 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d9c0e-ab74-4ce3-92fc-cbfe5f5ffaf2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:09.359669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d9c0e-ab74-4ce3-92fc-cbfe5f5ffaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:09.359933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d9c0e-ab74-4ce3-92fc-cbfe5f5ffaf2 None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:09.362699 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d9c0e-ab74-4ce3-92fc-cbfe5f5ffaf2 None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:09.364136 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d9c0e-ab74-4ce3-92fc-cbfe5f5ffaf2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:09.366197 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 102/201] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:09 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:09.371571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d9c0e-ab74-4ce3-92fc-cbfe5f5ffaf2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:09.376766 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:09.415642 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:09.416867 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3f4a1-9f84-44d2-bc86-b01646f3fa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:09.417509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3f4a1-9f84-44d2-bc86-b01646f3fa39 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:09.417924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3f4a1-9f84-44d2-bc86-b01646f3fa39 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:09.418201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3f4a1-9f84-44d2-bc86-b01646f3fa39 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:09.431903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3f4a1-9f84-44d2-bc86-b01646f3fa39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-67a3f4a1-9f84-44d2-bc86-b01646f3fa39 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:09.436871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:09.437738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:09.438940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:09.438940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:09.438940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:09.438940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:09.438940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:09.438940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:09.438940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:09.438940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:09.438940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:09.438940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:09.438940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:09.438940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:09.438940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 100/202] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:12:09.444394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3f4a1-9f84-44d2-bc86-b01646f3fa39 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:09.547956 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d9c0e-ab74-4ce3-92fc-cbfe5f5ffaf2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:09.597849 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd030e54-9888-4a80-8e5a-9a8d63e241d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:09.598527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd030e54-9888-4a80-8e5a-9a8d63e241d7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:09.598807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd030e54-9888-4a80-8e5a-9a8d63e241d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:09.599079 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd030e54-9888-4a80-8e5a-9a8d63e241d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:09.599843 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd030e54-9888-4a80-8e5a-9a8d63e241d7 None admin] RBAC: Adding query filter params (role.id=a507b36f2493428fbb8fcdc4fbad6911, scope.project.id=75c18326de4348a5851e485deb998c36, user.id=2028f2f4cd7b4ce7945f099fee29e813) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:09.600147 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd030e54-9888-4a80-8e5a-9a8d63e241d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:09.605675 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd030e54-9888-4a80-8e5a-9a8d63e241d7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:09.616640 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 103/203] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:09 2022] GET /identity/v3/role_assignments?user.id=2028f2f4cd7b4ce7945f099fee29e813&scope.project.id=75c18326de4348a5851e485deb998c36&role.id=a507b36f2493428fbb8fcdc4fbad6911 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:09.626173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3f4a1-9f84-44d2-bc86-b01646f3fa39 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:09.674507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035cf87-59a6-4718-92fc-f1469ae8edb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:09.675142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035cf87-59a6-4718-92fc-f1469ae8edb8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:09.675420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035cf87-59a6-4718-92fc-f1469ae8edb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:09.675694 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035cf87-59a6-4718-92fc-f1469ae8edb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:09.676383 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035cf87-59a6-4718-92fc-f1469ae8edb8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:09.676755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035cf87-59a6-4718-92fc-f1469ae8edb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:09.678210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035cf87-59a6-4718-92fc-f1469ae8edb8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:09.688249 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 101/204] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:09.694328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd030e54-9888-4a80-8e5a-9a8d63e241d7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:09.824077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:09.837788 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd030e54-9888-4a80-8e5a-9a8d63e241d7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:09.885537 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dda42-6faf-4707-8296-1c6cadd86c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:09.886520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dda42-6faf-4707-8296-1c6cadd86c6a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:09.887008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dda42-6faf-4707-8296-1c6cadd86c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:09.887476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dda42-6faf-4707-8296-1c6cadd86c6a None admin] PATH_INFO: `/v3/users/0bf9f132d0164305a3d3239c974ddd67` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:09.888825 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dda42-6faf-4707-8296-1c6cadd86c6a None admin] RBAC: Authorizing `identity:get_user(user_id=0bf9f132d0164305a3d3239c974ddd67)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:09.890809 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dda42-6faf-4707-8296-1c6cadd86c6a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:09.892924 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 104/205] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:09 2022] GET /identity/v3/users/0bf9f132d0164305a3d3239c974ddd67 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:09.898358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035cf87-59a6-4718-92fc-f1469ae8edb8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:09.959906 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:10.057110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035cf87-59a6-4718-92fc-f1469ae8edb8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:10.102603 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d8dc7-ea8f-4956-a5fb-a41ec7bf09ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:10.103138 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d8dc7-ea8f-4956-a5fb-a41ec7bf09ae None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:10.103409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d8dc7-ea8f-4956-a5fb-a41ec7bf09ae None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:10.103679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d8dc7-ea8f-4956-a5fb-a41ec7bf09ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:10.176072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d8dc7-ea8f-4956-a5fb-a41ec7bf09ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:10.177560 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d8dc7-ea8f-4956-a5fb-a41ec7bf09ae None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:10.216891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:10.308221 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 102/206] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:10.317697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dda42-6faf-4707-8296-1c6cadd86c6a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:10.423180 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dda42-6faf-4707-8296-1c6cadd86c6a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:10.466139 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2401e5d-8f6d-49e5-9694-33954e0a999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:10.466768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2401e5d-8f6d-49e5-9694-33954e0a999c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:10.467048 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2401e5d-8f6d-49e5-9694-33954e0a999c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:10.467319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2401e5d-8f6d-49e5-9694-33954e0a999c None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:10.473285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2401e5d-8f6d-49e5-9694-33954e0a999c None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:10.474787 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2401e5d-8f6d-49e5-9694-33954e0a999c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:10.477285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 105/207] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:10 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:10.483993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d8dc7-ea8f-4956-a5fb-a41ec7bf09ae None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:10.624930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d8dc7-ea8f-4956-a5fb-a41ec7bf09ae None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:10.665707 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:10.671237 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a70913-347d-4b8e-b82b-5b7127bc4190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:10.672052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a70913-347d-4b8e-b82b-5b7127bc4190 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:10.672144 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a70913-347d-4b8e-b82b-5b7127bc4190 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:10.672372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a70913-347d-4b8e-b82b-5b7127bc4190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:10.673356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a70913-347d-4b8e-b82b-5b7127bc4190 None admin] RBAC: Adding query filter params (role.id=3b85296a2d114d309360453dd73a3c22, scope.project.id=c22b8f7f1cc4484180061823f1584623, user.id=0bf9f132d0164305a3d3239c974ddd67) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:10.673602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a70913-347d-4b8e-b82b-5b7127bc4190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:10.675052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a70913-347d-4b8e-b82b-5b7127bc4190 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:10.685178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 103/208] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:10 2022] GET /identity/v3/role_assignments?user.id=0bf9f132d0164305a3d3239c974ddd67&scope.project.id=c22b8f7f1cc4484180061823f1584623&role.id=3b85296a2d114d309360453dd73a3c22 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:11.176078 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180aca9-0369-4840-9b9d-1f5ebaff980f None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:11.176447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180aca9-0369-4840-9b9d-1f5ebaff980f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:11.176667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180aca9-0369-4840-9b9d-1f5ebaff980f None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:11.178291 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 106/209] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:11.183704 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5823ea5-3a72-4032-9143-cf0e4d594fa4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:11.184496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5823ea5-3a72-4032-9143-cf0e4d594fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:11.184946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5823ea5-3a72-4032-9143-cf0e4d594fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:11.209978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e5823ea5-3a72-4032-9143-cf0e4d594fa4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:11.211452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e5823ea5-3a72-4032-9143-cf0e4d594fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:11.286664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 104/210] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:11.310524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180aca9-0369-4840-9b9d-1f5ebaff980f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:11.321838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76360f0b-8cb4-4fea-a81d-80712f2b37a5 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:11.322138 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76360f0b-8cb4-4fea-a81d-80712f2b37a5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:11.324146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76360f0b-8cb4-4fea-a81d-80712f2b37a5 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:11.326747 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 105/211] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:11.331961 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901909d-5c27-47a4-a67c-694d1deca266 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:11.332265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901909d-5c27-47a4-a67c-694d1deca266 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:11.332536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901909d-5c27-47a4-a67c-694d1deca266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:11.348502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:11.352701 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2901909d-5c27-47a4-a67c-694d1deca266 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:11.353867 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2901909d-5c27-47a4-a67c-694d1deca266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:11.428703 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 106/212] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:11.448158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180aca9-0369-4840-9b9d-1f5ebaff980f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:11.456423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901909d-5c27-47a4-a67c-694d1deca266 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:11.493368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff839fd-c491-44bb-96a5-f2df2307a551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:11.494078 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff839fd-c491-44bb-96a5-f2df2307a551 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:11.494358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff839fd-c491-44bb-96a5-f2df2307a551 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:11.494626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff839fd-c491-44bb-96a5-f2df2307a551 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:11.513827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff839fd-c491-44bb-96a5-f2df2307a551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-0ff839fd-c491-44bb-96a5-f2df2307a551 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:11.520220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:11.521138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:11.521943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:11.521943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:11.521943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:11.521943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:11.521943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:11.521943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:11.521943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:11.521943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:11.521943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:11.521943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:11.521943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:11.521943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:11.521943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 107/213] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:11.527101 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff839fd-c491-44bb-96a5-f2df2307a551 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:11.538362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:11.587366 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901909d-5c27-47a4-a67c-694d1deca266 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:11.616750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:11.624188 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c804c-3252-4be0-92e6-ceac5e4026bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:11.624849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c804c-3252-4be0-92e6-ceac5e4026bb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:11.625128 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c804c-3252-4be0-92e6-ceac5e4026bb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:11.625401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c804c-3252-4be0-92e6-ceac5e4026bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:11.626514 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c804c-3252-4be0-92e6-ceac5e4026bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:11.627966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c804c-3252-4be0-92e6-ceac5e4026bb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:11.629594 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 107/214] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:11.630707 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1108d-1c1b-4f9a-b9ce-62fd27c7b147 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:11.631012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1108d-1c1b-4f9a-b9ce-62fd27c7b147 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:11.631286 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1108d-1c1b-4f9a-b9ce-62fd27c7b147 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:11.631770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff839fd-c491-44bb-96a5-f2df2307a551 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:11.632482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 108/215] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:11.636028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1108d-1c1b-4f9a-b9ce-62fd27c7b147 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:11.669858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbef32-a3ca-40f3-b822-0533b64771d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:11.670801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbef32-a3ca-40f3-b822-0533b64771d3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:11.671214 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbef32-a3ca-40f3-b822-0533b64771d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:11.671622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbef32-a3ca-40f3-b822-0533b64771d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:11.672444 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbef32-a3ca-40f3-b822-0533b64771d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:11.672912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbef32-a3ca-40f3-b822-0533b64771d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:11.674437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbef32-a3ca-40f3-b822-0533b64771d3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:11.683538 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 108/216] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:11.684981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38023a6c-644f-48e2-83c7-33ec3564f0d6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:11.685261 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38023a6c-644f-48e2-83c7-33ec3564f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:11.685525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38023a6c-644f-48e2-83c7-33ec3564f0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:11.704576 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-38023a6c-644f-48e2-83c7-33ec3564f0d6 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:11.705781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-38023a6c-644f-48e2-83c7-33ec3564f0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:11.746927 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1108d-1c1b-4f9a-b9ce-62fd27c7b147 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:11.770513 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:11.779223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 109/217] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:11.780804 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38023a6c-644f-48e2-83c7-33ec3564f0d6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:11.789813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a980c-d003-46b6-8839-102947104c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:11.791154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a980c-d003-46b6-8839-102947104c49 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:11.791673 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a980c-d003-46b6-8839-102947104c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:11.792553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a980c-d003-46b6-8839-102947104c49 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:11.793797 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a980c-d003-46b6-8839-102947104c49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:11.796419 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a980c-d003-46b6-8839-102947104c49 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:11.821686 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 109/218] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:12:11 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:12:11.822986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a980c-d003-46b6-8839-102947104c49 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:11.892075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:11.923452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38023a6c-644f-48e2-83c7-33ec3564f0d6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:11.941464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a980c-d003-46b6-8839-102947104c49 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:11.972094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bea5f-851e-4e33-973f-13f250c924ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:11.972781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bea5f-851e-4e33-973f-13f250c924ae None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:11.973057 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bea5f-851e-4e33-973f-13f250c924ae None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:11.973328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bea5f-851e-4e33-973f-13f250c924ae None admin] PATH_INFO: `/v3/users/c1ddfff3440b44a287643061ef76f6a7` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:11.982608 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca06e8-553f-495a-8bc8-b5c1d620c6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:11.983638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca06e8-553f-495a-8bc8-b5c1d620c6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:11.984155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca06e8-553f-495a-8bc8-b5c1d620c6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:11.984652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca06e8-553f-495a-8bc8-b5c1d620c6a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:11.989666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bea5f-851e-4e33-973f-13f250c924ae None admin] RBAC: Authorizing `identity:get_user(user_id=c1ddfff3440b44a287643061ef76f6a7)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:11.991282 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bea5f-851e-4e33-973f-13f250c924ae None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:11.994014 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 110/219] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:11 2022] GET /identity/v3/users/c1ddfff3440b44a287643061ef76f6a7 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:11.997480 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca06e8-553f-495a-8bc8-b5c1d620c6a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:11.999351 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bea5f-851e-4e33-973f-13f250c924ae None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-37ca06e8-553f-495a-8bc8-b5c1d620c6a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:12.003582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:12.004453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:12.005265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:12.005265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:12.005265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:12.005265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:12.005265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:12.005265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:12.005265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:12.005265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:12.005265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:12.005265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:12.005265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:12:12.005265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:12.005871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 110/220] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:12:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:12.011901 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca06e8-553f-495a-8bc8-b5c1d620c6a5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:12.060995 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:12.117444 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bea5f-851e-4e33-973f-13f250c924ae None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:12.139907 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca06e8-553f-495a-8bc8-b5c1d620c6a5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:12.169286 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61044e63-85c5-4460-8efd-d1c0ab3f9568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:12.169903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61044e63-85c5-4460-8efd-d1c0ab3f9568 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:12.170328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61044e63-85c5-4460-8efd-d1c0ab3f9568 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:12.170430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61044e63-85c5-4460-8efd-d1c0ab3f9568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:12.180533 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:12.188291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0950f0c-9861-4ade-96df-743dc4ad295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:12.189170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0950f0c-9861-4ade-96df-743dc4ad295c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:12.189565 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0950f0c-9861-4ade-96df-743dc4ad295c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:12.189851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0950f0c-9861-4ade-96df-743dc4ad295c None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:12.190530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0950f0c-9861-4ade-96df-743dc4ad295c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:12.190832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0950f0c-9861-4ade-96df-743dc4ad295c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:12.192412 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0950f0c-9861-4ade-96df-743dc4ad295c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:12.203466 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 111/221] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:12.205396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cf319-f3fb-42c4-8ea2-73036d392005 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:12.205681 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cf319-f3fb-42c4-8ea2-73036d392005 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:12.205954 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cf319-f3fb-42c4-8ea2-73036d392005 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:12.207349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 112/222] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:12.212716 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cf319-f3fb-42c4-8ea2-73036d392005 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:12.256811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61044e63-85c5-4460-8efd-d1c0ab3f9568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:12.258408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61044e63-85c5-4460-8efd-d1c0ab3f9568 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:12.352508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cf319-f3fb-42c4-8ea2-73036d392005 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:12.354962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:12.375110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 111/223] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 16:12:12.376520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d2b13-e1a7-40ef-bcec-02a66ca06345 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:12.376831 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d2b13-e1a7-40ef-bcec-02a66ca06345 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:12.377098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d2b13-e1a7-40ef-bcec-02a66ca06345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:12.395047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-240d2b13-e1a7-40ef-bcec-02a66ca06345 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:12.396278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-240d2b13-e1a7-40ef-bcec-02a66ca06345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:12.399059 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3fae6-bd2d-449f-951f-1078cbc753e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:12.400888 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3fae6-bd2d-449f-951f-1078cbc753e9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:12.401397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3fae6-bd2d-449f-951f-1078cbc753e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:12.401867 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3fae6-bd2d-449f-951f-1078cbc753e9 None admin] PATH_INFO: `/v3/users/2028f2f4cd7b4ce7945f099fee29e813` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:12.403250 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3fae6-bd2d-449f-951f-1078cbc753e9 None admin] RBAC: Authorizing `identity:get_user(user_id=2028f2f4cd7b4ce7945f099fee29e813)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:12.405101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3fae6-bd2d-449f-951f-1078cbc753e9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:12.408643 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 113/224] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:12 2022] GET /identity/v3/users/2028f2f4cd7b4ce7945f099fee29e813 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:12.410044 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3fae6-bd2d-449f-951f-1078cbc753e9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:12.440381 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:12.494893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 112/225] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:12.495832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d2b13-e1a7-40ef-bcec-02a66ca06345 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:12.546226 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3fae6-bd2d-449f-951f-1078cbc753e9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:12.590544 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293057-f826-4690-9958-5edd3243f83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:12.591875 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293057-f826-4690-9958-5edd3243f83d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:12.592357 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293057-f826-4690-9958-5edd3243f83d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:12.592837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293057-f826-4690-9958-5edd3243f83d None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:12.594633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb293057-f826-4690-9958-5edd3243f83d None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:12.596562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb293057-f826-4690-9958-5edd3243f83d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:12.599399 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 114/226] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:12 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:12.601158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293057-f826-4690-9958-5edd3243f83d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:12.607733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d2b13-e1a7-40ef-bcec-02a66ca06345 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:12.644505 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc337bd-3e0e-413f-8921-8193510f2b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:12.645405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc337bd-3e0e-413f-8921-8193510f2b00 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:12.645817 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc337bd-3e0e-413f-8921-8193510f2b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:12.646246 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc337bd-3e0e-413f-8921-8193510f2b00 None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:12.647513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc337bd-3e0e-413f-8921-8193510f2b00 None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:12.649507 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc337bd-3e0e-413f-8921-8193510f2b00 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:12.651065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 113/227] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:12 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:12.651886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc337bd-3e0e-413f-8921-8193510f2b00 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:12.654992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:12.690638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:12.736331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293057-f826-4690-9958-5edd3243f83d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:12.774116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc337bd-3e0e-413f-8921-8193510f2b00 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:12.780233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f19230-102b-4cee-aca4-e5ce73144852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:12.781147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f19230-102b-4cee-aca4-e5ce73144852 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:12.781607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f19230-102b-4cee-aca4-e5ce73144852 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:12.782597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f19230-102b-4cee-aca4-e5ce73144852 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:12.796714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f19230-102b-4cee-aca4-e5ce73144852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-16f19230-102b-4cee-aca4-e5ce73144852 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:12.802583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:12.803973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:12.804771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:12.804771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:12.804771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:12.804771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:12.804771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:12.804771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:12.804771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:12.804771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:12.804771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:12.804771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:12.804771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:12.804771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:12.807228 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 115/228] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:12:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:12.808210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f19230-102b-4cee-aca4-e5ce73144852 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:12.811506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a459cb-174e-4532-8f41-aa72568ff591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:12.812192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a459cb-174e-4532-8f41-aa72568ff591 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:12.812470 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a459cb-174e-4532-8f41-aa72568ff591 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:12.812793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a459cb-174e-4532-8f41-aa72568ff591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:12.814002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a459cb-174e-4532-8f41-aa72568ff591 None admin] RBAC: Adding query filter params (role.id=87abba8d76c2420c97d9d5f2dbb6b540, scope.project.id=75c18326de4348a5851e485deb998c36, user.id=c1ddfff3440b44a287643061ef76f6a7) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:12.814002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a459cb-174e-4532-8f41-aa72568ff591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:12.815280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a459cb-174e-4532-8f41-aa72568ff591 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:12.821877 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 114/229] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:12 2022] GET /identity/v3/role_assignments?user.id=c1ddfff3440b44a287643061ef76f6a7&scope.project.id=75c18326de4348a5851e485deb998c36&role.id=87abba8d76c2420c97d9d5f2dbb6b540 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:12.822826 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a459cb-174e-4532-8f41-aa72568ff591 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:12.921304 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:12.925881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f19230-102b-4cee-aca4-e5ce73144852 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:12.928890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:12.932420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a459cb-174e-4532-8f41-aa72568ff591 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:12.968773 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e12aee-ae11-4b82-b604-4c96e962747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:12.969290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e70df-3d67-4f2c-9d68-9f72fa7abf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:12.969896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e70df-3d67-4f2c-9d68-9f72fa7abf70 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:12.970030 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e12aee-ae11-4b82-b604-4c96e962747d None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:12.970168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e70df-3d67-4f2c-9d68-9f72fa7abf70 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:12.970501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e70df-3d67-4f2c-9d68-9f72fa7abf70 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:12.970706 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e12aee-ae11-4b82-b604-4c96e962747d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:12.971120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e12aee-ae11-4b82-b604-4c96e962747d None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36/users/2028f2f4cd7b4ce7945f099fee29e813/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:12.971240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e70df-3d67-4f2c-9d68-9f72fa7abf70 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:12.971452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e70df-3d67-4f2c-9d68-9f72fa7abf70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:12.972920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e70df-3d67-4f2c-9d68-9f72fa7abf70 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:12.973677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e12aee-ae11-4b82-b604-4c96e962747d None admin] RBAC: Authorizing `identity:create_grant(project_id=75c18326de4348a5851e485deb998c36, user_id=2028f2f4cd7b4ce7945f099fee29e813, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:12.975676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e12aee-ae11-4b82-b604-4c96e962747d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:12.982665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 115/230] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:12.991205 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e70df-3d67-4f2c-9d68-9f72fa7abf70 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:13.002797 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 116/231] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:12:12 2022] PUT /identity/v3/projects/75c18326de4348a5851e485deb998c36/users/2028f2f4cd7b4ce7945f099fee29e813/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:13.134077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e70df-3d67-4f2c-9d68-9f72fa7abf70 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:13.171772 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05dcff-c020-4cc4-8f47-4d087b10e067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:13.172735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05dcff-c020-4cc4-8f47-4d087b10e067 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:13.173161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05dcff-c020-4cc4-8f47-4d087b10e067 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:13.173576 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05dcff-c020-4cc4-8f47-4d087b10e067 None admin] PATH_INFO: `/v3/users/2028f2f4cd7b4ce7945f099fee29e813` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:13.174977 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05dcff-c020-4cc4-8f47-4d087b10e067 None admin] RBAC: Authorizing `identity:get_user(user_id=2028f2f4cd7b4ce7945f099fee29e813)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:13.176657 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05dcff-c020-4cc4-8f47-4d087b10e067 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:13.179433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 116/232] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:12 2022] GET /identity/v3/users/2028f2f4cd7b4ce7945f099fee29e813 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:13.184754 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e12aee-ae11-4b82-b604-4c96e962747d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:13.300785 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e12aee-ae11-4b82-b604-4c96e962747d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:13.342906 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fad86-aca8-4a92-9ab5-9165536752c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:13.343538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fad86-aca8-4a92-9ab5-9165536752c1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:13.343817 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fad86-aca8-4a92-9ab5-9165536752c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:13.344088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fad86-aca8-4a92-9ab5-9165536752c1 None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:13.345232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fad86-aca8-4a92-9ab5-9165536752c1 None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:13.346681 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fad86-aca8-4a92-9ab5-9165536752c1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:13.348649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 117/233] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:13 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:13.354696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05dcff-c020-4cc4-8f47-4d087b10e067 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:13.436967 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:13.494935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05dcff-c020-4cc4-8f47-4d087b10e067 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:13.529735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb99d7-b31a-46f9-936c-108766cee968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:13.530456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb99d7-b31a-46f9-936c-108766cee968 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:13.530741 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb99d7-b31a-46f9-936c-108766cee968 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:13.531012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb99d7-b31a-46f9-936c-108766cee968 None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36/users/2028f2f4cd7b4ce7945f099fee29e813/roles/a507b36f2493428fbb8fcdc4fbad6911` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:13.533234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb99d7-b31a-46f9-936c-108766cee968 None admin] RBAC: Authorizing `identity:create_grant(project_id=75c18326de4348a5851e485deb998c36, user_id=2028f2f4cd7b4ce7945f099fee29e813, role_id=a507b36f2493428fbb8fcdc4fbad6911)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:13.534796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb99d7-b31a-46f9-936c-108766cee968 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:13.563530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 117/234] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:12:13 2022] PUT /identity/v3/projects/75c18326de4348a5851e485deb998c36/users/2028f2f4cd7b4ce7945f099fee29e813/roles/a507b36f2493428fbb8fcdc4fbad6911 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:14.323537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec86b29-a3d2-4e91-b1a4-d2f96232d492 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:14.324052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec86b29-a3d2-4e91-b1a4-d2f96232d492 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:14.324125 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec86b29-a3d2-4e91-b1a4-d2f96232d492 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:14.325692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 118/235] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:14.331018 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0c46a-01cf-4c4d-98e6-3c0c82bee934 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:14.331303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0c46a-01cf-4c4d-98e6-3c0c82bee934 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:14.331573 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0c46a-01cf-4c4d-98e6-3c0c82bee934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:14.357515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f7b0c46a-01cf-4c4d-98e6-3c0c82bee934 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:14.358691 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f7b0c46a-01cf-4c4d-98e6-3c0c82bee934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:14.453307 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 118/236] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:14.496045 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec86b29-a3d2-4e91-b1a4-d2f96232d492 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:14.499860 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9aef3-d855-4c1b-8191-83ccc5188717 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:14.500360 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9aef3-d855-4c1b-8191-83ccc5188717 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:14.500888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9aef3-d855-4c1b-8191-83ccc5188717 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:14.502696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 119/237] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:12:14.508487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ca871-1285-4d78-826e-7a31d4ed050b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:14.509050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ca871-1285-4d78-826e-7a31d4ed050b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:14.509513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ca871-1285-4d78-826e-7a31d4ed050b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:14.544994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-324ca871-1285-4d78-826e-7a31d4ed050b None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:14.548724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-324ca871-1285-4d78-826e-7a31d4ed050b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:14.555334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:14.575062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:14.651842 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 120/238] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:14.688152 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ca871-1285-4d78-826e-7a31d4ed050b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:14.696737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec86b29-a3d2-4e91-b1a4-d2f96232d492 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:14.760842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c369dc3-3ebe-4b9e-8900-d03a7e83b9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:14.761838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c369dc3-3ebe-4b9e-8900-d03a7e83b9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:14.762306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c369dc3-3ebe-4b9e-8900-d03a7e83b9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:14.762867 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c369dc3-3ebe-4b9e-8900-d03a7e83b9d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:14.764158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c369dc3-3ebe-4b9e-8900-d03a7e83b9d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:14.765815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c369dc3-3ebe-4b9e-8900-d03a7e83b9d4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:14.767573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 119/239] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:14.775858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c369dc3-3ebe-4b9e-8900-d03a7e83b9d4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:14.876424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:14.886198 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c369dc3-3ebe-4b9e-8900-d03a7e83b9d4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:14.934603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ca871-1285-4d78-826e-7a31d4ed050b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:14.937408 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81766556-908b-4e7c-8aa1-899d079a8d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:14.938297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766556-908b-4e7c-8aa1-899d079a8d3f None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:14.938763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766556-908b-4e7c-8aa1-899d079a8d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:14.939244 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766556-908b-4e7c-8aa1-899d079a8d3f None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:14.940096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81766556-908b-4e7c-8aa1-899d079a8d3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:14.948550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81766556-908b-4e7c-8aa1-899d079a8d3f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:14.993385 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 120/240] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:12:14 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:12:15.008750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c94a6-b1f8-47c3-9388-d1b8e997d6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:15.009821 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c94a6-b1f8-47c3-9388-d1b8e997d6df None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:15.010296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c94a6-b1f8-47c3-9388-d1b8e997d6df None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:15.010757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c94a6-b1f8-47c3-9388-d1b8e997d6df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:15.028204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c94a6-b1f8-47c3-9388-d1b8e997d6df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c19c94a6-b1f8-47c3-9388-d1b8e997d6df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:15.033750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:15.034667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:15.035433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:15.035433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:15.035433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:15.035433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:15.035433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:15.035433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:15.035433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:15.035433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:15.035433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:15.035433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:15.035433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:15.035433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:15.042091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 121/241] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:12:15.049079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81766556-908b-4e7c-8aa1-899d079a8d3f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:15.178484 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81766556-908b-4e7c-8aa1-899d079a8d3f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:15.213584 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4ace5-5347-436a-9301-a488ada2edc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:15.214578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4ace5-5347-436a-9301-a488ada2edc9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:15.215047 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4ace5-5347-436a-9301-a488ada2edc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:15.215563 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4ace5-5347-436a-9301-a488ada2edc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:15.216407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4ace5-5347-436a-9301-a488ada2edc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:15.216922 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4ace5-5347-436a-9301-a488ada2edc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:15.218490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4ace5-5347-436a-9301-a488ada2edc9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:15.232685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 121/242] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:15.234455 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c94a6-b1f8-47c3-9388-d1b8e997d6df None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:15.248529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:15.340236 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c94a6-b1f8-47c3-9388-d1b8e997d6df None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:15.376724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58915c-939f-4626-891c-6d563cce3c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:15.377750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58915c-939f-4626-891c-6d563cce3c9c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:15.378219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58915c-939f-4626-891c-6d563cce3c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:15.378680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58915c-939f-4626-891c-6d563cce3c9c None admin] PATH_INFO: `/v3/users/0503c76a6cf54ebd929504d269640f46` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:15.392842 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58915c-939f-4626-891c-6d563cce3c9c None admin] RBAC: Authorizing `identity:get_user(user_id=0503c76a6cf54ebd929504d269640f46)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:15.394591 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58915c-939f-4626-891c-6d563cce3c9c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:15.396479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 122/243] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:15 2022] GET /identity/v3/users/0503c76a6cf54ebd929504d269640f46 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:15.402326 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4ace5-5347-436a-9301-a488ada2edc9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:15.420348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:15.495483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4eaae7-6186-4e2b-a1e9-6531fe550db1 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:15.495971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4eaae7-6186-4e2b-a1e9-6531fe550db1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:15.496068 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4eaae7-6186-4e2b-a1e9-6531fe550db1 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:15.497653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 123/244] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:15.504533 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ade27-0964-483a-afde-bdf52d022b11 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:15.504844 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ade27-0964-483a-afde-bdf52d022b11 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:15.505121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ade27-0964-483a-afde-bdf52d022b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:15.528747 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f92ade27-0964-483a-afde-bdf52d022b11 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:15.529965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f92ade27-0964-483a-afde-bdf52d022b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:15.534991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4ace5-5347-436a-9301-a488ada2edc9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:15.582632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a35680-a2ad-4a3d-86ac-192122c47812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:15.583253 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a35680-a2ad-4a3d-86ac-192122c47812 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:15.583532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a35680-a2ad-4a3d-86ac-192122c47812 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:15.583808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a35680-a2ad-4a3d-86ac-192122c47812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:15.610269 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:15.617328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 124/245] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:15.618600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc1ce8-b3bb-4686-b463-0c3a03d4a7df None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:15.618885 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc1ce8-b3bb-4686-b463-0c3a03d4a7df None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:15.619156 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc1ce8-b3bb-4686-b463-0c3a03d4a7df None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:15.620712 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 125/246] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:15.626755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029d68f-dce1-498b-b2cd-a0d8b7540441 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:15.627204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029d68f-dce1-498b-b2cd-a0d8b7540441 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:15.627481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029d68f-dce1-498b-b2cd-a0d8b7540441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:15.651395 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3029d68f-dce1-498b-b2cd-a0d8b7540441 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:15.652887 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3029d68f-dce1-498b-b2cd-a0d8b7540441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:15.680531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a35680-a2ad-4a3d-86ac-192122c47812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:15.683097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a35680-a2ad-4a3d-86ac-192122c47812 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:15.706153 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:15.733550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 126/247] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:15.734114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029d68f-dce1-498b-b2cd-a0d8b7540441 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:15.834305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 122/248] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:15.835260 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a35680-a2ad-4a3d-86ac-192122c47812 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:15.868771 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029d68f-dce1-498b-b2cd-a0d8b7540441 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:15.896993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:15.905321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80312cab-6f64-491d-ac04-0d5a0d7bc798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:15.905957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80312cab-6f64-491d-ac04-0d5a0d7bc798 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:15.906234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80312cab-6f64-491d-ac04-0d5a0d7bc798 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:15.906504 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80312cab-6f64-491d-ac04-0d5a0d7bc798 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:15.919524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80312cab-6f64-491d-ac04-0d5a0d7bc798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-80312cab-6f64-491d-ac04-0d5a0d7bc798 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:15.924674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:15.925551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:15.926733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:15.926733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:15.926733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:15.926733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:15.926733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:15.926733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:15.926733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:15.926733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:15.926733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:15.926733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:15.926733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:15.926733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:15.926733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 127/249] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:15.927388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80312cab-6f64-491d-ac04-0d5a0d7bc798 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:15.988989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a35680-a2ad-4a3d-86ac-192122c47812 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:16.004631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:16.027781 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d3934-359c-4d89-8c83-175769486d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:16.028415 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d3934-359c-4d89-8c83-175769486d25 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:16.028736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d3934-359c-4d89-8c83-175769486d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:16.029008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d3934-359c-4d89-8c83-175769486d25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:16.049530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d3934-359c-4d89-8c83-175769486d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6e3d3934-359c-4d89-8c83-175769486d25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:16.055953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:16.056828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:16.058014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:16.058014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:16.058014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:16.058014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:16.058014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:16.058014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:16.058014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:16.058014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:16.058014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:16.058014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:16.058014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:12:16.058014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:16.058014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 123/250] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:12:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:16.058014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d3934-359c-4d89-8c83-175769486d25 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:16.125940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80312cab-6f64-491d-ac04-0d5a0d7bc798 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:16.171350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16ef84-9c1e-4d45-bfbf-447532dc3b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:16.172683 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16ef84-9c1e-4d45-bfbf-447532dc3b14 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:16.173161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16ef84-9c1e-4d45-bfbf-447532dc3b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:16.173765 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16ef84-9c1e-4d45-bfbf-447532dc3b14 None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:16.175899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16ef84-9c1e-4d45-bfbf-447532dc3b14 None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:16.177622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16ef84-9c1e-4d45-bfbf-447532dc3b14 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:16.179942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 128/251] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:15 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:16.181588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16ef84-9c1e-4d45-bfbf-447532dc3b14 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:16.213346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d3934-359c-4d89-8c83-175769486d25 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:16.249685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a035492-6f87-4a2f-b7ac-b337896811da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:16.250215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a035492-6f87-4a2f-b7ac-b337896811da None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:16.250493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a035492-6f87-4a2f-b7ac-b337896811da None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:16.250767 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a035492-6f87-4a2f-b7ac-b337896811da None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:16.251436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a035492-6f87-4a2f-b7ac-b337896811da None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:16.251739 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a035492-6f87-4a2f-b7ac-b337896811da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:16.253178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a035492-6f87-4a2f-b7ac-b337896811da None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:16.263457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:16.269049 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 124/252] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:16.272825 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434a3d3-bcd3-4b22-80fb-09d152679af5 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:16.272825 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434a3d3-bcd3-4b22-80fb-09d152679af5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:16.272825 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434a3d3-bcd3-4b22-80fb-09d152679af5 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:16.273404 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 125/253] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:16.274328 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434a3d3-bcd3-4b22-80fb-09d152679af5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:16.314004 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:16.315605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16ef84-9c1e-4d45-bfbf-447532dc3b14 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:16.353360 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280577d-6061-4478-a042-4b93836d66c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:16.354315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280577d-6061-4478-a042-4b93836d66c1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:16.354790 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280577d-6061-4478-a042-4b93836d66c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:16.355273 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280577d-6061-4478-a042-4b93836d66c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:16.356128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280577d-6061-4478-a042-4b93836d66c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:16.356688 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280577d-6061-4478-a042-4b93836d66c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:16.358254 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280577d-6061-4478-a042-4b93836d66c1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:16.366977 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 129/254] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:16.368470 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c4c23-c31f-4cd7-83a5-2ed7b43fa0d4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:16.368972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c4c23-c31f-4cd7-83a5-2ed7b43fa0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:16.369458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c4c23-c31f-4cd7-83a5-2ed7b43fa0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:16.387528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-598c4c23-c31f-4cd7-83a5-2ed7b43fa0d4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:16.389027 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-598c4c23-c31f-4cd7-83a5-2ed7b43fa0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:16.395437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434a3d3-bcd3-4b22-80fb-09d152679af5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:16.434193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23f8a3-c172-40dd-92cd-834235222e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:16.434834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23f8a3-c172-40dd-92cd-834235222e40 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:16.435106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23f8a3-c172-40dd-92cd-834235222e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:16.435376 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23f8a3-c172-40dd-92cd-834235222e40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:16.436277 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23f8a3-c172-40dd-92cd-834235222e40 None admin] RBAC: Adding query filter params (role.id=3b85296a2d114d309360453dd73a3c22, scope.project.id=75c18326de4348a5851e485deb998c36, user.id=0503c76a6cf54ebd929504d269640f46) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:16.436509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23f8a3-c172-40dd-92cd-834235222e40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:16.438194 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23f8a3-c172-40dd-92cd-834235222e40 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:16.445283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 126/255] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:16 2022] GET /identity/v3/role_assignments?user.id=0503c76a6cf54ebd929504d269640f46&scope.project.id=75c18326de4348a5851e485deb998c36&role.id=3b85296a2d114d309360453dd73a3c22 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:16.445918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23f8a3-c172-40dd-92cd-834235222e40 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:16.462768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 130/256] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:16.463933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c4c23-c31f-4cd7-83a5-2ed7b43fa0d4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:16.523835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:16.557722 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:16.562209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23f8a3-c172-40dd-92cd-834235222e40 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:16.590566 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c4c23-c31f-4cd7-83a5-2ed7b43fa0d4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:16.599480 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc8a02-a219-4aa3-8914-547f35f1c6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:16.600111 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc8a02-a219-4aa3-8914-547f35f1c6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:16.600385 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc8a02-a219-4aa3-8914-547f35f1c6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:16.600705 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc8a02-a219-4aa3-8914-547f35f1c6a2 None admin] PATH_INFO: `/v3/users/c1ddfff3440b44a287643061ef76f6a7` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:16.601896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc8a02-a219-4aa3-8914-547f35f1c6a2 None admin] RBAC: Authorizing `identity:get_user(user_id=c1ddfff3440b44a287643061ef76f6a7)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:16.603328 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc8a02-a219-4aa3-8914-547f35f1c6a2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:16.605177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 127/257] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:16 2022] GET /identity/v3/users/c1ddfff3440b44a287643061ef76f6a7 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:16.605939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc8a02-a219-4aa3-8914-547f35f1c6a2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:16.632961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e904a75-1e7b-4641-a56b-7a2373ce826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:16.633632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e904a75-1e7b-4641-a56b-7a2373ce826e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:16.633913 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e904a75-1e7b-4641-a56b-7a2373ce826e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:16.634185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e904a75-1e7b-4641-a56b-7a2373ce826e None admin] PATH_INFO: `/v3/users/2028f2f4cd7b4ce7945f099fee29e813` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:16.635356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e904a75-1e7b-4641-a56b-7a2373ce826e None admin] RBAC: Authorizing `identity:get_user(user_id=2028f2f4cd7b4ce7945f099fee29e813)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:16.636869 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e904a75-1e7b-4641-a56b-7a2373ce826e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:16.638509 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 131/258] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:16 2022] GET /identity/v3/users/2028f2f4cd7b4ce7945f099fee29e813 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:16.639295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e904a75-1e7b-4641-a56b-7a2373ce826e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:16.764740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc8a02-a219-4aa3-8914-547f35f1c6a2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:16.784922 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e904a75-1e7b-4641-a56b-7a2373ce826e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:16.820963 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:16.827166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395ff97-891c-4f03-9926-c23e2c1e1c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:16.827794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395ff97-891c-4f03-9926-c23e2c1e1c8d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:16.828068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395ff97-891c-4f03-9926-c23e2c1e1c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:16.828335 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395ff97-891c-4f03-9926-c23e2c1e1c8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:16.845552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791bcf5-e49b-4e09-8e3d-f1627e81924c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:16.846184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791bcf5-e49b-4e09-8e3d-f1627e81924c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:16.846465 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791bcf5-e49b-4e09-8e3d-f1627e81924c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:16.846731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791bcf5-e49b-4e09-8e3d-f1627e81924c None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:16.848063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791bcf5-e49b-4e09-8e3d-f1627e81924c None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:16.850049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791bcf5-e49b-4e09-8e3d-f1627e81924c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:16.851667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 132/259] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:16 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:16.852426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791bcf5-e49b-4e09-8e3d-f1627e81924c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:16.853196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395ff97-891c-4f03-9926-c23e2c1e1c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e395ff97-891c-4f03-9926-c23e2c1e1c8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:16.858665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:16.859534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:16.860317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:16.860317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:16.860317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:16.860317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:16.860317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:16.860317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:16.860317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:16.860317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:16.860317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:16.860317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:16.860317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:16.860317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:16.860317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 128/260] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:12:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:16.861063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395ff97-891c-4f03-9926-c23e2c1e1c8d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:16.909734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:17.024859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395ff97-891c-4f03-9926-c23e2c1e1c8d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:17.057305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791bcf5-e49b-4e09-8e3d-f1627e81924c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:17.084100 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26a58b-3d2f-4db4-bad0-57a248f6600b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:17.085842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26a58b-3d2f-4db4-bad0-57a248f6600b None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:17.087065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26a58b-3d2f-4db4-bad0-57a248f6600b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:17.087341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26a58b-3d2f-4db4-bad0-57a248f6600b None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36/users/c1ddfff3440b44a287643061ef76f6a7/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:17.090000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26a58b-3d2f-4db4-bad0-57a248f6600b None admin] RBAC: Authorizing `identity:create_grant(project_id=75c18326de4348a5851e485deb998c36, user_id=c1ddfff3440b44a287643061ef76f6a7, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:17.091485 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26a58b-3d2f-4db4-bad0-57a248f6600b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:17.106247 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d052e-f67d-4cad-ba09-860e09d55e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:17.106859 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d052e-f67d-4cad-ba09-860e09d55e24 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:17.107133 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d052e-f67d-4cad-ba09-860e09d55e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:17.107399 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d052e-f67d-4cad-ba09-860e09d55e24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:17.114263 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 129/261] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:12:16 2022] PUT /identity/v3/projects/75c18326de4348a5851e485deb998c36/users/c1ddfff3440b44a287643061ef76f6a7/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:17.125592 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26a58b-3d2f-4db4-bad0-57a248f6600b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:17.165777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:17.183845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d052e-f67d-4cad-ba09-860e09d55e24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:17.185353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d052e-f67d-4cad-ba09-860e09d55e24 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:17.304102 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 133/262] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:17.309004 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:17.311591 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d052e-f67d-4cad-ba09-860e09d55e24 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:17.339596 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26a58b-3d2f-4db4-bad0-57a248f6600b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:17.395253 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93181780-5e9f-4838-9329-11d2e7b70100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:17.396846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93181780-5e9f-4838-9329-11d2e7b70100 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:17.397324 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93181780-5e9f-4838-9329-11d2e7b70100 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:17.397809 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93181780-5e9f-4838-9329-11d2e7b70100 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:17.398736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93181780-5e9f-4838-9329-11d2e7b70100 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:17.399253 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93181780-5e9f-4838-9329-11d2e7b70100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:17.400860 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93181780-5e9f-4838-9329-11d2e7b70100 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:17.411504 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 130/263] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:17.417602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93181780-5e9f-4838-9329-11d2e7b70100 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:17.440935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:17.452808 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d052e-f67d-4cad-ba09-860e09d55e24 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:17.529491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cd40d-4ad8-49a7-ba8e-43146105d0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:17.530853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cd40d-4ad8-49a7-ba8e-43146105d0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:17.531294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cd40d-4ad8-49a7-ba8e-43146105d0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:17.531693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cd40d-4ad8-49a7-ba8e-43146105d0b7 None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:17.538768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cd40d-4ad8-49a7-ba8e-43146105d0b7 None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:17.540408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cd40d-4ad8-49a7-ba8e-43146105d0b7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:17.544307 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 134/264] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:17 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:17.549524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cd40d-4ad8-49a7-ba8e-43146105d0b7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:17.596158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93181780-5e9f-4838-9329-11d2e7b70100 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:17.671482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c591f-be72-4608-9f0d-bddda213ece1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:17.672359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c591f-be72-4608-9f0d-bddda213ece1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:17.672809 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c591f-be72-4608-9f0d-bddda213ece1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:17.673251 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c591f-be72-4608-9f0d-bddda213ece1 None admin] PATH_INFO: `/v3/users/2028f2f4cd7b4ce7945f099fee29e813` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:17.674939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c591f-be72-4608-9f0d-bddda213ece1 None admin] RBAC: Authorizing `identity:get_user(user_id=2028f2f4cd7b4ce7945f099fee29e813)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:17.676536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c591f-be72-4608-9f0d-bddda213ece1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:17.678356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 131/265] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:17 2022] GET /identity/v3/users/2028f2f4cd7b4ce7945f099fee29e813 => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:17.685302 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c591f-be72-4608-9f0d-bddda213ece1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:17.718483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:17.802761 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cd40d-4ad8-49a7-ba8e-43146105d0b7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:17.888511 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c591f-be72-4608-9f0d-bddda213ece1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:17.897662 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f024b-0ff2-405f-b640-89d7df3bf7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:17.898356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f024b-0ff2-405f-b640-89d7df3bf7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:17.898635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f024b-0ff2-405f-b640-89d7df3bf7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:17.898906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f024b-0ff2-405f-b640-89d7df3bf7a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:17.899644 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f024b-0ff2-405f-b640-89d7df3bf7a5 None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=75c18326de4348a5851e485deb998c36, user.id=2028f2f4cd7b4ce7945f099fee29e813) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:17.899949 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f024b-0ff2-405f-b640-89d7df3bf7a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:17.901480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f024b-0ff2-405f-b640-89d7df3bf7a5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:17.919437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 135/266] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:17 2022] GET /identity/v3/role_assignments?user.id=2028f2f4cd7b4ce7945f099fee29e813&scope.project.id=75c18326de4348a5851e485deb998c36&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 608 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:17.971141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad60a2d-1999-41b4-9141-c05dca57324d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:17.971773 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad60a2d-1999-41b4-9141-c05dca57324d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:17.972049 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad60a2d-1999-41b4-9141-c05dca57324d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:17.972319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad60a2d-1999-41b4-9141-c05dca57324d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:18.044856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e04193-5b8e-4232-a0a6-20ead4f2a79a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:18.045156 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e04193-5b8e-4232-a0a6-20ead4f2a79a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:18.045415 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e04193-5b8e-4232-a0a6-20ead4f2a79a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:18.048695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 136/267] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:18.054776 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f028a-e69c-4b33-8602-22c1e26a138c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:18.055150 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f028a-e69c-4b33-8602-22c1e26a138c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:18.055531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f028a-e69c-4b33-8602-22c1e26a138c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:18.088466 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad60a2d-1999-41b4-9141-c05dca57324d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:18.089867 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-de3f028a-e69c-4b33-8602-22c1e26a138c None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:18.090482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad60a2d-1999-41b4-9141-c05dca57324d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:18.091231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-de3f028a-e69c-4b33-8602-22c1e26a138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:18.108488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:18.125177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:18.188426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 137/268] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:18.212838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f028a-e69c-4b33-8602-22c1e26a138c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:18.308875 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 132/269] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:18.314473 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad60a2d-1999-41b4-9141-c05dca57324d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:18.373437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f028a-e69c-4b33-8602-22c1e26a138c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:18.411306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa339a0-c4b8-4460-9aca-d6a6fdb6e3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:18.412481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa339a0-c4b8-4460-9aca-d6a6fdb6e3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:18.412789 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa339a0-c4b8-4460-9aca-d6a6fdb6e3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:18.413058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa339a0-c4b8-4460-9aca-d6a6fdb6e3e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:18.425964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa339a0-c4b8-4460-9aca-d6a6fdb6e3e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-eaa339a0-c4b8-4460-9aca-d6a6fdb6e3e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:18.431451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:18.432337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:18.433140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:18.433140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:18.433140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:18.433140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:18.433140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:18.433140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:18.433140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:18.433140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:18.433140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:18.433140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:18.433140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:18.433140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:18.433140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 138/270] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:12:18.443040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa339a0-c4b8-4460-9aca-d6a6fdb6e3e9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:18.460926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:18.491671 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad60a2d-1999-41b4-9141-c05dca57324d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:18.533689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cffd95-7d2b-45c8-b0ad-b862d72df648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:18.534663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cffd95-7d2b-45c8-b0ad-b862d72df648 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:18.535166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cffd95-7d2b-45c8-b0ad-b862d72df648 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:18.535645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cffd95-7d2b-45c8-b0ad-b862d72df648 None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:18.537531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cffd95-7d2b-45c8-b0ad-b862d72df648 None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:18.539158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cffd95-7d2b-45c8-b0ad-b862d72df648 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:18.541398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 133/271] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:18 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:18.542743 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bee61-0995-4d0e-90bf-1f47fcfe4cb1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:18.543214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bee61-0995-4d0e-90bf-1f47fcfe4cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:18.543672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bee61-0995-4d0e-90bf-1f47fcfe4cb1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:18.545338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 134/272] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:18.547257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bee61-0995-4d0e-90bf-1f47fcfe4cb1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:18.553328 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:18.602547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa339a0-c4b8-4460-9aca-d6a6fdb6e3e9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:18.640998 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e2245-f52b-4189-a36b-6a1152b64cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:18.641837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2245-f52b-4189-a36b-6a1152b64cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:18.642316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2245-f52b-4189-a36b-6a1152b64cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:18.642832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2245-f52b-4189-a36b-6a1152b64cd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:18.643712 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e2245-f52b-4189-a36b-6a1152b64cd2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:18.644191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e2245-f52b-4189-a36b-6a1152b64cd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:18.645681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e2245-f52b-4189-a36b-6a1152b64cd2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:18.654851 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 139/273] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:18.656392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb143-f2c8-4bc7-a15f-80494651901c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:18.656920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb143-f2c8-4bc7-a15f-80494651901c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:18.657382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb143-f2c8-4bc7-a15f-80494651901c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:18.679826 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-26cdb143-f2c8-4bc7-a15f-80494651901c None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:18.681595 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-26cdb143-f2c8-4bc7-a15f-80494651901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:18.701905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bee61-0995-4d0e-90bf-1f47fcfe4cb1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:18.748662 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:18.752478 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3170a3-2fb8-4640-9ec1-6bb18b2fb167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:18.753244 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3170a3-2fb8-4640-9ec1-6bb18b2fb167 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:18.753528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3170a3-2fb8-4640-9ec1-6bb18b2fb167 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:18.754208 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3170a3-2fb8-4640-9ec1-6bb18b2fb167 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:18.755186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3170a3-2fb8-4640-9ec1-6bb18b2fb167 None admin] RBAC: Adding query filter params (role.id=a507b36f2493428fbb8fcdc4fbad6911, scope.project.id=75c18326de4348a5851e485deb998c36, user.id=2028f2f4cd7b4ce7945f099fee29e813) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:18.755494 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3170a3-2fb8-4640-9ec1-6bb18b2fb167 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:18.757053 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 140/274] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:18.757158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3170a3-2fb8-4640-9ec1-6bb18b2fb167 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:18.761605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdb143-f2c8-4bc7-a15f-80494651901c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:18.763902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 135/275] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:18 2022] GET /identity/v3/role_assignments?user.id=2028f2f4cd7b4ce7945f099fee29e813&scope.project.id=75c18326de4348a5851e485deb998c36&role.id=a507b36f2493428fbb8fcdc4fbad6911 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:18.799327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3170a3-2fb8-4640-9ec1-6bb18b2fb167 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:18.914088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:18.965231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdb143-f2c8-4bc7-a15f-80494651901c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:18.969893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3170a3-2fb8-4640-9ec1-6bb18b2fb167 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:19.015748 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788e7d5-c092-41dc-a4b1-35abf61eae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:19.016804 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788e7d5-c092-41dc-a4b1-35abf61eae64 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:19.017277 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788e7d5-c092-41dc-a4b1-35abf61eae64 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:19.017676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398149e-dab9-4cd6-b1d7-255ef36d0967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:19.017818 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788e7d5-c092-41dc-a4b1-35abf61eae64 None admin] PATH_INFO: `/v3/users/25c17d6474124a65959932cf71fc58e5` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:19.018293 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398149e-dab9-4cd6-b1d7-255ef36d0967 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:19.018566 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398149e-dab9-4cd6-b1d7-255ef36d0967 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:19.018832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398149e-dab9-4cd6-b1d7-255ef36d0967 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:19.019917 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398149e-dab9-4cd6-b1d7-255ef36d0967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:19.021900 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398149e-dab9-4cd6-b1d7-255ef36d0967 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:19.023811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 136/276] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:19.024968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a33a4-dda1-4bae-af8f-5cf3dc682e05 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:19.025231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a33a4-dda1-4bae-af8f-5cf3dc682e05 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:19.025495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a33a4-dda1-4bae-af8f-5cf3dc682e05 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:19.028662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 137/277] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:19.032818 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062696c0-1a6e-4556-bef2-2bee260c66f2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:19.033336 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062696c0-1a6e-4556-bef2-2bee260c66f2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:19.033616 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062696c0-1a6e-4556-bef2-2bee260c66f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:19.039801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788e7d5-c092-41dc-a4b1-35abf61eae64 None admin] RBAC: Authorizing `identity:get_user(user_id=25c17d6474124a65959932cf71fc58e5)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:19.041298 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788e7d5-c092-41dc-a4b1-35abf61eae64 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:19.044433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 141/278] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:18 2022] GET /identity/v3/users/25c17d6474124a65959932cf71fc58e5 => generated 293 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:19.045069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788e7d5-c092-41dc-a4b1-35abf61eae64 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:19.056842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-062696c0-1a6e-4556-bef2-2bee260c66f2 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:19.058724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-062696c0-1a6e-4556-bef2-2bee260c66f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:19.111456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:19.144613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 138/279] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:19.144613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062696c0-1a6e-4556-bef2-2bee260c66f2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:19.167893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788e7d5-c092-41dc-a4b1-35abf61eae64 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:19.191749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:19.202879 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd5a4a-f7c9-4f05-95aa-80cc5259c976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:19.203517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd5a4a-f7c9-4f05-95aa-80cc5259c976 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:19.203798 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd5a4a-f7c9-4f05-95aa-80cc5259c976 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:19.204069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd5a4a-f7c9-4f05-95aa-80cc5259c976 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:19.204743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd5a4a-f7c9-4f05-95aa-80cc5259c976 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:19.206173 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd5a4a-f7c9-4f05-95aa-80cc5259c976 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:19.236692 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 142/280] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:12:19 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:12:19.236692 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd5a4a-f7c9-4f05-95aa-80cc5259c976 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:19.278008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062696c0-1a6e-4556-bef2-2bee260c66f2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:19.334806 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587c553-3fde-4ef5-9ff4-01233bf74fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:19.335966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587c553-3fde-4ef5-9ff4-01233bf74fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:19.336247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587c553-3fde-4ef5-9ff4-01233bf74fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:19.337065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587c553-3fde-4ef5-9ff4-01233bf74fb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:19.338121 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587c553-3fde-4ef5-9ff4-01233bf74fb0 None admin] RBAC: Adding query filter params (role.id=87abba8d76c2420c97d9d5f2dbb6b540, user.id=25c17d6474124a65959932cf71fc58e5, scope.system=all) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:19.338445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587c553-3fde-4ef5-9ff4-01233bf74fb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:19.340164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587c553-3fde-4ef5-9ff4-01233bf74fb0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:19.347935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 139/281] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Aug 11 16:12:19 2022] GET /identity/v3/role_assignments?user.id=25c17d6474124a65959932cf71fc58e5&scope.system=all&role.id=87abba8d76c2420c97d9d5f2dbb6b540 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:19.368536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd5a4a-f7c9-4f05-95aa-80cc5259c976 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:19.386432 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:19.417602 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcf5e6-04f7-48a1-b519-051ba5b2b845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:19.418610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcf5e6-04f7-48a1-b519-051ba5b2b845 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:19.419346 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcf5e6-04f7-48a1-b519-051ba5b2b845 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:19.419834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcf5e6-04f7-48a1-b519-051ba5b2b845 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:19.433826 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcf5e6-04f7-48a1-b519-051ba5b2b845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e3dcf5e6-04f7-48a1-b519-051ba5b2b845 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:19.439600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:19.440546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:19.441629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:19.441629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:19.441629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:19.441629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:19.441629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:19.441629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:19.441629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:19.441629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:19.441629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:19.441629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:19.441629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:19.441629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:19.441629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 143/282] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:19.449179 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587c553-3fde-4ef5-9ff4-01233bf74fb0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:19.568019 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587c553-3fde-4ef5-9ff4-01233bf74fb0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:19.580393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:19.606750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514ce74-c2da-44d5-b588-5523852bdf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:19.607355 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514ce74-c2da-44d5-b588-5523852bdf0c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:19.607630 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514ce74-c2da-44d5-b588-5523852bdf0c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:19.607896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514ce74-c2da-44d5-b588-5523852bdf0c None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:19.608558 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514ce74-c2da-44d5-b588-5523852bdf0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:19.608882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514ce74-c2da-44d5-b588-5523852bdf0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:19.610239 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514ce74-c2da-44d5-b588-5523852bdf0c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:19.620029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 140/283] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:19.626249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcf5e6-04f7-48a1-b519-051ba5b2b845 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:19.650806 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc0b42-789d-43f2-bab2-b4a4d04cc609 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:19.651365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc0b42-789d-43f2-bab2-b4a4d04cc609 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:19.652335 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc0b42-789d-43f2-bab2-b4a4d04cc609 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:19.653869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 141/284] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:12:19.659613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfc29d-c320-4181-ae98-37867b447c08 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:19.659896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfc29d-c320-4181-ae98-37867b447c08 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:19.660167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfc29d-c320-4181-ae98-37867b447c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:19.681866 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8dbfc29d-c320-4181-ae98-37867b447c08 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:19.683052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8dbfc29d-c320-4181-ae98-37867b447c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:19.758539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcf5e6-04f7-48a1-b519-051ba5b2b845 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:19.758730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 142/285] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:19.782145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbfc29d-c320-4181-ae98-37867b447c08 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:19.794725 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e54094-e088-4b5d-a487-e214a099190e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:19.795824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e54094-e088-4b5d-a487-e214a099190e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:19.796104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e54094-e088-4b5d-a487-e214a099190e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:19.796379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e54094-e088-4b5d-a487-e214a099190e None admin] PATH_INFO: `/v3/users/0503c76a6cf54ebd929504d269640f46` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:19.798216 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e54094-e088-4b5d-a487-e214a099190e None admin] RBAC: Authorizing `identity:get_user(user_id=0503c76a6cf54ebd929504d269640f46)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:19.799920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e54094-e088-4b5d-a487-e214a099190e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:19.804684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 144/286] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:19 2022] GET /identity/v3/users/0503c76a6cf54ebd929504d269640f46 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:19.809189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e54094-e088-4b5d-a487-e214a099190e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:19.869267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:19.923857 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e54094-e088-4b5d-a487-e214a099190e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:19.940164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbfc29d-c320-4181-ae98-37867b447c08 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:19.944972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:19.966037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec8463-7c81-4ef2-8323-90c87a15bbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:19.966667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec8463-7c81-4ef2-8323-90c87a15bbbd None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:19.966942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec8463-7c81-4ef2-8323-90c87a15bbbd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:19.967210 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec8463-7c81-4ef2-8323-90c87a15bbbd None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:19.968480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec8463-7c81-4ef2-8323-90c87a15bbbd None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:19.969938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec8463-7c81-4ef2-8323-90c87a15bbbd None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:19.971557 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 145/287] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:19 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:19.978321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec8463-7c81-4ef2-8323-90c87a15bbbd None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:20.021878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e32e7-f5e3-48f7-bb50-341ca7ab4ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:20.022893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e32e7-f5e3-48f7-bb50-341ca7ab4ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:20.023414 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e32e7-f5e3-48f7-bb50-341ca7ab4ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:20.023902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e32e7-f5e3-48f7-bb50-341ca7ab4ea3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:20.057490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e32e7-f5e3-48f7-bb50-341ca7ab4ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-cc8e32e7-f5e3-48f7-bb50-341ca7ab4ea3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:20.062662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:20.063529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:20.064292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:20.064292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:20.064292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:20.064292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:20.064292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:20.064292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:20.064292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:20.064292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:20.064292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:20.064292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:20.064292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:20.064292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:20.074278 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 143/288] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:20.082288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e32e7-f5e3-48f7-bb50-341ca7ab4ea3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:20.085624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec8463-7c81-4ef2-8323-90c87a15bbbd None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:20.095233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:20.122445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed564f6-14d0-494f-84d0-b898dc38043b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:20.123026 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed564f6-14d0-494f-84d0-b898dc38043b None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:20.123302 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed564f6-14d0-494f-84d0-b898dc38043b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:20.123677 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed564f6-14d0-494f-84d0-b898dc38043b None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36/users/0503c76a6cf54ebd929504d269640f46/roles/3b85296a2d114d309360453dd73a3c22` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:20.125772 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed564f6-14d0-494f-84d0-b898dc38043b None admin] RBAC: Authorizing `identity:create_grant(project_id=75c18326de4348a5851e485deb998c36, user_id=0503c76a6cf54ebd929504d269640f46, role_id=3b85296a2d114d309360453dd73a3c22)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:20.127214 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed564f6-14d0-494f-84d0-b898dc38043b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:20.147883 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 146/289] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:12:19 2022] PUT /identity/v3/projects/75c18326de4348a5851e485deb998c36/users/0503c76a6cf54ebd929504d269640f46/roles/3b85296a2d114d309360453dd73a3c22 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:20.246589 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e32e7-f5e3-48f7-bb50-341ca7ab4ea3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:20.296119 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca1de6-ea3f-4c41-9f63-c1bccedbeb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:20.296793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca1de6-ea3f-4c41-9f63-c1bccedbeb6d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:20.297114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca1de6-ea3f-4c41-9f63-c1bccedbeb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:20.297418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca1de6-ea3f-4c41-9f63-c1bccedbeb6d None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:20.298140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca1de6-ea3f-4c41-9f63-c1bccedbeb6d None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:20.298462 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca1de6-ea3f-4c41-9f63-c1bccedbeb6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:20.299875 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca1de6-ea3f-4c41-9f63-c1bccedbeb6d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:20.313002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 144/290] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:20.319253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed564f6-14d0-494f-84d0-b898dc38043b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:20.437257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed564f6-14d0-494f-84d0-b898dc38043b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:20.475581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490caad8-aedf-4d74-9c33-ce2ee48bbbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:20.476218 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490caad8-aedf-4d74-9c33-ce2ee48bbbdb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:20.477026 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490caad8-aedf-4d74-9c33-ce2ee48bbbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:20.477026 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490caad8-aedf-4d74-9c33-ce2ee48bbbdb None admin] PATH_INFO: `/v3/users/c1ddfff3440b44a287643061ef76f6a7` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:20.481348 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490caad8-aedf-4d74-9c33-ce2ee48bbbdb None admin] RBAC: Authorizing `identity:get_user(user_id=c1ddfff3440b44a287643061ef76f6a7)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:20.482817 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490caad8-aedf-4d74-9c33-ce2ee48bbbdb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:20.484600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 147/291] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:20 2022] GET /identity/v3/users/c1ddfff3440b44a287643061ef76f6a7 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:20.490562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca1de6-ea3f-4c41-9f63-c1bccedbeb6d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:20.517468 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:20.621828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca1de6-ea3f-4c41-9f63-c1bccedbeb6d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:20.668580 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e9c0e-8fe7-4d34-b2db-650d7ad1c9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:20.669771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e9c0e-8fe7-4d34-b2db-650d7ad1c9af None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:20.670318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e9c0e-8fe7-4d34-b2db-650d7ad1c9af None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:20.670817 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e9c0e-8fe7-4d34-b2db-650d7ad1c9af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:20.772599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e9c0e-8fe7-4d34-b2db-650d7ad1c9af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:20.773992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e9c0e-8fe7-4d34-b2db-650d7ad1c9af None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:20.803519 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:20.898496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 145/292] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:20.903730 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490caad8-aedf-4d74-9c33-ce2ee48bbbdb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:20.964570 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:21.023024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490caad8-aedf-4d74-9c33-ce2ee48bbbdb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:21.061445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e1ad3-5b17-4ab7-a947-be86e4953942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:21.062545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e1ad3-5b17-4ab7-a947-be86e4953942 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:21.062876 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e1ad3-5b17-4ab7-a947-be86e4953942 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:21.063240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e1ad3-5b17-4ab7-a947-be86e4953942 None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:21.065719 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e1ad3-5b17-4ab7-a947-be86e4953942 None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:21.067432 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e1ad3-5b17-4ab7-a947-be86e4953942 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:21.069360 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 148/293] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:20 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:21.075348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e9c0e-8fe7-4d34-b2db-650d7ad1c9af None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:21.204339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e9c0e-8fe7-4d34-b2db-650d7ad1c9af None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:21.233751 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:21.250278 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ae4db-ef12-4226-b05f-8d6b10c29a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:21.250903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ae4db-ef12-4226-b05f-8d6b10c29a7e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:21.251216 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ae4db-ef12-4226-b05f-8d6b10c29a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:21.251579 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ae4db-ef12-4226-b05f-8d6b10c29a7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:21.252321 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ae4db-ef12-4226-b05f-8d6b10c29a7e None admin] RBAC: Adding query filter params (role.id=87abba8d76c2420c97d9d5f2dbb6b540, scope.project.id=75c18326de4348a5851e485deb998c36, user.id=c1ddfff3440b44a287643061ef76f6a7) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:21.252702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ae4db-ef12-4226-b05f-8d6b10c29a7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:21.254136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ae4db-ef12-4226-b05f-8d6b10c29a7e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:21.265442 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 146/294] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:21 2022] GET /identity/v3/role_assignments?user.id=c1ddfff3440b44a287643061ef76f6a7&scope.project.id=75c18326de4348a5851e485deb998c36&role.id=87abba8d76c2420c97d9d5f2dbb6b540 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:21.743473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad3f2d-5c3a-44d5-81aa-400958993b0b None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:21.743473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad3f2d-5c3a-44d5-81aa-400958993b0b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:21.743473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad3f2d-5c3a-44d5-81aa-400958993b0b None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:21.744335 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 149/295] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:21.753205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cb43b-22f2-449b-8a85-180c4038b469 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:21.753205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cb43b-22f2-449b-8a85-180c4038b469 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:21.753205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cb43b-22f2-449b-8a85-180c4038b469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:21.770585 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c68cb43b-22f2-449b-8a85-180c4038b469 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:21.772073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c68cb43b-22f2-449b-8a85-180c4038b469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:21.846223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 147/296] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:21.870194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad3f2d-5c3a-44d5-81aa-400958993b0b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:21.902141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5d3c5-3cfc-4bf3-a685-8237807b9cab None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:21.902735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5d3c5-3cfc-4bf3-a685-8237807b9cab None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:21.903196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5d3c5-3cfc-4bf3-a685-8237807b9cab None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:21.905002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 148/297] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:21.911125 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3803c8f-c7c7-48ea-8f4e-e359472381cd None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:21.911681 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3803c8f-c7c7-48ea-8f4e-e359472381cd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:21.912157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3803c8f-c7c7-48ea-8f4e-e359472381cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:21.937646 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e3803c8f-c7c7-48ea-8f4e-e359472381cd None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:21.939397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e3803c8f-c7c7-48ea-8f4e-e359472381cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:22.004824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad3f2d-5c3a-44d5-81aa-400958993b0b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:22.009952 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:22.038177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 149/298] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:22.048953 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc9b77-e6c2-43d2-8e69-b0ee213b336a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:22.049812 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc9b77-e6c2-43d2-8e69-b0ee213b336a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:22.050256 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc9b77-e6c2-43d2-8e69-b0ee213b336a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:22.050693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc9b77-e6c2-43d2-8e69-b0ee213b336a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:22.060815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3803c8f-c7c7-48ea-8f4e-e359472381cd None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:22.062797 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc9b77-e6c2-43d2-8e69-b0ee213b336a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-d3bc9b77-e6c2-43d2-8e69-b0ee213b336a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:22.068813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:22.069666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:22.070453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:22.070453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:22.070453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:22.070453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:22.070453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:22.070453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:22.070453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:22.070453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:22.070453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:22.070453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:22.070453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:22.070453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:22.073052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 150/299] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:22.079611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc9b77-e6c2-43d2-8e69-b0ee213b336a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:22.120837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:22.173248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3803c8f-c7c7-48ea-8f4e-e359472381cd None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:22.194669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc9b77-e6c2-43d2-8e69-b0ee213b336a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:22.208141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e88921-e011-43c1-ae07-53f71fea0cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:22.209047 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e88921-e011-43c1-ae07-53f71fea0cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:22.209318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e88921-e011-43c1-ae07-53f71fea0cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:22.209729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e88921-e011-43c1-ae07-53f71fea0cc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:22.221121 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e88921-e011-43c1-ae07-53f71fea0cc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-82e88921-e011-43c1-ae07-53f71fea0cc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:22.226487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:22.227534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:22.228503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:22.228503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:22.228503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:22.228503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:22.228503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:22.228503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:22.228503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:22.228503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:22.228503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:22.228503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:22.228503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:22.228503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:22.234360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 150/300] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:12:22.234360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4df57b-9938-4f1f-a1bc-814ba29fb253 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:22.234360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4df57b-9938-4f1f-a1bc-814ba29fb253 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:22.234360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4df57b-9938-4f1f-a1bc-814ba29fb253 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:22.234360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 151/301] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:22.236858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25671fc-8e07-4cb6-bb2e-aa836e7135e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:22.237657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4df57b-9938-4f1f-a1bc-814ba29fb253 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:22.237806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25671fc-8e07-4cb6-bb2e-aa836e7135e6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:22.237987 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25671fc-8e07-4cb6-bb2e-aa836e7135e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:22.238230 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25671fc-8e07-4cb6-bb2e-aa836e7135e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:22.238897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25671fc-8e07-4cb6-bb2e-aa836e7135e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:22.239199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25671fc-8e07-4cb6-bb2e-aa836e7135e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:22.241178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25671fc-8e07-4cb6-bb2e-aa836e7135e6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:22.255274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 151/302] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:22.255274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d01a-6740-4865-85a5-afbd0deb27fb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:22.255274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d01a-6740-4865-85a5-afbd0deb27fb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:22.255274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d01a-6740-4865-85a5-afbd0deb27fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:22.270309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-23c9d01a-6740-4865-85a5-afbd0deb27fb None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:22.271521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-23c9d01a-6740-4865-85a5-afbd0deb27fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:22.292971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:22.356607 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 152/303] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:22.356607 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9d01a-6740-4865-85a5-afbd0deb27fb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:22.362546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4df57b-9938-4f1f-a1bc-814ba29fb253 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:22.381503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:22.408305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46a262-6fb0-461d-a48a-0c314a05fd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:22.408934 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46a262-6fb0-461d-a48a-0c314a05fd84 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:22.409210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46a262-6fb0-461d-a48a-0c314a05fd84 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:22.409479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46a262-6fb0-461d-a48a-0c314a05fd84 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:22.410138 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46a262-6fb0-461d-a48a-0c314a05fd84 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:22.410437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46a262-6fb0-461d-a48a-0c314a05fd84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:22.412333 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46a262-6fb0-461d-a48a-0c314a05fd84 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:22.421269 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 152/304] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:22.426283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46a262-6fb0-461d-a48a-0c314a05fd84 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:22.475472 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9d01a-6740-4865-85a5-afbd0deb27fb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:22.514284 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f0c62-202a-41c4-81d6-c59125ca392b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:22.514822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f0c62-202a-41c4-81d6-c59125ca392b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:22.515097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f0c62-202a-41c4-81d6-c59125ca392b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:22.515362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f0c62-202a-41c4-81d6-c59125ca392b None admin] PATH_INFO: `/v3/users/6d245e2ce3aa46ee900d4f107ac6ce5b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:22.529527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f0c62-202a-41c4-81d6-c59125ca392b None admin] RBAC: Authorizing `identity:get_user(user_id=6d245e2ce3aa46ee900d4f107ac6ce5b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:22.530980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f0c62-202a-41c4-81d6-c59125ca392b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:22.532632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 153/305] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:22 2022] GET /identity/v3/users/6d245e2ce3aa46ee900d4f107ac6ce5b => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:22.537951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f0c62-202a-41c4-81d6-c59125ca392b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:22.538048 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46a262-6fb0-461d-a48a-0c314a05fd84 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:22.550416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:22.577739 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e1011-8558-4844-9ef6-ca4a9d4d6bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:22.578383 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e1011-8558-4844-9ef6-ca4a9d4d6bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:22.578664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e1011-8558-4844-9ef6-ca4a9d4d6bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:22.578934 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e1011-8558-4844-9ef6-ca4a9d4d6bc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:22.580026 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e1011-8558-4844-9ef6-ca4a9d4d6bc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:22.581477 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e1011-8558-4844-9ef6-ca4a9d4d6bc0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:22.583192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 153/306] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:22.589141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e1011-8558-4844-9ef6-ca4a9d4d6bc0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:22.631425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:22.641324 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f0c62-202a-41c4-81d6-c59125ca392b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:22.676810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931e75b-6ef1-4800-8ba3-78d1f2b8316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:22.677549 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931e75b-6ef1-4800-8ba3-78d1f2b8316b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:22.677727 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931e75b-6ef1-4800-8ba3-78d1f2b8316b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:22.677999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931e75b-6ef1-4800-8ba3-78d1f2b8316b None admin] PATH_INFO: `/v3/users/25c17d6474124a65959932cf71fc58e5` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:22.679115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931e75b-6ef1-4800-8ba3-78d1f2b8316b None admin] RBAC: Authorizing `identity:get_user(user_id=25c17d6474124a65959932cf71fc58e5)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:22.680629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931e75b-6ef1-4800-8ba3-78d1f2b8316b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:22.682200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 154/307] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:22 2022] GET /identity/v3/users/25c17d6474124a65959932cf71fc58e5 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:22.683017 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931e75b-6ef1-4800-8ba3-78d1f2b8316b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:22.697005 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e1011-8558-4844-9ef6-ca4a9d4d6bc0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:22.734180 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d1041-368a-492d-8cd9-f564b631a718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:22.734765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d1041-368a-492d-8cd9-f564b631a718 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:22.735039 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d1041-368a-492d-8cd9-f564b631a718 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:22.735311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d1041-368a-492d-8cd9-f564b631a718 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:22.736017 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d1041-368a-492d-8cd9-f564b631a718 None admin] RBAC: Adding query filter params (role.id=3b85296a2d114d309360453dd73a3c22, user.id=6d245e2ce3aa46ee900d4f107ac6ce5b, scope.system=all) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:22.736321 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d1041-368a-492d-8cd9-f564b631a718 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:22.737780 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d1041-368a-492d-8cd9-f564b631a718 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:22.743237 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 154/308] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Aug 11 16:12:22 2022] GET /identity/v3/role_assignments?user.id=6d245e2ce3aa46ee900d4f107ac6ce5b&scope.system=all&role.id=3b85296a2d114d309360453dd73a3c22 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:22.744358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2aded-3f59-4283-abd0-37e91bb7a9f8 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:22.744665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2aded-3f59-4283-abd0-37e91bb7a9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:22.744937 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2aded-3f59-4283-abd0-37e91bb7a9f8 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:22.746145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 155/309] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:22.746855 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2aded-3f59-4283-abd0-37e91bb7a9f8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:22.781237 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:22.803265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931e75b-6ef1-4800-8ba3-78d1f2b8316b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:22.845292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077da3ce-612c-4d27-8b6e-f5d1df4b66ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:22.846011 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077da3ce-612c-4d27-8b6e-f5d1df4b66ad None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:22.846294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077da3ce-612c-4d27-8b6e-f5d1df4b66ad None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:22.846564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077da3ce-612c-4d27-8b6e-f5d1df4b66ad None admin] PATH_INFO: `/v3/groups` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:22.847191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077da3ce-612c-4d27-8b6e-f5d1df4b66ad None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:22.848665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077da3ce-612c-4d27-8b6e-f5d1df4b66ad None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:22.866961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 155/310] 10.222.0.40 () {60 vars in 1134 bytes} [Thu Aug 11 16:12:22 2022] POST /identity/v3/groups => generated 229 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:12:22.868345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c0ff-cce1-4f21-ae1d-5ec9f29c6b3c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:22.868648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c0ff-cce1-4f21-ae1d-5ec9f29c6b3c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:22.868910 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c0ff-cce1-4f21-ae1d-5ec9f29c6b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:22.869676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2aded-3f59-4283-abd0-37e91bb7a9f8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:22.880197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:22.890699 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6ed8c0ff-cce1-4f21-ae1d-5ec9f29c6b3c None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:22.892657 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6ed8c0ff-cce1-4f21-ae1d-5ec9f29c6b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:22.928548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9b90c-1a16-48eb-8f06-eec9bac412e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:22.930101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9b90c-1a16-48eb-8f06-eec9bac412e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:22.930372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9b90c-1a16-48eb-8f06-eec9bac412e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:22.930642 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9b90c-1a16-48eb-8f06-eec9bac412e8 None admin] PATH_INFO: `/v3/system/users/25c17d6474124a65959932cf71fc58e5/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:22.933042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9b90c-1a16-48eb-8f06-eec9bac412e8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=25c17d6474124a65959932cf71fc58e5, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:22.934471 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9b90c-1a16-48eb-8f06-eec9bac412e8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:22.957015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 156/311] 10.222.0.40 () {58 vars in 1334 bytes} [Thu Aug 11 16:12:22 2022] PUT /identity/v3/system/users/25c17d6474124a65959932cf71fc58e5/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:22.986170 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 156/312] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:23.012168 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9b90c-1a16-48eb-8f06-eec9bac412e8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:23.130701 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9b90c-1a16-48eb-8f06-eec9bac412e8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:23.171881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a0d7c-2d62-42f2-869b-f007d8acf8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:23.172861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a0d7c-2d62-42f2-869b-f007d8acf8ff None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:23.173317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a0d7c-2d62-42f2-869b-f007d8acf8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:23.173764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a0d7c-2d62-42f2-869b-f007d8acf8ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:23.186099 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a0d7c-2d62-42f2-869b-f007d8acf8ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b46a0d7c-2d62-42f2-869b-f007d8acf8ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:23.191807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:23.192719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:23.193537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:23.193537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:23.193537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:23.193537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:23.193537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:23.193537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:23.193537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:23.193537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:23.193537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:23.193537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:23.193537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:23.193537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:23.195745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 157/313] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:23.201820 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8c0ff-cce1-4f21-ae1d-5ec9f29c6b3c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:23.275614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:23.311819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8c0ff-cce1-4f21-ae1d-5ec9f29c6b3c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:23.347926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126277c-b4ba-4099-9be0-63ae187c9055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:23.348845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126277c-b4ba-4099-9be0-63ae187c9055 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:23.349840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126277c-b4ba-4099-9be0-63ae187c9055 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:23.350260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126277c-b4ba-4099-9be0-63ae187c9055 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:23.351073 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126277c-b4ba-4099-9be0-63ae187c9055 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:23.351519 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126277c-b4ba-4099-9be0-63ae187c9055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:23.353094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126277c-b4ba-4099-9be0-63ae187c9055 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:23.362396 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 157/314] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:23.372604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a0d7c-2d62-42f2-869b-f007d8acf8ff None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:23.405994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:23.479198 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a0d7c-2d62-42f2-869b-f007d8acf8ff None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:23.514449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d0fd3-f9fe-49b5-8db7-c16fc313855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:23.515412 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d0fd3-f9fe-49b5-8db7-c16fc313855b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:23.515881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d0fd3-f9fe-49b5-8db7-c16fc313855b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:23.516366 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d0fd3-f9fe-49b5-8db7-c16fc313855b None admin] PATH_INFO: `/v3/users/0503c76a6cf54ebd929504d269640f46` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:23.517786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d0fd3-f9fe-49b5-8db7-c16fc313855b None admin] RBAC: Authorizing `identity:get_user(user_id=0503c76a6cf54ebd929504d269640f46)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:23.519422 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d0fd3-f9fe-49b5-8db7-c16fc313855b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:23.521899 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 158/315] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:23 2022] GET /identity/v3/users/0503c76a6cf54ebd929504d269640f46 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:23.532609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126277c-b4ba-4099-9be0-63ae187c9055 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:23.632835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126277c-b4ba-4099-9be0-63ae187c9055 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:23.667406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981f86e-ca08-4a88-9253-fe8ab1f2deb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:23.667939 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981f86e-ca08-4a88-9253-fe8ab1f2deb1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:23.668217 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981f86e-ca08-4a88-9253-fe8ab1f2deb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:23.668489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981f86e-ca08-4a88-9253-fe8ab1f2deb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:23.671524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:23.740532 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981f86e-ca08-4a88-9253-fe8ab1f2deb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:23.742030 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981f86e-ca08-4a88-9253-fe8ab1f2deb1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:23.843469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 158/316] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:23.849690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d0fd3-f9fe-49b5-8db7-c16fc313855b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:23.950037 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:23.958243 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d0fd3-f9fe-49b5-8db7-c16fc313855b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:23.996555 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81851da-da49-438c-9457-a03abb029a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:23.997212 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81851da-da49-438c-9457-a03abb029a85 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:23.997490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81851da-da49-438c-9457-a03abb029a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:23.997760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81851da-da49-438c-9457-a03abb029a85 None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:23.998893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81851da-da49-438c-9457-a03abb029a85 None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:24.000405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81851da-da49-438c-9457-a03abb029a85 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:24.002075 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 159/317] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:23 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:24.008170 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981f86e-ca08-4a88-9253-fe8ab1f2deb1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:24.056969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:24.114224 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981f86e-ca08-4a88-9253-fe8ab1f2deb1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:24.149697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff78b6-b4ec-494e-918b-3f7a7ed62f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:24.150305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff78b6-b4ec-494e-918b-3f7a7ed62f3f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:24.150622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff78b6-b4ec-494e-918b-3f7a7ed62f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:24.150949 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff78b6-b4ec-494e-918b-3f7a7ed62f3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:24.151728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff78b6-b4ec-494e-918b-3f7a7ed62f3f None admin] RBAC: Adding query filter params (role.id=3b85296a2d114d309360453dd73a3c22, scope.project.id=75c18326de4348a5851e485deb998c36, user.id=0503c76a6cf54ebd929504d269640f46) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:24.152040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff78b6-b4ec-494e-918b-3f7a7ed62f3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:24.153563 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff78b6-b4ec-494e-918b-3f7a7ed62f3f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:24.163163 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 159/318] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:24 2022] GET /identity/v3/role_assignments?user.id=0503c76a6cf54ebd929504d269640f46&scope.project.id=75c18326de4348a5851e485deb998c36&role.id=3b85296a2d114d309360453dd73a3c22 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:24.883148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f296fa7-d7df-4144-ae3c-32813cc0ee01 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:24.883517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f296fa7-d7df-4144-ae3c-32813cc0ee01 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:24.883712 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f296fa7-d7df-4144-ae3c-32813cc0ee01 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:24.885229 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 160/319] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:24.890060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c1787-8597-41d7-a3e1-3a04fda930f8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:24.890483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c1787-8597-41d7-a3e1-3a04fda930f8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:24.890634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c1787-8597-41d7-a3e1-3a04fda930f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:24.908837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-322c1787-8597-41d7-a3e1-3a04fda930f8 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:24.910032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-322c1787-8597-41d7-a3e1-3a04fda930f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:24.962992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc041d-d85c-4f40-bc7a-74266beb7335 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:24.963509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc041d-d85c-4f40-bc7a-74266beb7335 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:24.963810 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc041d-d85c-4f40-bc7a-74266beb7335 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:24.965328 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 161/320] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:24.971561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69857753-541d-4c85-9e79-8850549ba769 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:24.972084 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69857753-541d-4c85-9e79-8850549ba769 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:24.972540 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69857753-541d-4c85-9e79-8850549ba769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:24.985194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 160/321] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:24.995329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-69857753-541d-4c85-9e79-8850549ba769 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:24.996516 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-69857753-541d-4c85-9e79-8850549ba769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:25.007512 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c1787-8597-41d7-a3e1-3a04fda930f8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:25.034787 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:25.072866 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 162/322] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:25.082336 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d5f65-be00-4c8d-87ad-477e782f2772 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:25.082625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d5f65-be00-4c8d-87ad-477e782f2772 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:25.082883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d5f65-be00-4c8d-87ad-477e782f2772 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:25.084207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 163/323] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:12:25.088893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32900884-6d71-4abe-a673-b5a3398c22a6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:25.089158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32900884-6d71-4abe-a673-b5a3398c22a6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:25.089429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32900884-6d71-4abe-a673-b5a3398c22a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:25.108310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c1787-8597-41d7-a3e1-3a04fda930f8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:25.108474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-32900884-6d71-4abe-a673-b5a3398c22a6 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:25.109493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-32900884-6d71-4abe-a673-b5a3398c22a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:25.142063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1e248-8ba6-4df9-9845-5799d6b673a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:25.142610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1e248-8ba6-4df9-9845-5799d6b673a9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:25.142883 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1e248-8ba6-4df9-9845-5799d6b673a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:25.143145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1e248-8ba6-4df9-9845-5799d6b673a9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:25.153305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1e248-8ba6-4df9-9845-5799d6b673a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-86c1e248-8ba6-4df9-9845-5799d6b673a9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:25.157951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:25.158940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:25.159726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:25.159726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:25.159726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:25.159726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:25.159726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:25.159726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:25.159726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:25.159726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:25.159726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:25.159726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:25.159726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:25.159726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:25.159726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 161/324] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:12:25.160399 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1e248-8ba6-4df9-9845-5799d6b673a9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:25.182464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 164/325] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:25.183337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32900884-6d71-4abe-a673-b5a3398c22a6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:25.210531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:25.247223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:25.259143 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1e248-8ba6-4df9-9845-5799d6b673a9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:25.283286 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32900884-6d71-4abe-a673-b5a3398c22a6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:25.291865 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7894a-461a-49ee-9a3f-66e30efbfbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:25.292490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7894a-461a-49ee-9a3f-66e30efbfbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:25.292797 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7894a-461a-49ee-9a3f-66e30efbfbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:25.293071 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7894a-461a-49ee-9a3f-66e30efbfbb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:25.294423 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7894a-461a-49ee-9a3f-66e30efbfbb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:25.295853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7894a-461a-49ee-9a3f-66e30efbfbb8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:25.297439 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 162/326] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:25.303195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7894a-461a-49ee-9a3f-66e30efbfbb8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:25.317388 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5190e-3a3b-4050-8f20-60a6ab8f3f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:25.318049 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5190e-3a3b-4050-8f20-60a6ab8f3f68 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:25.318322 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5190e-3a3b-4050-8f20-60a6ab8f3f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:25.318587 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5190e-3a3b-4050-8f20-60a6ab8f3f68 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:25.319241 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5190e-3a3b-4050-8f20-60a6ab8f3f68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:25.319537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5190e-3a3b-4050-8f20-60a6ab8f3f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:25.320915 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5190e-3a3b-4050-8f20-60a6ab8f3f68 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:25.334512 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 165/327] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:25.334512 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5190e-3a3b-4050-8f20-60a6ab8f3f68 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:25.402384 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7894a-461a-49ee-9a3f-66e30efbfbb8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:25.412580 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:25.429240 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5190e-3a3b-4050-8f20-60a6ab8f3f68 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:25.436461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7af79f-412c-4c41-9682-f270c0f5ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:25.437102 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7af79f-412c-4c41-9682-f270c0f5ec26 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:25.437374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7af79f-412c-4c41-9682-f270c0f5ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:25.437649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7af79f-412c-4c41-9682-f270c0f5ec26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:25.447599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7af79f-412c-4c41-9682-f270c0f5ec26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-8d7af79f-412c-4c41-9682-f270c0f5ec26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:25.452222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:25.453109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:25.453870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:25.453870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:25.453870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:25.453870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:25.453870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:25.453870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:25.453870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:25.453870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:25.453870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:25.453870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:25.453870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:25.453870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:25.453870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 163/328] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:25.454513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7af79f-412c-4c41-9682-f270c0f5ec26 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:25.466916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3b890-305d-4fa0-a933-e8c4539caa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:25.467467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3b890-305d-4fa0-a933-e8c4539caa1e None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:25.467749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3b890-305d-4fa0-a933-e8c4539caa1e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:25.468024 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3b890-305d-4fa0-a933-e8c4539caa1e None admin] PATH_INFO: `/v3/groups` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:25.468669 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3b890-305d-4fa0-a933-e8c4539caa1e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:25.470096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3b890-305d-4fa0-a933-e8c4539caa1e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:25.477253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:25.487023 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 166/329] 10.222.0.40 () {60 vars in 1134 bytes} [Thu Aug 11 16:12:25 2022] POST /identity/v3/groups => generated 226 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:12:25.487670 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3b890-305d-4fa0-a933-e8c4539caa1e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:25.572335 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7af79f-412c-4c41-9682-f270c0f5ec26 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:25.602160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3b890-305d-4fa0-a933-e8c4539caa1e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:25.608732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7642032-313a-439b-b02e-b3604be1d3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:25.609365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7642032-313a-439b-b02e-b3604be1d3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:25.609638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7642032-313a-439b-b02e-b3604be1d3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:25.609905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7642032-313a-439b-b02e-b3604be1d3d8 None admin] PATH_INFO: `/v3/users/6d245e2ce3aa46ee900d4f107ac6ce5b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:25.611054 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7642032-313a-439b-b02e-b3604be1d3d8 None admin] RBAC: Authorizing `identity:get_user(user_id=6d245e2ce3aa46ee900d4f107ac6ce5b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:25.612523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7642032-313a-439b-b02e-b3604be1d3d8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:25.614345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 164/330] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:25 2022] GET /identity/v3/users/6d245e2ce3aa46ee900d4f107ac6ce5b => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:25.619991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7642032-313a-439b-b02e-b3604be1d3d8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:25.647525 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f8634-6d30-45c0-889b-1d17276b0cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:25.648178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f8634-6d30-45c0-889b-1d17276b0cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:25.648443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f8634-6d30-45c0-889b-1d17276b0cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:25.648750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f8634-6d30-45c0-889b-1d17276b0cd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:25.649432 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f8634-6d30-45c0-889b-1d17276b0cd2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:25.649737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f8634-6d30-45c0-889b-1d17276b0cd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:25.651112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f8634-6d30-45c0-889b-1d17276b0cd2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:25.661573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 167/331] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:25.667704 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f8634-6d30-45c0-889b-1d17276b0cd2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:25.676991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:25.720011 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:25.742773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7642032-313a-439b-b02e-b3604be1d3d8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:25.786368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe352586-9dfd-4848-9c4e-d39b1dfc44c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:25.787058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe352586-9dfd-4848-9c4e-d39b1dfc44c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:25.787332 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe352586-9dfd-4848-9c4e-d39b1dfc44c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:25.787603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe352586-9dfd-4848-9c4e-d39b1dfc44c1 None admin] PATH_INFO: `/v3/system/users/6d245e2ce3aa46ee900d4f107ac6ce5b/roles/3b85296a2d114d309360453dd73a3c22` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:25.789090 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe352586-9dfd-4848-9c4e-d39b1dfc44c1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6d245e2ce3aa46ee900d4f107ac6ce5b, role_id=3b85296a2d114d309360453dd73a3c22)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:25.790467 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe352586-9dfd-4848-9c4e-d39b1dfc44c1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:25.799536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f8634-6d30-45c0-889b-1d17276b0cd2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:25.800540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 165/332] 10.222.0.40 () {58 vars in 1334 bytes} [Thu Aug 11 16:12:25 2022] PUT /identity/v3/system/users/6d245e2ce3aa46ee900d4f107ac6ce5b/roles/3b85296a2d114d309360453dd73a3c22 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:12:25.846458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74936f-d0b3-4f2e-a58e-132ecb1c8006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:25.847107 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74936f-d0b3-4f2e-a58e-132ecb1c8006 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:25.847386 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74936f-d0b3-4f2e-a58e-132ecb1c8006 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:25.847657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74936f-d0b3-4f2e-a58e-132ecb1c8006 None admin] PATH_INFO: `/v3/users/25c17d6474124a65959932cf71fc58e5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:25.848906 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74936f-d0b3-4f2e-a58e-132ecb1c8006 None admin] RBAC: Authorizing `identity:get_user(user_id=25c17d6474124a65959932cf71fc58e5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:25.851051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74936f-d0b3-4f2e-a58e-132ecb1c8006 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:25.852997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 168/333] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:25 2022] GET /identity/v3/users/25c17d6474124a65959932cf71fc58e5 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:25.858912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe352586-9dfd-4848-9c4e-d39b1dfc44c1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:25.980321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe352586-9dfd-4848-9c4e-d39b1dfc44c1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:26.021231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96105401-07b7-407a-86cd-144b126dd51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:26.021852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96105401-07b7-407a-86cd-144b126dd51e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:26.022191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96105401-07b7-407a-86cd-144b126dd51e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:26.022470 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96105401-07b7-407a-86cd-144b126dd51e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:26.023212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96105401-07b7-407a-86cd-144b126dd51e None admin] RBAC: Adding query filter params (role.id=87abba8d76c2420c97d9d5f2dbb6b540, user.id=25c17d6474124a65959932cf71fc58e5, scope.system=all) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:26.023518 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96105401-07b7-407a-86cd-144b126dd51e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:26.024975 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96105401-07b7-407a-86cd-144b126dd51e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:26.038479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 166/334] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Aug 11 16:12:25 2022] GET /identity/v3/role_assignments?user.id=25c17d6474124a65959932cf71fc58e5&scope.system=all&role.id=87abba8d76c2420c97d9d5f2dbb6b540 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:27.687352 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01987d-f833-4772-bdca-e39bd78c1653 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:27.687878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01987d-f833-4772-bdca-e39bd78c1653 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:27.687878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01987d-f833-4772-bdca-e39bd78c1653 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:27.689280 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 169/335] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:27.694524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83aa18-3648-44dd-9940-e0b4573109d3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:27.694936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83aa18-3648-44dd-9940-e0b4573109d3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:27.695123 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83aa18-3648-44dd-9940-e0b4573109d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:27.713692 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:27.719925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0f83aa18-3648-44dd-9940-e0b4573109d3 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:27.721138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0f83aa18-3648-44dd-9940-e0b4573109d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:27.815476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 167/336] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:27.851216 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01987d-f833-4772-bdca-e39bd78c1653 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:27.935169 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:27.944332 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298c44a-c669-4c81-ae2f-22fe921b7be5 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:27.944870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298c44a-c669-4c81-ae2f-22fe921b7be5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:27.945353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298c44a-c669-4c81-ae2f-22fe921b7be5 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:27.947206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 168/337] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:12:27.952628 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73324248-2590-4110-aee6-0a38bb2c2003 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:27.953169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73324248-2590-4110-aee6-0a38bb2c2003 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:27.953637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73324248-2590-4110-aee6-0a38bb2c2003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:27.979566 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01987d-f833-4772-bdca-e39bd78c1653 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:27.981048 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-73324248-2590-4110-aee6-0a38bb2c2003 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:27.982471 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-73324248-2590-4110-aee6-0a38bb2c2003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:28.036467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36cc07-fe31-44b5-9c03-91bdd084fe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:28.037261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36cc07-fe31-44b5-9c03-91bdd084fe23 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:28.037553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36cc07-fe31-44b5-9c03-91bdd084fe23 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:28.037826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36cc07-fe31-44b5-9c03-91bdd084fe23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:28.069640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36cc07-fe31-44b5-9c03-91bdd084fe23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-2f36cc07-fe31-44b5-9c03-91bdd084fe23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:28.074883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:28.075936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:28.076880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:28.076880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:28.076880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:28.076880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:28.076880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:28.076880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:28.076880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:28.076880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:28.076880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:28.076880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:28.076880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:28.076880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:28.076880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 170/338] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:28.082012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36cc07-fe31-44b5-9c03-91bdd084fe23 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:28.117955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 169/339] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:28.153349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73324248-2590-4110-aee6-0a38bb2c2003 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:28.238517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36cc07-fe31-44b5-9c03-91bdd084fe23 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:28.274212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:28.281397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ed7e2-5e0e-4db6-b04c-b09686c2ccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:28.281999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ed7e2-5e0e-4db6-b04c-b09686c2ccb7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:28.282273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ed7e2-5e0e-4db6-b04c-b09686c2ccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:28.282537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ed7e2-5e0e-4db6-b04c-b09686c2ccb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:28.286258 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ed7e2-5e0e-4db6-b04c-b09686c2ccb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:28.286258 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ed7e2-5e0e-4db6-b04c-b09686c2ccb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:28.287736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ed7e2-5e0e-4db6-b04c-b09686c2ccb7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:28.293144 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:28.308281 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 171/340] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:28.309575 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e78918-70ab-40c4-b79d-2a9557aa2eda None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:28.309854 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e78918-70ab-40c4-b79d-2a9557aa2eda None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:28.310122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e78918-70ab-40c4-b79d-2a9557aa2eda None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:28.316575 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 172/341] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:28.317354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e78918-70ab-40c4-b79d-2a9557aa2eda None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:28.365488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73324248-2590-4110-aee6-0a38bb2c2003 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:28.437611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a220a0-1a04-4d41-952b-6460512a2d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:28.438246 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a220a0-1a04-4d41-952b-6460512a2d55 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:28.438516 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a220a0-1a04-4d41-952b-6460512a2d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:28.438784 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a220a0-1a04-4d41-952b-6460512a2d55 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:28.440484 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e78918-70ab-40c4-b79d-2a9557aa2eda None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:28.466535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a220a0-1a04-4d41-952b-6460512a2d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-61a220a0-1a04-4d41-952b-6460512a2d55 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:28.473125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:28.474603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:28.475400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:28.475400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:28.475400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:28.475400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:28.475400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:28.475400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:28.475400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:28.475400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:28.475400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:28.475400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:28.475400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 16:12:28.475400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:28.475400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 170/342] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:12:28.477504 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729514bd-1218-46ec-9e03-2fc15d163f27 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:28.483852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729514bd-1218-46ec-9e03-2fc15d163f27 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:28.483852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729514bd-1218-46ec-9e03-2fc15d163f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:28.505561 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-729514bd-1218-46ec-9e03-2fc15d163f27 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:28.506740 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-729514bd-1218-46ec-9e03-2fc15d163f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:28.524298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b253e2-05ce-4203-b32e-90e2433e920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:28.525212 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b253e2-05ce-4203-b32e-90e2433e920f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:28.525493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b253e2-05ce-4203-b32e-90e2433e920f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:28.525767 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b253e2-05ce-4203-b32e-90e2433e920f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:28.615072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:28.624542 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 171/343] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:28.625287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b253e2-05ce-4203-b32e-90e2433e920f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:28.625456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729514bd-1218-46ec-9e03-2fc15d163f27 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:28.626889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b253e2-05ce-4203-b32e-90e2433e920f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:28.714363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:28.763315 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 173/344] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:28.764182 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b253e2-05ce-4203-b32e-90e2433e920f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:28.784255 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729514bd-1218-46ec-9e03-2fc15d163f27 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:28.860339 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d8739-4fbe-404f-9eb0-fe1d1f4bd46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:28.861111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d8739-4fbe-404f-9eb0-fe1d1f4bd46e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:28.861392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d8739-4fbe-404f-9eb0-fe1d1f4bd46e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:28.861661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d8739-4fbe-404f-9eb0-fe1d1f4bd46e None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:28.862336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d8739-4fbe-404f-9eb0-fe1d1f4bd46e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:28.862637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d8739-4fbe-404f-9eb0-fe1d1f4bd46e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:28.864116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d8739-4fbe-404f-9eb0-fe1d1f4bd46e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:28.871265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:28.878364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b253e2-05ce-4203-b32e-90e2433e920f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:28.880329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 172/345] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:28.882082 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d8739-4fbe-404f-9eb0-fe1d1f4bd46e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:28.922316 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46553136-27bd-439c-a22e-48df63663673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:28.922943 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46553136-27bd-439c-a22e-48df63663673 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:28.923215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46553136-27bd-439c-a22e-48df63663673 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:28.923481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46553136-27bd-439c-a22e-48df63663673 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:28.936137 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46553136-27bd-439c-a22e-48df63663673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-46553136-27bd-439c-a22e-48df63663673 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:28.941177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:28.943553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:28.945748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:28.945748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:28.945748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:28.945748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:28.945748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:28.945748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:28.945748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:28.945748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:28.945748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:28.945748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:28.945748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:28.945748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:28.945748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 174/346] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:12:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:28.945748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46553136-27bd-439c-a22e-48df63663673 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:29.066078 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46553136-27bd-439c-a22e-48df63663673 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:29.093209 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d8739-4fbe-404f-9eb0-fe1d1f4bd46e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:29.109503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59505bb-b7de-4fbc-af8b-707135cf7524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:29.110405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59505bb-b7de-4fbc-af8b-707135cf7524 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:29.110692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59505bb-b7de-4fbc-af8b-707135cf7524 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:29.110965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59505bb-b7de-4fbc-af8b-707135cf7524 None admin] PATH_INFO: `/v3/users/6d245e2ce3aa46ee900d4f107ac6ce5b` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:29.112459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59505bb-b7de-4fbc-af8b-707135cf7524 None admin] RBAC: Authorizing `identity:get_user(user_id=6d245e2ce3aa46ee900d4f107ac6ce5b)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:29.114065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59505bb-b7de-4fbc-af8b-707135cf7524 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:29.116434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 175/347] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:12:28 2022] GET /identity/v3/users/6d245e2ce3aa46ee900d4f107ac6ce5b => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:29.120652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59505bb-b7de-4fbc-af8b-707135cf7524 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:29.123420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:29.151873 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:29.157954 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d93a3-2ebf-4dc3-b7b2-0ff2bccfb7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:29.158602 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d93a3-2ebf-4dc3-b7b2-0ff2bccfb7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:29.158879 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d93a3-2ebf-4dc3-b7b2-0ff2bccfb7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:29.159149 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d93a3-2ebf-4dc3-b7b2-0ff2bccfb7e5 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:29.160280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d93a3-2ebf-4dc3-b7b2-0ff2bccfb7e5 None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:29.162310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d93a3-2ebf-4dc3-b7b2-0ff2bccfb7e5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:29.164121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 173/348] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:28 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:29.164725 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d93a3-2ebf-4dc3-b7b2-0ff2bccfb7e5 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:29.245582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59505bb-b7de-4fbc-af8b-707135cf7524 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:29.282240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d93a3-2ebf-4dc3-b7b2-0ff2bccfb7e5 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:29.283959 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e57a17-9e07-4a79-9eca-22c46f672729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:29.284572 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e57a17-9e07-4a79-9eca-22c46f672729 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:29.284874 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e57a17-9e07-4a79-9eca-22c46f672729 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:29.285147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e57a17-9e07-4a79-9eca-22c46f672729 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:29.285868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e57a17-9e07-4a79-9eca-22c46f672729 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:29.286171 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e57a17-9e07-4a79-9eca-22c46f672729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:29.288117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e57a17-9e07-4a79-9eca-22c46f672729 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:29.299524 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 176/349] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:29.300557 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b0b66-a4fe-4001-8fc6-7953aff3c7bd None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:29.300864 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b0b66-a4fe-4001-8fc6-7953aff3c7bd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:29.301207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b0b66-a4fe-4001-8fc6-7953aff3c7bd None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:29.302701 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 177/350] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:29.303413 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b0b66-a4fe-4001-8fc6-7953aff3c7bd None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:29.329549 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925670a-cd9e-4338-8f13-db7508d9c29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:29.330212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925670a-cd9e-4338-8f13-db7508d9c29f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:29.330484 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925670a-cd9e-4338-8f13-db7508d9c29f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:29.330754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925670a-cd9e-4338-8f13-db7508d9c29f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:29.331539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925670a-cd9e-4338-8f13-db7508d9c29f None admin] RBAC: Adding query filter params (role.id=3b85296a2d114d309360453dd73a3c22, user.id=6d245e2ce3aa46ee900d4f107ac6ce5b, scope.system=all) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:29.331848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925670a-cd9e-4338-8f13-db7508d9c29f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:29.333906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925670a-cd9e-4338-8f13-db7508d9c29f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:29.347890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 174/351] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Aug 11 16:12:29 2022] GET /identity/v3/role_assignments?user.id=6d245e2ce3aa46ee900d4f107ac6ce5b&scope.system=all&role.id=3b85296a2d114d309360453dd73a3c22 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:29.348632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925670a-cd9e-4338-8f13-db7508d9c29f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:29.424024 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:29.438329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b0b66-a4fe-4001-8fc6-7953aff3c7bd None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:29.491654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:29.514015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac9913-dbfc-4ec8-9376-e0e5c7de20b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:29.514654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac9913-dbfc-4ec8-9376-e0e5c7de20b7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:29.514934 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac9913-dbfc-4ec8-9376-e0e5c7de20b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:29.515259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac9913-dbfc-4ec8-9376-e0e5c7de20b7 None admin] PATH_INFO: `/v3/groups/94a10a45510d47b0888ba9b04a64ab3c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:29.523117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac9913-dbfc-4ec8-9376-e0e5c7de20b7 None admin] RBAC: Authorizing `identity:get_group(group_id=94a10a45510d47b0888ba9b04a64ab3c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:29.524707 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac9913-dbfc-4ec8-9376-e0e5c7de20b7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:29.526637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 178/352] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Aug 11 16:12:29 2022] GET /identity/v3/groups/94a10a45510d47b0888ba9b04a64ab3c => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:29.527702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a71de0-b437-4519-a829-69dbaf1fa0eb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:29.527987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a71de0-b437-4519-a829-69dbaf1fa0eb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:29.528258 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a71de0-b437-4519-a829-69dbaf1fa0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:29.558870 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-40a71de0-b437-4519-a829-69dbaf1fa0eb None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:29.560079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-40a71de0-b437-4519-a829-69dbaf1fa0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:29.605742 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925670a-cd9e-4338-8f13-db7508d9c29f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:29.647191 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 179/353] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:29.647827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a71de0-b437-4519-a829-69dbaf1fa0eb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:29.650034 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550f9a5-99b5-4cd7-9720-c730e2095dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:29.650657 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550f9a5-99b5-4cd7-9720-c730e2095dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:29.650935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550f9a5-99b5-4cd7-9720-c730e2095dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:29.651204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550f9a5-99b5-4cd7-9720-c730e2095dd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:29.732413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550f9a5-99b5-4cd7-9720-c730e2095dd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:29.733951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550f9a5-99b5-4cd7-9720-c730e2095dd1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:29.749924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:29.777570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a71de0-b437-4519-a829-69dbaf1fa0eb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:29.792685 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:29.819311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d33a15-d521-45a1-861d-0310a4ad9757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:29.820065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d33a15-d521-45a1-861d-0310a4ad9757 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:29.820342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d33a15-d521-45a1-861d-0310a4ad9757 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:29.821124 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d33a15-d521-45a1-861d-0310a4ad9757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:29.823636 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d33a15-d521-45a1-861d-0310a4ad9757 None admin] RBAC: Adding query filter params (group.id=94a10a45510d47b0888ba9b04a64ab3c, role.id=87abba8d76c2420c97d9d5f2dbb6b540, scope.project.id=c22b8f7f1cc4484180061823f1584623) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:29.823636 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d33a15-d521-45a1-861d-0310a4ad9757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:29.825000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d33a15-d521-45a1-861d-0310a4ad9757 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:29.832834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 180/354] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Aug 11 16:12:29 2022] GET /identity/v3/role_assignments?group.id=94a10a45510d47b0888ba9b04a64ab3c&scope.project.id=c22b8f7f1cc4484180061823f1584623&role.id=87abba8d76c2420c97d9d5f2dbb6b540 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:29.834087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d33a15-d521-45a1-861d-0310a4ad9757 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:29.868927 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 175/355] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:29.874875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4f17d-9ee9-4aa6-85e2-d1b9924e178e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:29.875161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4f17d-9ee9-4aa6-85e2-d1b9924e178e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:29.875433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4f17d-9ee9-4aa6-85e2-d1b9924e178e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:29.877116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 176/356] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:29.877880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4f17d-9ee9-4aa6-85e2-d1b9924e178e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:29.961344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d33a15-d521-45a1-861d-0310a4ad9757 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:29.999645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc13d1c-d5fa-41bc-b5cf-a12adfd99536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:30.000656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc13d1c-d5fa-41bc-b5cf-a12adfd99536 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:30.001140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc13d1c-d5fa-41bc-b5cf-a12adfd99536 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:30.001629 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc13d1c-d5fa-41bc-b5cf-a12adfd99536 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:30.011732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4f17d-9ee9-4aa6-85e2-d1b9924e178e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:30.017242 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc13d1c-d5fa-41bc-b5cf-a12adfd99536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-0dc13d1c-d5fa-41bc-b5cf-a12adfd99536 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:30.024574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:30.025506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:30.026348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:30.026348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:30.026348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:30.026348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:30.026348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:30.026348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:30.026348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:30.026348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:30.026348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:30.026348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:30.026348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:30.026348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:30.028691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 181/357] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:30.030191 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979f13d-74c2-4dad-9112-ffabd8c2f4c2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:30.030672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979f13d-74c2-4dad-9112-ffabd8c2f4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:30.031134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979f13d-74c2-4dad-9112-ffabd8c2f4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:30.051710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b2de6-2bb2-435b-b088-68d13b73c9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:30.052925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b2de6-2bb2-435b-b088-68d13b73c9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:30.053202 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b2de6-2bb2-435b-b088-68d13b73c9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:30.053471 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b2de6-2bb2-435b-b088-68d13b73c9c0 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:30.055103 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b2de6-2bb2-435b-b088-68d13b73c9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:30.056899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b2de6-2bb2-435b-b088-68d13b73c9c0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:30.058523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 177/358] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:29 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:30.059027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:30.059288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b2de6-2bb2-435b-b088-68d13b73c9c0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:30.065543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0979f13d-74c2-4dad-9112-ffabd8c2f4c2 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:30.066907 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0979f13d-74c2-4dad-9112-ffabd8c2f4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:30.077586 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:30.142897 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 182/359] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:30.143932 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979f13d-74c2-4dad-9112-ffabd8c2f4c2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:30.202945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b2de6-2bb2-435b-b088-68d13b73c9c0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:30.252561 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c567a-064a-4f55-95dc-c960c0ffb25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:30.253861 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c567a-064a-4f55-95dc-c960c0ffb25e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:30.254540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c567a-064a-4f55-95dc-c960c0ffb25e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:30.254966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c567a-064a-4f55-95dc-c960c0ffb25e None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:30.256335 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c567a-064a-4f55-95dc-c960c0ffb25e None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:30.257081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c567a-064a-4f55-95dc-c960c0ffb25e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:30.259404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c567a-064a-4f55-95dc-c960c0ffb25e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:30.274320 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 178/360] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:30.276039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c567a-064a-4f55-95dc-c960c0ffb25e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:30.283297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979f13d-74c2-4dad-9112-ffabd8c2f4c2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:30.324318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338aa1d-23c8-4c24-8fe6-aa04ad64dd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:30.325147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338aa1d-23c8-4c24-8fe6-aa04ad64dd35 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:30.325518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338aa1d-23c8-4c24-8fe6-aa04ad64dd35 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:30.325881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338aa1d-23c8-4c24-8fe6-aa04ad64dd35 None admin] PATH_INFO: `/v3/groups/94a10a45510d47b0888ba9b04a64ab3c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:30.327425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338aa1d-23c8-4c24-8fe6-aa04ad64dd35 None admin] RBAC: Authorizing `identity:get_group(group_id=94a10a45510d47b0888ba9b04a64ab3c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:30.328672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338aa1d-23c8-4c24-8fe6-aa04ad64dd35 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:30.330504 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 183/361] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Aug 11 16:12:30 2022] GET /identity/v3/groups/94a10a45510d47b0888ba9b04a64ab3c => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:30.331311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338aa1d-23c8-4c24-8fe6-aa04ad64dd35 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:30.335341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:30.389649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:30.420013 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c567a-064a-4f55-95dc-c960c0ffb25e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:30.460517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33414dfb-f878-4041-a961-64d68b02fe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:30.461257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33414dfb-f878-4041-a961-64d68b02fe9b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:30.461542 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33414dfb-f878-4041-a961-64d68b02fe9b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:30.462756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33414dfb-f878-4041-a961-64d68b02fe9b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:30.466720 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338aa1d-23c8-4c24-8fe6-aa04ad64dd35 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:30.482399 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33414dfb-f878-4041-a961-64d68b02fe9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-33414dfb-f878-4041-a961-64d68b02fe9b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:30.489182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:30.490626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:30.491394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:30.491394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:30.491394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:30.491394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:30.491394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:30.491394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:30.491394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:30.491394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:30.491394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:30.491394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:30.491394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:30.491394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:30.491394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 179/362] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:12:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:30.492041 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33414dfb-f878-4041-a961-64d68b02fe9b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:30.520389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09cc62-d9fc-4997-bdd8-be53d0870683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:30.521091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09cc62-d9fc-4997-bdd8-be53d0870683 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:30.521379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09cc62-d9fc-4997-bdd8-be53d0870683 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:30.521655 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09cc62-d9fc-4997-bdd8-be53d0870683 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:30.605493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09cc62-d9fc-4997-bdd8-be53d0870683 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:30.607238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09cc62-d9fc-4997-bdd8-be53d0870683 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:30.610450 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:30.634264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33414dfb-f878-4041-a961-64d68b02fe9b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:30.680490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d4d4c-acfe-49cf-bad6-4e949357d31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:30.681383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d4d4c-acfe-49cf-bad6-4e949357d31a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:30.681659 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d4d4c-acfe-49cf-bad6-4e949357d31a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:30.681925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d4d4c-acfe-49cf-bad6-4e949357d31a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:30.683096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d4d4c-acfe-49cf-bad6-4e949357d31a None admin] RBAC: Adding query filter params (group.id=94a10a45510d47b0888ba9b04a64ab3c, role.id=a507b36f2493428fbb8fcdc4fbad6911, scope.project.id=c22b8f7f1cc4484180061823f1584623) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:30.683420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d4d4c-acfe-49cf-bad6-4e949357d31a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:30.685301 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d4d4c-acfe-49cf-bad6-4e949357d31a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:30.688133 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:30.696484 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 180/363] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Aug 11 16:12:30 2022] GET /identity/v3/role_assignments?group.id=94a10a45510d47b0888ba9b04a64ab3c&scope.project.id=c22b8f7f1cc4484180061823f1584623&role.id=a507b36f2493428fbb8fcdc4fbad6911 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:30.701483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d4d4c-acfe-49cf-bad6-4e949357d31a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:30.761844 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 184/364] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:30.763205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aef622-57bc-4c22-882e-595624511908 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:30.763490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aef622-57bc-4c22-882e-595624511908 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:30.763760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aef622-57bc-4c22-882e-595624511908 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:30.765427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 185/365] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:30.767137 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aef622-57bc-4c22-882e-595624511908 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:30.843012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d4d4c-acfe-49cf-bad6-4e949357d31a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:30.896222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f7b8b-24c4-4648-b6de-694b6981e56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:30.896932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f7b8b-24c4-4648-b6de-694b6981e56a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:30.897214 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f7b8b-24c4-4648-b6de-694b6981e56a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:30.897486 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f7b8b-24c4-4648-b6de-694b6981e56a None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:30.898261 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f7b8b-24c4-4648-b6de-694b6981e56a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:30.898573 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f7b8b-24c4-4648-b6de-694b6981e56a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:30.899938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f7b8b-24c4-4648-b6de-694b6981e56a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:30.902450 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aef622-57bc-4c22-882e-595624511908 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:30.909190 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 181/366] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:30.910230 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8380074-dedb-4d52-9d5b-006e2f493e9d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:30.910520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8380074-dedb-4d52-9d5b-006e2f493e9d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:30.910797 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8380074-dedb-4d52-9d5b-006e2f493e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:30.916303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:30.932342 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b8380074-dedb-4d52-9d5b-006e2f493e9d None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:30.933595 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b8380074-dedb-4d52-9d5b-006e2f493e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:30.948158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3acf7a-4872-419b-8ccc-25abfecdbe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:30.949219 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3acf7a-4872-419b-8ccc-25abfecdbe09 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:30.949785 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3acf7a-4872-419b-8ccc-25abfecdbe09 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:30.950259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3acf7a-4872-419b-8ccc-25abfecdbe09 None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:30.951682 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3acf7a-4872-419b-8ccc-25abfecdbe09 None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:30.953670 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3acf7a-4872-419b-8ccc-25abfecdbe09 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:30.961068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 186/367] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:30 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:30.962185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3acf7a-4872-419b-8ccc-25abfecdbe09 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:30.994940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:31.013959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 182/368] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:31.014957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8380074-dedb-4d52-9d5b-006e2f493e9d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:31.105605 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3acf7a-4872-419b-8ccc-25abfecdbe09 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:31.129586 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8380074-dedb-4d52-9d5b-006e2f493e9d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:31.154254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c920c6-4ac6-4079-b58f-fc46429ea4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:31.155413 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c920c6-4ac6-4079-b58f-fc46429ea4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:31.155691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c920c6-4ac6-4079-b58f-fc46429ea4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:31.156112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c920c6-4ac6-4079-b58f-fc46429ea4e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:31.173526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bebe06-2904-4da7-9e17-c0ecbe9513cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:31.174161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bebe06-2904-4da7-9e17-c0ecbe9513cb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:31.174434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bebe06-2904-4da7-9e17-c0ecbe9513cb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:31.174702 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bebe06-2904-4da7-9e17-c0ecbe9513cb None admin] PATH_INFO: `/v3/groups/94a10a45510d47b0888ba9b04a64ab3c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:31.175952 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bebe06-2904-4da7-9e17-c0ecbe9513cb None admin] RBAC: Authorizing `identity:get_group(group_id=94a10a45510d47b0888ba9b04a64ab3c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:31.179387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bebe06-2904-4da7-9e17-c0ecbe9513cb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:31.184713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 183/369] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Aug 11 16:12:31 2022] GET /identity/v3/groups/94a10a45510d47b0888ba9b04a64ab3c => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:31.185527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bebe06-2904-4da7-9e17-c0ecbe9513cb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:31.205418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:31.238223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c920c6-4ac6-4079-b58f-fc46429ea4e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:31.240400 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c920c6-4ac6-4079-b58f-fc46429ea4e2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:31.266154 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:31.319025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bebe06-2904-4da7-9e17-c0ecbe9513cb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:31.356927 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255c33f-161f-4b04-bdb8-947d436cab16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:31.357806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255c33f-161f-4b04-bdb8-947d436cab16 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:31.358232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255c33f-161f-4b04-bdb8-947d436cab16 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:31.358649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255c33f-161f-4b04-bdb8-947d436cab16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:31.370096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255c33f-161f-4b04-bdb8-947d436cab16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:31.373902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 187/370] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:31.374916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c920c6-4ac6-4079-b58f-fc46429ea4e2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c255c33f-161f-4b04-bdb8-947d436cab16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:31.376001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:31.377085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:31.377982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:31.377982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:31.377982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:31.377982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:31.377982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:31.377982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:31.377982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:31.377982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:31.377982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:31.377982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:31.377982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:12:31.377982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:31.380670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 184/371] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:12:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:31.381799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255c33f-161f-4b04-bdb8-947d436cab16 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:31.485020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:31.507526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255c33f-161f-4b04-bdb8-947d436cab16 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:31.526148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c920c6-4ac6-4079-b58f-fc46429ea4e2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:31.528394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:31.553506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9dbbf6-4e1f-47bc-a438-908b49d1ee5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:31.554487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dbbf6-4e1f-47bc-a438-908b49d1ee5d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:31.554969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dbbf6-4e1f-47bc-a438-908b49d1ee5d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:31.555413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dbbf6-4e1f-47bc-a438-908b49d1ee5d None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:31.556781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9dbbf6-4e1f-47bc-a438-908b49d1ee5d None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:31.558407 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9dbbf6-4e1f-47bc-a438-908b49d1ee5d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:31.560218 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 185/372] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:31 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:31.561334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9dbbf6-4e1f-47bc-a438-908b49d1ee5d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:31.575700 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b7fe4-956d-4e40-be9f-db028d8be3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:31.575700 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b7fe4-956d-4e40-be9f-db028d8be3cf None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:31.575700 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b7fe4-956d-4e40-be9f-db028d8be3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:31.575700 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b7fe4-956d-4e40-be9f-db028d8be3cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:31.578079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b7fe4-956d-4e40-be9f-db028d8be3cf None admin] RBAC: Adding query filter params (group.id=94a10a45510d47b0888ba9b04a64ab3c, role.id=87abba8d76c2420c97d9d5f2dbb6b540, scope.project.id=75c18326de4348a5851e485deb998c36) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:31.578890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b7fe4-956d-4e40-be9f-db028d8be3cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:31.580908 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b7fe4-956d-4e40-be9f-db028d8be3cf None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:31.588967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 188/373] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Aug 11 16:12:31 2022] GET /identity/v3/role_assignments?group.id=94a10a45510d47b0888ba9b04a64ab3c&scope.project.id=75c18326de4348a5851e485deb998c36&role.id=87abba8d76c2420c97d9d5f2dbb6b540 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:31.594285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b7fe4-956d-4e40-be9f-db028d8be3cf None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:31.706220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9dbbf6-4e1f-47bc-a438-908b49d1ee5d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:31.743863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3372e8-8f8b-42ad-b609-ba2d85dd0769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:31.744611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3372e8-8f8b-42ad-b609-ba2d85dd0769 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:31.744960 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3372e8-8f8b-42ad-b609-ba2d85dd0769 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:31.745516 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3372e8-8f8b-42ad-b609-ba2d85dd0769 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:31.746030 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3372e8-8f8b-42ad-b609-ba2d85dd0769 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:31.746392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3372e8-8f8b-42ad-b609-ba2d85dd0769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:31.747845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3372e8-8f8b-42ad-b609-ba2d85dd0769 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:31.760158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 186/374] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:31.763576 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3372e8-8f8b-42ad-b609-ba2d85dd0769 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:31.817065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:31.822363 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b7fe4-956d-4e40-be9f-db028d8be3cf None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:31.873703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3372e8-8f8b-42ad-b609-ba2d85dd0769 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:31.901310 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daf096-1cc3-4580-8161-f6c5f32075bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:31.902298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daf096-1cc3-4580-8161-f6c5f32075bb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:31.902805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daf096-1cc3-4580-8161-f6c5f32075bb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:31.903696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daf096-1cc3-4580-8161-f6c5f32075bb None admin] PATH_INFO: `/v3/groups/94a10a45510d47b0888ba9b04a64ab3c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:31.905221 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daf096-1cc3-4580-8161-f6c5f32075bb None admin] RBAC: Authorizing `identity:get_group(group_id=94a10a45510d47b0888ba9b04a64ab3c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:31.906891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daf096-1cc3-4580-8161-f6c5f32075bb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:31.908780 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 189/375] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Aug 11 16:12:31 2022] GET /identity/v3/groups/94a10a45510d47b0888ba9b04a64ab3c => generated 226 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:31.912632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7ae63-f58f-4059-962b-e7cc64544be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:31.912632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7ae63-f58f-4059-962b-e7cc64544be5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:31.912632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7ae63-f58f-4059-962b-e7cc64544be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:31.912632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7ae63-f58f-4059-962b-e7cc64544be5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:31.915509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daf096-1cc3-4580-8161-f6c5f32075bb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:31.923298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:31.981744 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7ae63-f58f-4059-962b-e7cc64544be5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:31.983188 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7ae63-f58f-4059-962b-e7cc64544be5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:32.041486 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:32.092304 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 187/376] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 16:12:32.093697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7ae63-f58f-4059-962b-e7cc64544be5 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:32.141478 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daf096-1cc3-4580-8161-f6c5f32075bb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:32.180643 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fa0bf-38ba-4a1f-af56-ba3e9ad122b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:32.181365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa0bf-38ba-4a1f-af56-ba3e9ad122b0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:32.181652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa0bf-38ba-4a1f-af56-ba3e9ad122b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:32.181928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa0bf-38ba-4a1f-af56-ba3e9ad122b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:32.182672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fa0bf-38ba-4a1f-af56-ba3e9ad122b0 None admin] RBAC: Adding query filter params (group.id=94a10a45510d47b0888ba9b04a64ab3c, role.id=a507b36f2493428fbb8fcdc4fbad6911, scope.project.id=75c18326de4348a5851e485deb998c36) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:32.182983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fa0bf-38ba-4a1f-af56-ba3e9ad122b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:32.184603 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fa0bf-38ba-4a1f-af56-ba3e9ad122b0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:32.191787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 190/377] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Aug 11 16:12:31 2022] GET /identity/v3/role_assignments?group.id=94a10a45510d47b0888ba9b04a64ab3c&scope.project.id=75c18326de4348a5851e485deb998c36&role.id=a507b36f2493428fbb8fcdc4fbad6911 => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:32.193694 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd0d53-fdad-412a-b5c6-8b6a928dced5 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:32.194049 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd0d53-fdad-412a-b5c6-8b6a928dced5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:32.194429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd0d53-fdad-412a-b5c6-8b6a928dced5 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:32.195814 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 191/378] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:32.198534 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7ae63-f58f-4059-962b-e7cc64544be5 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:32.206257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061443b-326d-4071-bf1b-a1505f2a738f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:32.206599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061443b-326d-4071-bf1b-a1505f2a738f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:32.207021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061443b-326d-4071-bf1b-a1505f2a738f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:32.235626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0061443b-326d-4071-bf1b-a1505f2a738f None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:32.241985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f1d9f-136a-4ebe-9f1d-c94707c90150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:32.242753 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0061443b-326d-4071-bf1b-a1505f2a738f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:32.244524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f1d9f-136a-4ebe-9f1d-c94707c90150 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:32.244927 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f1d9f-136a-4ebe-9f1d-c94707c90150 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:32.245204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f1d9f-136a-4ebe-9f1d-c94707c90150 None admin] PATH_INFO: `/v3/projects/bc786cd53c124382a4c7cfd8b7e41636` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:32.248189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f1d9f-136a-4ebe-9f1d-c94707c90150 None admin] RBAC: Authorizing `identity:get_project(project_id=bc786cd53c124382a4c7cfd8b7e41636)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:32.251688 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f1d9f-136a-4ebe-9f1d-c94707c90150 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:32.255667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 188/379] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:32 2022] GET /identity/v3/projects/bc786cd53c124382a4c7cfd8b7e41636 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:32.261410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f1d9f-136a-4ebe-9f1d-c94707c90150 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:32.304927 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:32.382161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:32.400055 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 192/380] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:32.439344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061443b-326d-4071-bf1b-a1505f2a738f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:32.439969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f1d9f-136a-4ebe-9f1d-c94707c90150 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:32.493324 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198f108-d95a-4a2c-8149-6ee1c4de377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:32.493885 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198f108-d95a-4a2c-8149-6ee1c4de377b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:32.494156 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198f108-d95a-4a2c-8149-6ee1c4de377b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:32.494423 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198f108-d95a-4a2c-8149-6ee1c4de377b None admin] PATH_INFO: `/v3/groups/983accc5efb1438583bc542fa93552bb` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:32.502637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198f108-d95a-4a2c-8149-6ee1c4de377b None admin] RBAC: Authorizing `identity:get_group(group_id=983accc5efb1438583bc542fa93552bb)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:32.504114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198f108-d95a-4a2c-8149-6ee1c4de377b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:32.506572 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 189/381] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Aug 11 16:12:32 2022] GET /identity/v3/groups/983accc5efb1438583bc542fa93552bb => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:32.512213 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198f108-d95a-4a2c-8149-6ee1c4de377b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:32.613389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061443b-326d-4071-bf1b-a1505f2a738f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:32.655197 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:32.679183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56547898-5e13-482b-beb0-c6d189328666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:32.679817 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56547898-5e13-482b-beb0-c6d189328666 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:32.680089 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56547898-5e13-482b-beb0-c6d189328666 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:32.680357 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56547898-5e13-482b-beb0-c6d189328666 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:32.690277 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198f108-d95a-4a2c-8149-6ee1c4de377b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:32.701452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56547898-5e13-482b-beb0-c6d189328666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-56547898-5e13-482b-beb0-c6d189328666 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:32.706235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:32.707098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:32.708097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:32.708097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:32.708097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:32.708097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:32.708097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:32.708097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:32.708097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:32.708097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:32.708097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:32.708097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:32.708097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:32.708097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:32.712620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 193/382] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:32.715160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56547898-5e13-482b-beb0-c6d189328666 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:32.756432 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a9929-526f-47bb-8abd-160b3ac067cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:32.756983 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a9929-526f-47bb-8abd-160b3ac067cb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:32.757253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a9929-526f-47bb-8abd-160b3ac067cb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:32.757517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a9929-526f-47bb-8abd-160b3ac067cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:32.758245 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a9929-526f-47bb-8abd-160b3ac067cb None admin] RBAC: Adding query filter params (group.id=983accc5efb1438583bc542fa93552bb, role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=bc786cd53c124382a4c7cfd8b7e41636) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:32.758548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a9929-526f-47bb-8abd-160b3ac067cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:32.761176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a9929-526f-47bb-8abd-160b3ac067cb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:32.770270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 190/383] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Aug 11 16:12:32 2022] GET /identity/v3/role_assignments?group.id=983accc5efb1438583bc542fa93552bb&scope.project.id=bc786cd53c124382a4c7cfd8b7e41636&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:32.812357 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:32.878276 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56547898-5e13-482b-beb0-c6d189328666 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:32.934328 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa0395-9b3b-465d-91da-39fdc35630f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:32.935048 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa0395-9b3b-465d-91da-39fdc35630f7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:32.935286 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa0395-9b3b-465d-91da-39fdc35630f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:32.935459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa0395-9b3b-465d-91da-39fdc35630f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:32.936140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa0395-9b3b-465d-91da-39fdc35630f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:32.936435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa0395-9b3b-465d-91da-39fdc35630f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:32.937851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa0395-9b3b-465d-91da-39fdc35630f7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:32.952184 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 194/384] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:32.957452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a9929-526f-47bb-8abd-160b3ac067cb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:33.083499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a9929-526f-47bb-8abd-160b3ac067cb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:33.122930 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241ecf8-fa73-48e6-b66f-163079c16e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:33.123643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ecf8-fa73-48e6-b66f-163079c16e41 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:33.123916 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ecf8-fa73-48e6-b66f-163079c16e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:33.124185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ecf8-fa73-48e6-b66f-163079c16e41 None admin] PATH_INFO: `/v3/groups/94a10a45510d47b0888ba9b04a64ab3c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:33.127704 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241ecf8-fa73-48e6-b66f-163079c16e41 None admin] RBAC: Authorizing `identity:get_group(group_id=94a10a45510d47b0888ba9b04a64ab3c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:33.129196 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241ecf8-fa73-48e6-b66f-163079c16e41 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:33.131844 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 191/385] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Aug 11 16:12:32 2022] GET /identity/v3/groups/94a10a45510d47b0888ba9b04a64ab3c => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:33.136942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa0395-9b3b-465d-91da-39fdc35630f7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:33.265346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa0395-9b3b-465d-91da-39fdc35630f7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:33.284874 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:33.305214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd1621-66f6-44d3-8ff8-b62b30d69dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:33.305840 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd1621-66f6-44d3-8ff8-b62b30d69dbc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:33.306114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd1621-66f6-44d3-8ff8-b62b30d69dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:33.306383 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd1621-66f6-44d3-8ff8-b62b30d69dbc None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:33.307517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd1621-66f6-44d3-8ff8-b62b30d69dbc None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:33.308952 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd1621-66f6-44d3-8ff8-b62b30d69dbc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:33.310882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 195/386] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:33 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:33.316716 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241ecf8-fa73-48e6-b66f-163079c16e41 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:33.344087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:33.462656 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241ecf8-fa73-48e6-b66f-163079c16e41 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:33.500232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aa239-6c5d-47c9-8e5f-764ff99cd8fe None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:33.500543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aa239-6c5d-47c9-8e5f-764ff99cd8fe None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:33.500806 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aa239-6c5d-47c9-8e5f-764ff99cd8fe None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:33.502495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 196/387] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:33.508550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae4247-4ae9-4bda-a155-9d8241228855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:33.509240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae4247-4ae9-4bda-a155-9d8241228855 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:33.509523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae4247-4ae9-4bda-a155-9d8241228855 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:33.509795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae4247-4ae9-4bda-a155-9d8241228855 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623/groups/94a10a45510d47b0888ba9b04a64ab3c/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:33.510799 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c1bfe-466a-4971-bb89-f7fa9c8ff939 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:33.511082 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c1bfe-466a-4971-bb89-f7fa9c8ff939 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:33.511351 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c1bfe-466a-4971-bb89-f7fa9c8ff939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:33.518188 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae4247-4ae9-4bda-a155-9d8241228855 None admin] RBAC: Authorizing `identity:create_grant(project_id=c22b8f7f1cc4484180061823f1584623, group_id=94a10a45510d47b0888ba9b04a64ab3c, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:33.520687 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae4247-4ae9-4bda-a155-9d8241228855 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:33.532974 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-551c1bfe-466a-4971-bb89-f7fa9c8ff939 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:33.534256 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-551c1bfe-466a-4971-bb89-f7fa9c8ff939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:33.549924 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 192/388] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Aug 11 16:12:33 2022] PUT /identity/v3/projects/c22b8f7f1cc4484180061823f1584623/groups/94a10a45510d47b0888ba9b04a64ab3c/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:33.623725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 197/389] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:33.647060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae4247-4ae9-4bda-a155-9d8241228855 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:33.729784 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:33.764150 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae4247-4ae9-4bda-a155-9d8241228855 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:33.803148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a2b91-bb94-40fd-9350-21acbe65ab56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:33.804185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a2b91-bb94-40fd-9350-21acbe65ab56 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:33.804763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a2b91-bb94-40fd-9350-21acbe65ab56 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:33.805228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a2b91-bb94-40fd-9350-21acbe65ab56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:33.820028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a2b91-bb94-40fd-9350-21acbe65ab56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-087a2b91-bb94-40fd-9350-21acbe65ab56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:33.825854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:33.826814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:33.827608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:33.827608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:33.827608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:33.827608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:33.827608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:33.827608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:33.827608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:33.827608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:33.827608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:33.827608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:33.827608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:33.827608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:33.833919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 193/390] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:12:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:33.836676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c1bfe-466a-4971-bb89-f7fa9c8ff939 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:33.945685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c1bfe-466a-4971-bb89-f7fa9c8ff939 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:33.963576 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:33.983565 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393f064-08a0-4e08-b273-e940307c665d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:33.984457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393f064-08a0-4e08-b273-e940307c665d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:33.984906 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393f064-08a0-4e08-b273-e940307c665d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:33.985411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393f064-08a0-4e08-b273-e940307c665d None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:33.986269 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393f064-08a0-4e08-b273-e940307c665d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:33.986705 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393f064-08a0-4e08-b273-e940307c665d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:33.988203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393f064-08a0-4e08-b273-e940307c665d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:34.000780 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 198/391] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:34.003398 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a2b91-bb94-40fd-9350-21acbe65ab56 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:34.108720 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a2b91-bb94-40fd-9350-21acbe65ab56 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:34.139425 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:34.147636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0b70f-7291-45c6-866e-04a872e7c94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:34.148579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b70f-7291-45c6-866e-04a872e7c94f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:34.149040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b70f-7291-45c6-866e-04a872e7c94f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:34.149473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b70f-7291-45c6-866e-04a872e7c94f None admin] PATH_INFO: `/v3/groups/94a10a45510d47b0888ba9b04a64ab3c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:34.153215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0b70f-7291-45c6-866e-04a872e7c94f None admin] RBAC: Authorizing `identity:get_group(group_id=94a10a45510d47b0888ba9b04a64ab3c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:34.154876 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0b70f-7291-45c6-866e-04a872e7c94f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:34.156958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 194/392] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Aug 11 16:12:34 2022] GET /identity/v3/groups/94a10a45510d47b0888ba9b04a64ab3c => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:34.163241 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393f064-08a0-4e08-b273-e940307c665d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:34.318653 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393f064-08a0-4e08-b273-e940307c665d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:34.377852 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd3943-f44a-407d-a780-dce05a08e388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:34.378740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd3943-f44a-407d-a780-dce05a08e388 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:34.379175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd3943-f44a-407d-a780-dce05a08e388 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:34.379591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd3943-f44a-407d-a780-dce05a08e388 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:34.381041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd3943-f44a-407d-a780-dce05a08e388 None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:34.382666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd3943-f44a-407d-a780-dce05a08e388 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:34.388695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 199/393] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:34 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:34.391699 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0b70f-7291-45c6-866e-04a872e7c94f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:34.437474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31510928-6517-48fa-8d38-190aaf08a488 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:34.438004 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31510928-6517-48fa-8d38-190aaf08a488 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:34.438419 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31510928-6517-48fa-8d38-190aaf08a488 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:34.440224 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 200/394] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:12:34.475293 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50e143-d9a3-4d9f-acbc-d527148ec9ff None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:34.475576 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50e143-d9a3-4d9f-acbc-d527148ec9ff None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:34.475851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50e143-d9a3-4d9f-acbc-d527148ec9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:34.532992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5e50e143-d9a3-4d9f-acbc-d527148ec9ff None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:34.540611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5e50e143-d9a3-4d9f-acbc-d527148ec9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:34.540790 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0b70f-7291-45c6-866e-04a872e7c94f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:34.584796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a53a5-16ec-4367-bc8a-e11754bdbb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:34.585617 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a53a5-16ec-4367-bc8a-e11754bdbb82 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:34.585954 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a53a5-16ec-4367-bc8a-e11754bdbb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:34.586295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a53a5-16ec-4367-bc8a-e11754bdbb82 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623/groups/94a10a45510d47b0888ba9b04a64ab3c/roles/a507b36f2493428fbb8fcdc4fbad6911` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:34.590483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a53a5-16ec-4367-bc8a-e11754bdbb82 None admin] RBAC: Authorizing `identity:create_grant(project_id=c22b8f7f1cc4484180061823f1584623, group_id=94a10a45510d47b0888ba9b04a64ab3c, role_id=a507b36f2493428fbb8fcdc4fbad6911)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:34.592391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a53a5-16ec-4367-bc8a-e11754bdbb82 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:34.615638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 195/395] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Aug 11 16:12:34 2022] PUT /identity/v3/projects/c22b8f7f1cc4484180061823f1584623/groups/94a10a45510d47b0888ba9b04a64ab3c/roles/a507b36f2493428fbb8fcdc4fbad6911 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:12:34.639783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:34.731226 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 201/396] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:34.759530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a53a5-16ec-4367-bc8a-e11754bdbb82 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:34.857943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:34.929925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a53a5-16ec-4367-bc8a-e11754bdbb82 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:34.972237 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed90795-a425-42a6-824d-c4779bd3e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:34.972920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed90795-a425-42a6-824d-c4779bd3e804 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:34.973198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed90795-a425-42a6-824d-c4779bd3e804 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:34.973465 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed90795-a425-42a6-824d-c4779bd3e804 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:34.990519 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed90795-a425-42a6-824d-c4779bd3e804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-9ed90795-a425-42a6-824d-c4779bd3e804 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:34.995734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:34.996618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:34.997499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:34.997499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:34.997499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:34.997499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:34.997499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:34.997499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:34.997499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:34.997499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:34.997499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:34.997499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:34.997499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:34.997499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:34.997499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 196/397] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:35.004438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50e143-d9a3-4d9f-acbc-d527148ec9ff None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:35.131653 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50e143-d9a3-4d9f-acbc-d527148ec9ff None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:35.178003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd76d68-ca05-42e3-a6d4-ecc096848619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:35.178991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd76d68-ca05-42e3-a6d4-ecc096848619 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:35.179464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd76d68-ca05-42e3-a6d4-ecc096848619 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:35.179931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd76d68-ca05-42e3-a6d4-ecc096848619 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:35.180819 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd76d68-ca05-42e3-a6d4-ecc096848619 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:35.181402 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd76d68-ca05-42e3-a6d4-ecc096848619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:35.182961 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd76d68-ca05-42e3-a6d4-ecc096848619 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:35.195725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 202/398] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:35.202091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed90795-a425-42a6-824d-c4779bd3e804 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:35.203147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1570130-9fae-449f-a259-1c68b88acec9 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:35.203579 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1570130-9fae-449f-a259-1c68b88acec9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:35.204017 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1570130-9fae-449f-a259-1c68b88acec9 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:35.205790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 203/399] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:12:35.216554 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6d6e5-b131-495e-ae3e-b990370234a4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:35.217064 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6d6e5-b131-495e-ae3e-b990370234a4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:35.217497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6d6e5-b131-495e-ae3e-b990370234a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:35.246135 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-edf6d6e5-b131-495e-ae3e-b990370234a4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:35.247702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-edf6d6e5-b131-495e-ae3e-b990370234a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:35.306836 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:35.354931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 204/400] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:35.384369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed90795-a425-42a6-824d-c4779bd3e804 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:35.398289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6d6e5-b131-495e-ae3e-b990370234a4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:35.407432 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:35.431822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cbffd-cdf7-4461-ade2-cc4d4a63c0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:35.432511 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cbffd-cdf7-4461-ade2-cc4d4a63c0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:35.432854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cbffd-cdf7-4461-ade2-cc4d4a63c0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:35.433128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cbffd-cdf7-4461-ade2-cc4d4a63c0e4 None admin] PATH_INFO: `/v3/groups/94a10a45510d47b0888ba9b04a64ab3c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:35.434611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402cbffd-cdf7-4461-ade2-cc4d4a63c0e4 None admin] RBAC: Authorizing `identity:get_group(group_id=94a10a45510d47b0888ba9b04a64ab3c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:35.437693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402cbffd-cdf7-4461-ade2-cc4d4a63c0e4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:35.440860 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 197/401] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Aug 11 16:12:35 2022] GET /identity/v3/groups/94a10a45510d47b0888ba9b04a64ab3c => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:35.443738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fef03f-e5b9-4e02-a979-49d10aa29876 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:35.444018 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fef03f-e5b9-4e02-a979-49d10aa29876 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:35.444287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fef03f-e5b9-4e02-a979-49d10aa29876 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:35.447442 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 198/402] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:35.448963 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fef03f-e5b9-4e02-a979-49d10aa29876 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:35.571475 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6d6e5-b131-495e-ae3e-b990370234a4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:35.583618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fef03f-e5b9-4e02-a979-49d10aa29876 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:35.610189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944d7a9-ae46-46dd-97ab-e1d6a839fada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:35.611817 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944d7a9-ae46-46dd-97ab-e1d6a839fada None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:35.612333 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944d7a9-ae46-46dd-97ab-e1d6a839fada None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:35.612832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944d7a9-ae46-46dd-97ab-e1d6a839fada None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:35.627241 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944d7a9-ae46-46dd-97ab-e1d6a839fada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:35.629510 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da0080-58b2-4e75-84c0-bc19e27b63e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:35.630181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0080-58b2-4e75-84c0-bc19e27b63e0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:35.630442 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0080-58b2-4e75-84c0-bc19e27b63e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:35.630708 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0080-58b2-4e75-84c0-bc19e27b63e0 None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:35.631878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da0080-58b2-4e75-84c0-bc19e27b63e0 None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:35.633323 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da0080-58b2-4e75-84c0-bc19e27b63e0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a944d7a9-ae46-46dd-97ab-e1d6a839fada None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:35.634470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:35.635342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:35.636145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:35.636145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:35.636145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:35.636145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:35.636145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:35.636145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:35.636145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:35.636145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:35.636145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:35.636145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:35.636145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:35.636145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:35.636872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 199/403] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:35 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:35.636872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0f43e-8195-49ab-b902-457977b949e5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:35.636872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0f43e-8195-49ab-b902-457977b949e5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:35.637064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0f43e-8195-49ab-b902-457977b949e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:35.639117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 205/404] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:12:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:35.644877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944d7a9-ae46-46dd-97ab-e1d6a839fada None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:35.662883 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-22a0f43e-8195-49ab-b902-457977b949e5 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:35.664692 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-22a0f43e-8195-49ab-b902-457977b949e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:35.680007 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:35.732816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:35.754535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 200/405] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:35.755619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0f43e-8195-49ab-b902-457977b949e5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:35.779510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944d7a9-ae46-46dd-97ab-e1d6a839fada None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:35.820820 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee6589-87c3-4369-b740-163eb395b695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:35.821427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee6589-87c3-4369-b740-163eb395b695 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:35.821700 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee6589-87c3-4369-b740-163eb395b695 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:35.821968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee6589-87c3-4369-b740-163eb395b695 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:35.822775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee6589-87c3-4369-b740-163eb395b695 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:35.823079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee6589-87c3-4369-b740-163eb395b695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:35.824437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee6589-87c3-4369-b740-163eb395b695 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:35.834499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 206/406] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:35.835342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee6589-87c3-4369-b740-163eb395b695 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:35.883033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0f43e-8195-49ab-b902-457977b949e5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:35.929309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f2688-75e6-40c2-a833-5248fe41cf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:35.929896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f2688-75e6-40c2-a833-5248fe41cf06 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:35.930173 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f2688-75e6-40c2-a833-5248fe41cf06 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:35.930439 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f2688-75e6-40c2-a833-5248fe41cf06 None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36/groups/94a10a45510d47b0888ba9b04a64ab3c/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:35.933254 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f2688-75e6-40c2-a833-5248fe41cf06 None admin] RBAC: Authorizing `identity:create_grant(project_id=75c18326de4348a5851e485deb998c36, group_id=94a10a45510d47b0888ba9b04a64ab3c, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:35.935563 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f2688-75e6-40c2-a833-5248fe41cf06 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:35.959441 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 201/407] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Aug 11 16:12:35 2022] PUT /identity/v3/projects/75c18326de4348a5851e485deb998c36/groups/94a10a45510d47b0888ba9b04a64ab3c/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:35.960694 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f2688-75e6-40c2-a833-5248fe41cf06 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:35.971427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:35.985096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee6589-87c3-4369-b740-163eb395b695 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:36.028738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf7f7-05e8-47a8-be0a-24d2fb8ee31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:36.029485 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf7f7-05e8-47a8-be0a-24d2fb8ee31b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:36.029792 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf7f7-05e8-47a8-be0a-24d2fb8ee31b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:36.030110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf7f7-05e8-47a8-be0a-24d2fb8ee31b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:36.045310 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bf7f7-05e8-47a8-be0a-24d2fb8ee31b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-895bf7f7-05e8-47a8-be0a-24d2fb8ee31b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:36.052323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:36.053307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:36.054088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:36.054088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:36.054088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:36.054088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:36.054088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:36.054088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:36.054088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:36.054088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:36.054088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:36.054088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:36.054088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:12:36.054088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:36.054088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 207/408] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:12:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:36.059188 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf7f7-05e8-47a8-be0a-24d2fb8ee31b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:36.063921 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:36.190430 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf7f7-05e8-47a8-be0a-24d2fb8ee31b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:36.205166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f2688-75e6-40c2-a833-5248fe41cf06 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:36.233284 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60f33a-88f1-4db5-a365-0d148d55db33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:36.233931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60f33a-88f1-4db5-a365-0d148d55db33 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:36.234287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60f33a-88f1-4db5-a365-0d148d55db33 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:36.234571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60f33a-88f1-4db5-a365-0d148d55db33 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:36.235311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60f33a-88f1-4db5-a365-0d148d55db33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:36.235630 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60f33a-88f1-4db5-a365-0d148d55db33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:36.241063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60f33a-88f1-4db5-a365-0d148d55db33 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:36.246689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 208/409] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:36.251951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60f33a-88f1-4db5-a365-0d148d55db33 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:36.279010 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:36.280658 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a52ef-d5b3-4476-8d78-d1ab32eb68c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:36.281312 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a52ef-d5b3-4476-8d78-d1ab32eb68c4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:36.281593 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a52ef-d5b3-4476-8d78-d1ab32eb68c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:36.281861 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a52ef-d5b3-4476-8d78-d1ab32eb68c4 None admin] PATH_INFO: `/v3/groups/94a10a45510d47b0888ba9b04a64ab3c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:36.284287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a52ef-d5b3-4476-8d78-d1ab32eb68c4 None admin] RBAC: Authorizing `identity:get_group(group_id=94a10a45510d47b0888ba9b04a64ab3c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:36.286782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a52ef-d5b3-4476-8d78-d1ab32eb68c4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:36.291368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 202/410] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Aug 11 16:12:35 2022] GET /identity/v3/groups/94a10a45510d47b0888ba9b04a64ab3c => generated 226 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:36.296447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a52ef-d5b3-4476-8d78-d1ab32eb68c4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:36.422461 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60f33a-88f1-4db5-a365-0d148d55db33 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:36.444714 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a52ef-d5b3-4476-8d78-d1ab32eb68c4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:36.460881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:36.498298 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e184e-3b12-494a-a357-56ea8770e12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:36.499398 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e184e-3b12-494a-a357-56ea8770e12b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:36.499884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e184e-3b12-494a-a357-56ea8770e12b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:36.500390 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e184e-3b12-494a-a357-56ea8770e12b None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:36.501815 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e184e-3b12-494a-a357-56ea8770e12b None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:36.503720 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e184e-3b12-494a-a357-56ea8770e12b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:36.506685 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 203/411] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:36 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:36.508444 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f2b9b-084e-412a-8705-07f8f9b675fb None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:36.508954 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f2b9b-084e-412a-8705-07f8f9b675fb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:36.509430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f2b9b-084e-412a-8705-07f8f9b675fb None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:36.511287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 204/412] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:36.511620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca6be3-ab1b-4667-88ab-1225399c0175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:36.512258 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca6be3-ab1b-4667-88ab-1225399c0175 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:36.512538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca6be3-ab1b-4667-88ab-1225399c0175 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:36.512846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca6be3-ab1b-4667-88ab-1225399c0175 None admin] PATH_INFO: `/v3/groups/983accc5efb1438583bc542fa93552bb` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:36.513042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f2b9b-084e-412a-8705-07f8f9b675fb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:36.517655 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca6be3-ab1b-4667-88ab-1225399c0175 None admin] RBAC: Authorizing `identity:get_group(group_id=983accc5efb1438583bc542fa93552bb)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:36.519104 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca6be3-ab1b-4667-88ab-1225399c0175 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:36.528637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 209/413] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Aug 11 16:12:36 2022] GET /identity/v3/groups/983accc5efb1438583bc542fa93552bb => generated 229 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:36.528637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805caeb-9ead-44c2-8f20-519d89811333 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:36.528637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805caeb-9ead-44c2-8f20-519d89811333 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:36.528637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805caeb-9ead-44c2-8f20-519d89811333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:36.541811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0805caeb-9ead-44c2-8f20-519d89811333 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:36.543168 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0805caeb-9ead-44c2-8f20-519d89811333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:36.623204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f2b9b-084e-412a-8705-07f8f9b675fb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:36.632003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 210/414] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:36.633176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805caeb-9ead-44c2-8f20-519d89811333 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:36.658972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:36.675752 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e12e39-117f-47e3-a658-54f663df0999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:36.677857 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e12e39-117f-47e3-a658-54f663df0999 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:36.678609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e12e39-117f-47e3-a658-54f663df0999 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:36.679081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e12e39-117f-47e3-a658-54f663df0999 None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36/groups/94a10a45510d47b0888ba9b04a64ab3c/roles/a507b36f2493428fbb8fcdc4fbad6911` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:36.682383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e12e39-117f-47e3-a658-54f663df0999 None admin] RBAC: Authorizing `identity:create_grant(project_id=75c18326de4348a5851e485deb998c36, group_id=94a10a45510d47b0888ba9b04a64ab3c, role_id=a507b36f2493428fbb8fcdc4fbad6911)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:36.684868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e12e39-117f-47e3-a658-54f663df0999 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:36.703792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 205/415] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Aug 11 16:12:36 2022] PUT /identity/v3/projects/75c18326de4348a5851e485deb998c36/groups/94a10a45510d47b0888ba9b04a64ab3c/roles/a507b36f2493428fbb8fcdc4fbad6911 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:36.705063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e12e39-117f-47e3-a658-54f663df0999 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:36.781133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805caeb-9ead-44c2-8f20-519d89811333 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:36.796114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:36.826890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658e57d-3b85-4161-b2c9-ecf688a6963c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:36.828486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658e57d-3b85-4161-b2c9-ecf688a6963c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:36.829026 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658e57d-3b85-4161-b2c9-ecf688a6963c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:36.829522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658e57d-3b85-4161-b2c9-ecf688a6963c None admin] PATH_INFO: `/v3/projects/bc786cd53c124382a4c7cfd8b7e41636` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:36.831022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658e57d-3b85-4161-b2c9-ecf688a6963c None admin] RBAC: Authorizing `identity:get_project(project_id=bc786cd53c124382a4c7cfd8b7e41636)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:36.833645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658e57d-3b85-4161-b2c9-ecf688a6963c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:36.835988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 211/416] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:36 2022] GET /identity/v3/projects/bc786cd53c124382a4c7cfd8b7e41636 => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:36.845679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658e57d-3b85-4161-b2c9-ecf688a6963c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:36.915696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e12e39-117f-47e3-a658-54f663df0999 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:36.955035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:36.956330 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf25b6-a0ee-486a-ad46-6558b39d673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:36.957105 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf25b6-a0ee-486a-ad46-6558b39d673d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:36.957382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf25b6-a0ee-486a-ad46-6558b39d673d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:36.957726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf25b6-a0ee-486a-ad46-6558b39d673d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:36.978697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf25b6-a0ee-486a-ad46-6558b39d673d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5bbf25b6-a0ee-486a-ad46-6558b39d673d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:36.988899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:36.990331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:36.991110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:36.991110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:36.991110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:36.991110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:36.991110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:36.991110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:36.991110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:36.991110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:36.991110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:36.991110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:36.991110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:36.991110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:36.994751 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 206/417] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:36.996688 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf25b6-a0ee-486a-ad46-6558b39d673d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:37.001509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658e57d-3b85-4161-b2c9-ecf688a6963c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:37.044657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c09aa-5cd4-4a49-bdee-9a8b9b51aaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:37.045416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c09aa-5cd4-4a49-bdee-9a8b9b51aaa3 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:37.045701 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c09aa-5cd4-4a49-bdee-9a8b9b51aaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:37.045968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c09aa-5cd4-4a49-bdee-9a8b9b51aaa3 None admin] PATH_INFO: `/v3/projects/bc786cd53c124382a4c7cfd8b7e41636/groups/983accc5efb1438583bc542fa93552bb/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:37.048724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c09aa-5cd4-4a49-bdee-9a8b9b51aaa3 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc786cd53c124382a4c7cfd8b7e41636, group_id=983accc5efb1438583bc542fa93552bb, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:37.050136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c09aa-5cd4-4a49-bdee-9a8b9b51aaa3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:37.077891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 212/418] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Aug 11 16:12:36 2022] PUT /identity/v3/projects/bc786cd53c124382a4c7cfd8b7e41636/groups/983accc5efb1438583bc542fa93552bb/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:37.159804 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf25b6-a0ee-486a-ad46-6558b39d673d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:37.161560 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:37.205172 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5998f44-0d91-4b3d-8b91-1515af04c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:37.205744 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5998f44-0d91-4b3d-8b91-1515af04c0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:37.206266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5998f44-0d91-4b3d-8b91-1515af04c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:37.206337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5998f44-0d91-4b3d-8b91-1515af04c0d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:37.206993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5998f44-0d91-4b3d-8b91-1515af04c0d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:37.207294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5998f44-0d91-4b3d-8b91-1515af04c0d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:37.209357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5998f44-0d91-4b3d-8b91-1515af04c0d3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:37.224386 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 207/419] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:37.229852 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c09aa-5cd4-4a49-bdee-9a8b9b51aaa3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:37.256405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dddaf-a4b8-419d-8cd5-6b2fbc21cd5f None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:37.256765 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dddaf-a4b8-419d-8cd5-6b2fbc21cd5f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:37.257029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dddaf-a4b8-419d-8cd5-6b2fbc21cd5f None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:37.258402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 208/420] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:37.264171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e42b2-d8fc-4e17-9b8c-1126cf9a4986 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:37.264502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e42b2-d8fc-4e17-9b8c-1126cf9a4986 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:37.265241 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e42b2-d8fc-4e17-9b8c-1126cf9a4986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:37.287425 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c98e42b2-d8fc-4e17-9b8c-1126cf9a4986 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:37.288681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c98e42b2-d8fc-4e17-9b8c-1126cf9a4986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:37.374058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 209/421] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:37.400936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e42b2-d8fc-4e17-9b8c-1126cf9a4986 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:37.410840 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c09aa-5cd4-4a49-bdee-9a8b9b51aaa3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:37.453364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736d831-a90c-4335-b97d-e2c6a322a8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:37.454094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736d831-a90c-4335-b97d-e2c6a322a8db None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:37.454850 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736d831-a90c-4335-b97d-e2c6a322a8db None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:37.455101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736d831-a90c-4335-b97d-e2c6a322a8db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:37.484512 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:37.548712 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736d831-a90c-4335-b97d-e2c6a322a8db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:37.550964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736d831-a90c-4335-b97d-e2c6a322a8db None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:37.597318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:37.622737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e42b2-d8fc-4e17-9b8c-1126cf9a4986 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:37.667912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 213/422] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:37.674224 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736d831-a90c-4335-b97d-e2c6a322a8db None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:37.714156 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc83a6-f31f-48c9-a853-cb580c545624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:37.714789 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc83a6-f31f-48c9-a853-cb580c545624 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:37.715066 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc83a6-f31f-48c9-a853-cb580c545624 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:37.715330 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc83a6-f31f-48c9-a853-cb580c545624 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:37.718663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:37.745234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc83a6-f31f-48c9-a853-cb580c545624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-81fc83a6-f31f-48c9-a853-cb580c545624 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:37.749897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:37.750762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:37.751539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:37.751539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:37.751539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:37.751539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:37.751539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:37.751539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:37.751539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:37.751539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:37.751539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:37.751539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:37.751539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:37.751539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:37.751539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 210/423] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:12:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:12:37.757571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc83a6-f31f-48c9-a853-cb580c545624 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:37.812614 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736d831-a90c-4335-b97d-e2c6a322a8db None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:37.850182 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271e394-c7eb-4d6a-afdd-2803c15c0ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:37.850812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271e394-c7eb-4d6a-afdd-2803c15c0ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:37.851088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271e394-c7eb-4d6a-afdd-2803c15c0ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:37.851359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271e394-c7eb-4d6a-afdd-2803c15c0ec2 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:37.853115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271e394-c7eb-4d6a-afdd-2803c15c0ec2 None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:37.854537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271e394-c7eb-4d6a-afdd-2803c15c0ec2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:37.857727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 214/424] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:37 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:37.862597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271e394-c7eb-4d6a-afdd-2803c15c0ec2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:37.928413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc83a6-f31f-48c9-a853-cb580c545624 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:38.003530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c34145-973a-4ce2-9e0a-4037c8603064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:38.004058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c34145-973a-4ce2-9e0a-4037c8603064 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:38.004335 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c34145-973a-4ce2-9e0a-4037c8603064 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:38.004619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c34145-973a-4ce2-9e0a-4037c8603064 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:38.005327 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c34145-973a-4ce2-9e0a-4037c8603064 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:38.005628 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c34145-973a-4ce2-9e0a-4037c8603064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:38.007013 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c34145-973a-4ce2-9e0a-4037c8603064 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:38.010282 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271e394-c7eb-4d6a-afdd-2803c15c0ec2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:38.025081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:38.030277 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 211/425] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:38.036677 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c34145-973a-4ce2-9e0a-4037c8603064 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:38.049707 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f2cd0-002b-43c0-8b37-508dfcac7a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:38.050350 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f2cd0-002b-43c0-8b37-508dfcac7a19 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:38.050632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f2cd0-002b-43c0-8b37-508dfcac7a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:38.050910 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f2cd0-002b-43c0-8b37-508dfcac7a19 None admin] PATH_INFO: `/v3/groups/94a10a45510d47b0888ba9b04a64ab3c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:38.052951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f2cd0-002b-43c0-8b37-508dfcac7a19 None admin] RBAC: Authorizing `identity:get_group(group_id=94a10a45510d47b0888ba9b04a64ab3c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:38.054422 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f2cd0-002b-43c0-8b37-508dfcac7a19 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:38.056029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 215/426] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Aug 11 16:12:37 2022] GET /identity/v3/groups/94a10a45510d47b0888ba9b04a64ab3c => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:38.063091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f2cd0-002b-43c0-8b37-508dfcac7a19 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:38.075651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:38.217187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c34145-973a-4ce2-9e0a-4037c8603064 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:38.262627 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f2cd0-002b-43c0-8b37-508dfcac7a19 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:38.285865 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c02ff-36c1-4cc0-ac64-70e766c07382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:38.286497 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c02ff-36c1-4cc0-ac64-70e766c07382 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:38.286772 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c02ff-36c1-4cc0-ac64-70e766c07382 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:38.287041 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c02ff-36c1-4cc0-ac64-70e766c07382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:38.301260 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a428c46-9c47-4070-aa24-9291470f33ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:38.302382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a428c46-9c47-4070-aa24-9291470f33ae None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:38.302657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a428c46-9c47-4070-aa24-9291470f33ae None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:38.302928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a428c46-9c47-4070-aa24-9291470f33ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:38.303649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a428c46-9c47-4070-aa24-9291470f33ae None admin] RBAC: Adding query filter params (group.id=94a10a45510d47b0888ba9b04a64ab3c, role.id=87abba8d76c2420c97d9d5f2dbb6b540, scope.project.id=c22b8f7f1cc4484180061823f1584623) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:38.303954 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a428c46-9c47-4070-aa24-9291470f33ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:38.305419 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a428c46-9c47-4070-aa24-9291470f33ae None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:38.311731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 216/427] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Aug 11 16:12:38 2022] GET /identity/v3/role_assignments?group.id=94a10a45510d47b0888ba9b04a64ab3c&scope.project.id=c22b8f7f1cc4484180061823f1584623&role.id=87abba8d76c2420c97d9d5f2dbb6b540 => generated 611 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:38.408093 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c02ff-36c1-4cc0-ac64-70e766c07382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:38.409612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c02ff-36c1-4cc0-ac64-70e766c07382 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:38.438677 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:38.553069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 212/428] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:38.560711 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a428c46-9c47-4070-aa24-9291470f33ae None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:38.618583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:38.687436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a428c46-9c47-4070-aa24-9291470f33ae None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:38.722936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a594b6-7147-434e-a657-ac2ed7e6f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:38.723619 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a594b6-7147-434e-a657-ac2ed7e6f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:38.723933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a594b6-7147-434e-a657-ac2ed7e6f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:38.724231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a594b6-7147-434e-a657-ac2ed7e6f1e2 None admin] PATH_INFO: `/v3/projects/c22b8f7f1cc4484180061823f1584623` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:38.725429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a594b6-7147-434e-a657-ac2ed7e6f1e2 None admin] RBAC: Authorizing `identity:get_project(project_id=c22b8f7f1cc4484180061823f1584623)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:38.726872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a594b6-7147-434e-a657-ac2ed7e6f1e2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:38.728840 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 217/429] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:38 2022] GET /identity/v3/projects/c22b8f7f1cc4484180061823f1584623 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:38.734366 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c02ff-36c1-4cc0-ac64-70e766c07382 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:38.838194 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7d508-e46f-456e-837e-398f191fad78 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:38.838796 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7d508-e46f-456e-837e-398f191fad78 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:38.839272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7d508-e46f-456e-837e-398f191fad78 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:38.841068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 218/430] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:12:38.847117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c094799-1b06-4ba2-9dd6-6f8010e9e6d5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:38.847668 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c094799-1b06-4ba2-9dd6-6f8010e9e6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:38.848041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c094799-1b06-4ba2-9dd6-6f8010e9e6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:38.856556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c02ff-36c1-4cc0-ac64-70e766c07382 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:38.872133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5c094799-1b06-4ba2-9dd6-6f8010e9e6d5 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:38.874533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5c094799-1b06-4ba2-9dd6-6f8010e9e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:38.878545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:38.902495 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d85a20-8848-41d0-acfa-8de1a22cc8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:38.903974 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d85a20-8848-41d0-acfa-8de1a22cc8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:38.904529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d85a20-8848-41d0-acfa-8de1a22cc8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:38.905257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d85a20-8848-41d0-acfa-8de1a22cc8d0 None admin] PATH_INFO: `/v3/groups/94a10a45510d47b0888ba9b04a64ab3c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:38.906820 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d85a20-8848-41d0-acfa-8de1a22cc8d0 None admin] RBAC: Authorizing `identity:get_group(group_id=94a10a45510d47b0888ba9b04a64ab3c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:38.909099 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d85a20-8848-41d0-acfa-8de1a22cc8d0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:38.916406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 213/431] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Aug 11 16:12:38 2022] GET /identity/v3/groups/94a10a45510d47b0888ba9b04a64ab3c => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:38.919000 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d85a20-8848-41d0-acfa-8de1a22cc8d0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:38.960492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 219/432] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:38.984100 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9c585-0a7e-454b-b770-31bc6aa1c098 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:38.984860 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9c585-0a7e-454b-b770-31bc6aa1c098 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:38.985357 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9c585-0a7e-454b-b770-31bc6aa1c098 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:38.988303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 220/433] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:12:38.991938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba711cc-ca3b-4d7e-b209-c608ad09d5ed None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:38.992424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba711cc-ca3b-4d7e-b209-c608ad09d5ed None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:38.993006 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba711cc-ca3b-4d7e-b209-c608ad09d5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:39.016403 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-bba711cc-ca3b-4d7e-b209-c608ad09d5ed None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:39.016403 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bba711cc-ca3b-4d7e-b209-c608ad09d5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:39.048830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d85a20-8848-41d0-acfa-8de1a22cc8d0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:39.053786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:39.110671 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 221/434] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:39.110878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44a2dc-782d-4c45-84dc-5ea996426090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:39.111663 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44a2dc-782d-4c45-84dc-5ea996426090 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:39.111846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba711cc-ca3b-4d7e-b209-c608ad09d5ed None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:39.116765 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44a2dc-782d-4c45-84dc-5ea996426090 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:39.117031 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44a2dc-782d-4c45-84dc-5ea996426090 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:39.117871 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44a2dc-782d-4c45-84dc-5ea996426090 None admin] RBAC: Adding query filter params (group.id=94a10a45510d47b0888ba9b04a64ab3c, role.id=a507b36f2493428fbb8fcdc4fbad6911, scope.project.id=c22b8f7f1cc4484180061823f1584623) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:39.118185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44a2dc-782d-4c45-84dc-5ea996426090 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:39.124620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44a2dc-782d-4c45-84dc-5ea996426090 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:39.126610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 214/435] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Aug 11 16:12:38 2022] GET /identity/v3/role_assignments?group.id=94a10a45510d47b0888ba9b04a64ab3c&scope.project.id=c22b8f7f1cc4484180061823f1584623&role.id=a507b36f2493428fbb8fcdc4fbad6911 => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:39.138737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44a2dc-782d-4c45-84dc-5ea996426090 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:39.201595 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:39.263422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44a2dc-782d-4c45-84dc-5ea996426090 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:39.267452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba711cc-ca3b-4d7e-b209-c608ad09d5ed None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:39.308886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db9727-5798-4540-8279-5cdbc39ad949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:39.309576 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db9727-5798-4540-8279-5cdbc39ad949 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:39.309855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db9727-5798-4540-8279-5cdbc39ad949 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:39.310128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db9727-5798-4540-8279-5cdbc39ad949 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:39.322737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bec11-8390-4e15-bc76-65185485f4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:39.323661 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bec11-8390-4e15-bc76-65185485f4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:39.323787 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db9727-5798-4540-8279-5cdbc39ad949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:39.323973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bec11-8390-4e15-bc76-65185485f4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:39.324277 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bec11-8390-4e15-bc76-65185485f4c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f1db9727-5798-4540-8279-5cdbc39ad949 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:39.330711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:39.331588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:39.332368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:39.332368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:39.332368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:39.332368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:39.332368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:39.332368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:39.332368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:39.332368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:39.332368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:39.332368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:39.332368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:39.332368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:39.332368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 215/436] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:12:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:12:39.337821 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db9727-5798-4540-8279-5cdbc39ad949 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:39.343986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bec11-8390-4e15-bc76-65185485f4c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a67bec11-8390-4e15-bc76-65185485f4c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:39.350783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:39.351654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:39.352429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:39.352429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:39.352429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:39.352429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:39.352429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:39.352429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:39.352429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:39.352429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:39.352429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:39.352429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:39.352429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 16:12:39.352429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:39.352429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 222/437] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:39.357847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bec11-8390-4e15-bc76-65185485f4c9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:39.390507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:39.457994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db9727-5798-4540-8279-5cdbc39ad949 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:39.474267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:39.487248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bec11-8390-4e15-bc76-65185485f4c9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:39.505016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202b6ba-d56c-4dad-b12d-94202f11fdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:39.505723 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202b6ba-d56c-4dad-b12d-94202f11fdc0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:39.506072 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202b6ba-d56c-4dad-b12d-94202f11fdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:39.506346 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202b6ba-d56c-4dad-b12d-94202f11fdc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:39.507015 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202b6ba-d56c-4dad-b12d-94202f11fdc0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:39.507312 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202b6ba-d56c-4dad-b12d-94202f11fdc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:39.508742 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202b6ba-d56c-4dad-b12d-94202f11fdc0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:39.520712 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 216/438] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:39.526068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2d3b8-3062-44b8-abbe-5a74c2fd0898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:39.526592 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202b6ba-d56c-4dad-b12d-94202f11fdc0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:39.526696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2d3b8-3062-44b8-abbe-5a74c2fd0898 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:39.527010 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2d3b8-3062-44b8-abbe-5a74c2fd0898 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:39.527369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2d3b8-3062-44b8-abbe-5a74c2fd0898 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:39.528014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2d3b8-3062-44b8-abbe-5a74c2fd0898 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:39.528346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2d3b8-3062-44b8-abbe-5a74c2fd0898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:39.530846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2d3b8-3062-44b8-abbe-5a74c2fd0898 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:39.544065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 223/439] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:12:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:39.549756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2d3b8-3062-44b8-abbe-5a74c2fd0898 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:39.647062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202b6ba-d56c-4dad-b12d-94202f11fdc0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:39.651369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:39.663853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2d3b8-3062-44b8-abbe-5a74c2fd0898 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:39.681176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2da4af-9726-4811-9162-fcb82b4a156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:39.681777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2da4af-9726-4811-9162-fcb82b4a156a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:39.682049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2da4af-9726-4811-9162-fcb82b4a156a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:39.682326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2da4af-9726-4811-9162-fcb82b4a156a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:39.697192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b44168-66f4-4a12-878e-26d1ca504e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:39.697782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b44168-66f4-4a12-878e-26d1ca504e66 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:39.698058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b44168-66f4-4a12-878e-26d1ca504e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:39.698326 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b44168-66f4-4a12-878e-26d1ca504e66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:39.721440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:39.750559 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2da4af-9726-4811-9162-fcb82b4a156a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:39.752030 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2da4af-9726-4811-9162-fcb82b4a156a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:39.765081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b44168-66f4-4a12-878e-26d1ca504e66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:39.766533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b44168-66f4-4a12-878e-26d1ca504e66 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:39.854366 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 217/440] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:39.854366 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4f6fa-34ea-4e3b-99ef-36652c084791 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:39.854366 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4f6fa-34ea-4e3b-99ef-36652c084791 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:39.854366 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4f6fa-34ea-4e3b-99ef-36652c084791 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:39.854366 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 218/441] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:39.855224 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4f6fa-34ea-4e3b-99ef-36652c084791 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:39.856326 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:39.869434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 224/442] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:39.870955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a730a-5bcb-41c3-8d86-aa77ff3299a6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:39.871430 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a730a-5bcb-41c3-8d86-aa77ff3299a6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:39.871878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a730a-5bcb-41c3-8d86-aa77ff3299a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:39.889063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-375a730a-5bcb-41c3-8d86-aa77ff3299a6 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:39.890227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-375a730a-5bcb-41c3-8d86-aa77ff3299a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:39.925119 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:39.955221 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 225/443] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:39.956047 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a730a-5bcb-41c3-8d86-aa77ff3299a6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:39.958645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4f6fa-34ea-4e3b-99ef-36652c084791 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:39.992530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614ef75-2120-41db-8dae-c414f450301b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:39.993192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614ef75-2120-41db-8dae-c414f450301b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:39.993469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614ef75-2120-41db-8dae-c414f450301b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:39.993744 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614ef75-2120-41db-8dae-c414f450301b None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:39.994848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614ef75-2120-41db-8dae-c414f450301b None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:39.996276 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614ef75-2120-41db-8dae-c414f450301b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:39.997927 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 219/444] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:39 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:39.998671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614ef75-2120-41db-8dae-c414f450301b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:40.059325 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a730a-5bcb-41c3-8d86-aa77ff3299a6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:40.077857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:40.093790 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614ef75-2120-41db-8dae-c414f450301b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:40.094416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c52f5-f2bd-44bf-916c-278c26324fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:40.095072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c52f5-f2bd-44bf-916c-278c26324fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:40.095353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c52f5-f2bd-44bf-916c-278c26324fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:40.095662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c52f5-f2bd-44bf-916c-278c26324fd7 None admin] PATH_INFO: `/v3/projects/75c18326de4348a5851e485deb998c36` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:40.096836 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c52f5-f2bd-44bf-916c-278c26324fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=75c18326de4348a5851e485deb998c36)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:40.098251 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c52f5-f2bd-44bf-916c-278c26324fd7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:40.100370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 226/445] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:39 2022] GET /identity/v3/projects/75c18326de4348a5851e485deb998c36 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:40.101144 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c52f5-f2bd-44bf-916c-278c26324fd7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:40.128687 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dda7e-e451-479e-8954-1c0b3cbc5516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:40.129524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dda7e-e451-479e-8954-1c0b3cbc5516 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:40.129865 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dda7e-e451-479e-8954-1c0b3cbc5516 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:40.130136 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dda7e-e451-479e-8954-1c0b3cbc5516 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:40.137840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:40.142265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1dda7e-e451-479e-8954-1c0b3cbc5516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-bf1dda7e-e451-479e-8954-1c0b3cbc5516 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:40.147047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:40.148178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:40.149012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:40.149012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:40.149012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:40.149012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:40.149012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:40.149012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:40.149012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:40.149012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:40.149012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:40.149012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:40.149012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:12:40.149012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:40.149012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 220/446] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:12:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:40.149012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dda7e-e451-479e-8954-1c0b3cbc5516 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:40.206208 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c52f5-f2bd-44bf-916c-278c26324fd7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:40.239573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554e0cc-c0be-4e2f-b350-dfaee13e7a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:40.240219 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554e0cc-c0be-4e2f-b350-dfaee13e7a41 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:40.240498 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554e0cc-c0be-4e2f-b350-dfaee13e7a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:40.240796 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554e0cc-c0be-4e2f-b350-dfaee13e7a41 None admin] PATH_INFO: `/v3/groups/94a10a45510d47b0888ba9b04a64ab3c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:40.241929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554e0cc-c0be-4e2f-b350-dfaee13e7a41 None admin] RBAC: Authorizing `identity:get_group(group_id=94a10a45510d47b0888ba9b04a64ab3c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:40.243336 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554e0cc-c0be-4e2f-b350-dfaee13e7a41 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:40.244923 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 227/447] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Aug 11 16:12:40 2022] GET /identity/v3/groups/94a10a45510d47b0888ba9b04a64ab3c => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:40.247886 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554e0cc-c0be-4e2f-b350-dfaee13e7a41 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:40.252477 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dda7e-e451-479e-8954-1c0b3cbc5516 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:40.285462 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d5156-b374-4c2d-99dc-9fbd63854b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:40.286611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d5156-b374-4c2d-99dc-9fbd63854b8a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:40.287156 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d5156-b374-4c2d-99dc-9fbd63854b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:40.287156 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d5156-b374-4c2d-99dc-9fbd63854b8a None admin] PATH_INFO: `/v3/groups/94a10a45510d47b0888ba9b04a64ab3c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:40.288203 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d5156-b374-4c2d-99dc-9fbd63854b8a None admin] RBAC: Authorizing `identity:get_group(group_id=94a10a45510d47b0888ba9b04a64ab3c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:40.289655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d5156-b374-4c2d-99dc-9fbd63854b8a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:40.291202 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 221/448] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Aug 11 16:12:40 2022] GET /identity/v3/groups/94a10a45510d47b0888ba9b04a64ab3c => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:40.291949 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d5156-b374-4c2d-99dc-9fbd63854b8a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:40.305805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:40.349034 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554e0cc-c0be-4e2f-b350-dfaee13e7a41 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:40.356418 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:40.384558 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afd71d-4814-49d4-b5f0-90d07520bd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:40.385597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afd71d-4814-49d4-b5f0-90d07520bd10 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:40.386095 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afd71d-4814-49d4-b5f0-90d07520bd10 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:40.386586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afd71d-4814-49d4-b5f0-90d07520bd10 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:40.387279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afd71d-4814-49d4-b5f0-90d07520bd10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:40.387582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afd71d-4814-49d4-b5f0-90d07520bd10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:40.389501 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afd71d-4814-49d4-b5f0-90d07520bd10 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:40.390582 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d5156-b374-4c2d-99dc-9fbd63854b8a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:40.399473 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 228/449] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:40.400284 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afd71d-4814-49d4-b5f0-90d07520bd10 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:40.432750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf80bc-689a-4ccf-9f8f-38eab241a387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:40.433348 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf80bc-689a-4ccf-9f8f-38eab241a387 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:40.433629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf80bc-689a-4ccf-9f8f-38eab241a387 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:40.433901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf80bc-689a-4ccf-9f8f-38eab241a387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:40.434614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf80bc-689a-4ccf-9f8f-38eab241a387 None admin] RBAC: Adding query filter params (group.id=94a10a45510d47b0888ba9b04a64ab3c, role.id=a507b36f2493428fbb8fcdc4fbad6911, scope.project.id=75c18326de4348a5851e485deb998c36) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:40.434918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf80bc-689a-4ccf-9f8f-38eab241a387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:40.436331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf80bc-689a-4ccf-9f8f-38eab241a387 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:40.441955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 222/450] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Aug 11 16:12:40 2022] GET /identity/v3/role_assignments?group.id=94a10a45510d47b0888ba9b04a64ab3c&scope.project.id=75c18326de4348a5851e485deb998c36&role.id=a507b36f2493428fbb8fcdc4fbad6911 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:40.442844 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf80bc-689a-4ccf-9f8f-38eab241a387 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:40.532807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afd71d-4814-49d4-b5f0-90d07520bd10 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:40.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:40.564839 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf80bc-689a-4ccf-9f8f-38eab241a387 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:40.573625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fea04-c65d-4fda-9b5e-1a2d6372432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:40.574245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fea04-c65d-4fda-9b5e-1a2d6372432e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:40.574518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fea04-c65d-4fda-9b5e-1a2d6372432e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:40.574797 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fea04-c65d-4fda-9b5e-1a2d6372432e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:40.575625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fea04-c65d-4fda-9b5e-1a2d6372432e None admin] RBAC: Adding query filter params (group.id=94a10a45510d47b0888ba9b04a64ab3c, role.id=87abba8d76c2420c97d9d5f2dbb6b540, scope.project.id=75c18326de4348a5851e485deb998c36) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:40.575970 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fea04-c65d-4fda-9b5e-1a2d6372432e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:40.577569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fea04-c65d-4fda-9b5e-1a2d6372432e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:40.584853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 229/451] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Aug 11 16:12:40 2022] GET /identity/v3/role_assignments?group.id=94a10a45510d47b0888ba9b04a64ab3c&scope.project.id=75c18326de4348a5851e485deb998c36&role.id=87abba8d76c2420c97d9d5f2dbb6b540 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:40.615069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:40.621752 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8753fd-ece3-4857-85e1-1ad3e693b338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:40.622371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8753fd-ece3-4857-85e1-1ad3e693b338 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:40.622673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8753fd-ece3-4857-85e1-1ad3e693b338 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:40.622938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8753fd-ece3-4857-85e1-1ad3e693b338 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:40.701814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8753fd-ece3-4857-85e1-1ad3e693b338 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:40.703308 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8753fd-ece3-4857-85e1-1ad3e693b338 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:40.803912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 223/452] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:40.809510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fea04-c65d-4fda-9b5e-1a2d6372432e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:40.912964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fea04-c65d-4fda-9b5e-1a2d6372432e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:40.947075 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3a526-2884-4071-9bdf-27361e378422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:40.947695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3a526-2884-4071-9bdf-27361e378422 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:40.947973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3a526-2884-4071-9bdf-27361e378422 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:40.948242 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3a526-2884-4071-9bdf-27361e378422 None admin] PATH_INFO: `/v3/projects/bc786cd53c124382a4c7cfd8b7e41636` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:40.949389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3a526-2884-4071-9bdf-27361e378422 None admin] RBAC: Authorizing `identity:get_project(project_id=bc786cd53c124382a4c7cfd8b7e41636)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:40.950803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3a526-2884-4071-9bdf-27361e378422 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:40.952744 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 230/453] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:12:40 2022] GET /identity/v3/projects/bc786cd53c124382a4c7cfd8b7e41636 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:40.958078 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8753fd-ece3-4857-85e1-1ad3e693b338 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:40.987796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:41.066995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8753fd-ece3-4857-85e1-1ad3e693b338 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:41.113264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d84fc-b004-4cdd-b11e-6e3814c4f7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:41.113883 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d84fc-b004-4cdd-b11e-6e3814c4f7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:41.114716 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d84fc-b004-4cdd-b11e-6e3814c4f7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:41.114982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d84fc-b004-4cdd-b11e-6e3814c4f7a6 None admin] PATH_INFO: `/v3/groups/983accc5efb1438583bc542fa93552bb` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:41.116057 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d84fc-b004-4cdd-b11e-6e3814c4f7a6 None admin] RBAC: Authorizing `identity:get_group(group_id=983accc5efb1438583bc542fa93552bb)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:41.117516 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d84fc-b004-4cdd-b11e-6e3814c4f7a6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:41.119059 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 224/454] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Aug 11 16:12:40 2022] GET /identity/v3/groups/983accc5efb1438583bc542fa93552bb => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:41.125267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3a526-2884-4071-9bdf-27361e378422 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:41.173422 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:41.223079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3a526-2884-4071-9bdf-27361e378422 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:41.256326 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc83e3-aa87-4b6b-9d1a-9f24b3b5ee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:41.256945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc83e3-aa87-4b6b-9d1a-9f24b3b5ee39 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:41.257225 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc83e3-aa87-4b6b-9d1a-9f24b3b5ee39 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:41.257495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc83e3-aa87-4b6b-9d1a-9f24b3b5ee39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:41.258205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc83e3-aa87-4b6b-9d1a-9f24b3b5ee39 None admin] RBAC: Adding query filter params (group.id=983accc5efb1438583bc542fa93552bb, role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=bc786cd53c124382a4c7cfd8b7e41636) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:41.258510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc83e3-aa87-4b6b-9d1a-9f24b3b5ee39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:41.259926 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc83e3-aa87-4b6b-9d1a-9f24b3b5ee39 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:41.265474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 231/455] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Aug 11 16:12:41 2022] GET /identity/v3/role_assignments?group.id=983accc5efb1438583bc542fa93552bb&scope.project.id=bc786cd53c124382a4c7cfd8b7e41636&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:43.629422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0300b-1343-49ea-8782-7bef2bb4661b None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:43.629938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0300b-1343-49ea-8782-7bef2bb4661b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:43.629938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0300b-1343-49ea-8782-7bef2bb4661b None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:43.631584 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 225/456] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:43.636637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96234bc-f9c3-4e4c-be93-8abdf9b3d70a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:43.637020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96234bc-f9c3-4e4c-be93-8abdf9b3d70a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:43.637198 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96234bc-f9c3-4e4c-be93-8abdf9b3d70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:43.662157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e96234bc-f9c3-4e4c-be93-8abdf9b3d70a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:43.663367 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e96234bc-f9c3-4e4c-be93-8abdf9b3d70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:43.755859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 232/457] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:43.789922 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0300b-1343-49ea-8782-7bef2bb4661b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:43.913758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:43.919501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0300b-1343-49ea-8782-7bef2bb4661b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:43.971154 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0151aea-0196-45df-b0d7-7a30f675a3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:43.971783 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0151aea-0196-45df-b0d7-7a30f675a3df None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:43.972062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0151aea-0196-45df-b0d7-7a30f675a3df None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:43.972331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0151aea-0196-45df-b0d7-7a30f675a3df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:43.988328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0151aea-0196-45df-b0d7-7a30f675a3df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:43.990357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0151aea-0196-45df-b0d7-7a30f675a3df None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f0151aea-0196-45df-b0d7-7a30f675a3df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:44.018896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:44.019823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:44.020737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:44.020737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:44.020737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:44.020737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 226/458] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:44.027222 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96234bc-f9c3-4e4c-be93-8abdf9b3d70a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:44.079460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e380c-7ab3-4807-a857-b69cbaee51ab None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:44.079782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e380c-7ab3-4807-a857-b69cbaee51ab None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:44.080007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e380c-7ab3-4807-a857-b69cbaee51ab None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:44.081609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 227/459] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:44.083750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:44.087122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3d497-4df1-4ca7-9fd2-e5a86e555f35 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:44.087656 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3d497-4df1-4ca7-9fd2-e5a86e555f35 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:44.087934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3d497-4df1-4ca7-9fd2-e5a86e555f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:44.107992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-aea3d497-4df1-4ca7-9fd2-e5a86e555f35 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:44.109260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-aea3d497-4df1-4ca7-9fd2-e5a86e555f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:44.150053 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96234bc-f9c3-4e4c-be93-8abdf9b3d70a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:44.191784 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90435c79-9cc6-4bc1-bb6b-58474f6ce80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:44.192433 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90435c79-9cc6-4bc1-bb6b-58474f6ce80c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:44.192768 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90435c79-9cc6-4bc1-bb6b-58474f6ce80c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:44.193039 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90435c79-9cc6-4bc1-bb6b-58474f6ce80c None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:44.193688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90435c79-9cc6-4bc1-bb6b-58474f6ce80c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:44.193986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90435c79-9cc6-4bc1-bb6b-58474f6ce80c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:44.195358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90435c79-9cc6-4bc1-bb6b-58474f6ce80c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:44.197141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 228/460] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:44.198483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315573f1-6f3c-4003-b5c9-f863c7590736 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:44.198764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315573f1-6f3c-4003-b5c9-f863c7590736 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:44.199035 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315573f1-6f3c-4003-b5c9-f863c7590736 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:44.200247 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 229/461] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:44.210533 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72d3a6-4c47-4bce-bbdd-f0afc5e9e55b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:44.210771 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72d3a6-4c47-4bce-bbdd-f0afc5e9e55b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:44.210997 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72d3a6-4c47-4bce-bbdd-f0afc5e9e55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:44.219830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 233/462] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:44.221629 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90435c79-9cc6-4bc1-bb6b-58474f6ce80c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:44.234287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7f72d3a6-4c47-4bce-bbdd-f0afc5e9e55b None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:44.235480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7f72d3a6-4c47-4bce-bbdd-f0afc5e9e55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:44.322303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 230/463] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:44.323521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72d3a6-4c47-4bce-bbdd-f0afc5e9e55b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:44.338531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:44.341777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90435c79-9cc6-4bc1-bb6b-58474f6ce80c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:44.343379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:44.382946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042b121-5c98-49cd-b281-4cb40a19286a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:44.383677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042b121-5c98-49cd-b281-4cb40a19286a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:44.383955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042b121-5c98-49cd-b281-4cb40a19286a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:44.384225 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042b121-5c98-49cd-b281-4cb40a19286a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:44.397577 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042b121-5c98-49cd-b281-4cb40a19286a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:44.399142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042b121-5c98-49cd-b281-4cb40a19286a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-4042b121-5c98-49cd-b281-4cb40a19286a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:44.414878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:44.415793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:44.416660 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:44.416660 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:44.416660 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:44.416660 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 234/464] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:44.422371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042b121-5c98-49cd-b281-4cb40a19286a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:44.452209 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72d3a6-4c47-4bce-bbdd-f0afc5e9e55b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:44.509749 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9164a4-0de8-4e0b-8f3e-6238388b1d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:44.511083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9164a4-0de8-4e0b-8f3e-6238388b1d0d None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:44.511631 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9164a4-0de8-4e0b-8f3e-6238388b1d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:44.512453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9164a4-0de8-4e0b-8f3e-6238388b1d0d None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:44.513590 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9164a4-0de8-4e0b-8f3e-6238388b1d0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:44.515489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9164a4-0de8-4e0b-8f3e-6238388b1d0d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:44.537187 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042b121-5c98-49cd-b281-4cb40a19286a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:44.550543 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 231/465] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:12:44 2022] POST /identity/v3/users => generated 246 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:12:44.551746 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9164a4-0de8-4e0b-8f3e-6238388b1d0d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:44.626488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2506d1b-f021-4b0f-8f5a-32db0ae899e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:44.627201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2506d1b-f021-4b0f-8f5a-32db0ae899e3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:44.627545 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2506d1b-f021-4b0f-8f5a-32db0ae899e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:44.627901 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2506d1b-f021-4b0f-8f5a-32db0ae899e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:44.636768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:44.654380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2506d1b-f021-4b0f-8f5a-32db0ae899e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:44.655944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2506d1b-f021-4b0f-8f5a-32db0ae899e3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a2506d1b-f021-4b0f-8f5a-32db0ae899e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:44.680539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:44.681523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:44.682370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:44.682370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:44.682370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:44.683988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 235/466] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:44.689624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2506d1b-f021-4b0f-8f5a-32db0ae899e3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:44.708973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:44.716852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9164a4-0de8-4e0b-8f3e-6238388b1d0d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:44.767396 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616ea13-cfea-4f35-88f3-7fb0a3a1f27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:44.768260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616ea13-cfea-4f35-88f3-7fb0a3a1f27a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:44.768864 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616ea13-cfea-4f35-88f3-7fb0a3a1f27a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:44.769310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616ea13-cfea-4f35-88f3-7fb0a3a1f27a None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:44.771066 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616ea13-cfea-4f35-88f3-7fb0a3a1f27a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:44.771516 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616ea13-cfea-4f35-88f3-7fb0a3a1f27a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:44.773404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616ea13-cfea-4f35-88f3-7fb0a3a1f27a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:44.790685 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 232/467] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:44.791864 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf336-43cd-4ecb-b5a8-29c95a17fec3 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:44.792150 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf336-43cd-4ecb-b5a8-29c95a17fec3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:44.792416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf336-43cd-4ecb-b5a8-29c95a17fec3 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:44.795549 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 233/468] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:44.799977 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acf336-43cd-4ecb-b5a8-29c95a17fec3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:44.836499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2506d1b-f021-4b0f-8f5a-32db0ae899e3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:44.879207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf2f62-f7f2-41c7-bd63-09fa6b3e03d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:44.880368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf2f62-f7f2-41c7-bd63-09fa6b3e03d5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:44.881434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf2f62-f7f2-41c7-bd63-09fa6b3e03d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:44.881434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf2f62-f7f2-41c7-bd63-09fa6b3e03d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:44.881618 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf2f62-f7f2-41c7-bd63-09fa6b3e03d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:44.881855 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf2f62-f7f2-41c7-bd63-09fa6b3e03d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:44.883227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf2f62-f7f2-41c7-bd63-09fa6b3e03d5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:44.898565 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 236/469] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:44.900219 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b08f58-4b6a-4403-b8a2-b5c59dc40c3d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:44.900803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b08f58-4b6a-4403-b8a2-b5c59dc40c3d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:44.901414 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b08f58-4b6a-4403-b8a2-b5c59dc40c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:44.921133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-10b08f58-4b6a-4403-b8a2-b5c59dc40c3d None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:44.922726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-10b08f58-4b6a-4403-b8a2-b5c59dc40c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:44.931746 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acf336-43cd-4ecb-b5a8-29c95a17fec3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:44.961310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:44.970125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab6b16-fd37-4515-9fb8-766680f1b068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:44.970964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab6b16-fd37-4515-9fb8-766680f1b068 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:44.971144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab6b16-fd37-4515-9fb8-766680f1b068 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:44.971451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab6b16-fd37-4515-9fb8-766680f1b068 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:44.972092 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab6b16-fd37-4515-9fb8-766680f1b068 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:44.973772 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab6b16-fd37-4515-9fb8-766680f1b068 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:44.993554 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:45.000660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 234/470] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:12:44 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:12:45.001548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab6b16-fd37-4515-9fb8-766680f1b068 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:45.002313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 237/471] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:45.031981 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b08f58-4b6a-4403-b8a2-b5c59dc40c3d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:45.128248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab6b16-fd37-4515-9fb8-766680f1b068 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:45.157478 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b08f58-4b6a-4403-b8a2-b5c59dc40c3d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:45.166413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd226484-3617-4c3e-bcdc-7f076008bb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:45.167419 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd226484-3617-4c3e-bcdc-7f076008bb52 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:45.167840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd226484-3617-4c3e-bcdc-7f076008bb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:45.168350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd226484-3617-4c3e-bcdc-7f076008bb52 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:45.169370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd226484-3617-4c3e-bcdc-7f076008bb52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:45.171057 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd226484-3617-4c3e-bcdc-7f076008bb52 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:45.199210 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 235/472] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:12:45 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:12:45.200425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d442b-b95f-448b-b285-b2eda76a7ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:45.200809 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51e019-9066-4d77-8214-ea3dfed61757 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:45.201165 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51e019-9066-4d77-8214-ea3dfed61757 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:45.201272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d442b-b95f-448b-b285-b2eda76a7ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:45.201560 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51e019-9066-4d77-8214-ea3dfed61757 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:45.201680 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d442b-b95f-448b-b285-b2eda76a7ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:45.202067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d442b-b95f-448b-b285-b2eda76a7ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:45.203684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 236/473] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:45.211573 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fba9e-0e70-4adf-9648-c5fa0df65174 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:45.211946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fba9e-0e70-4adf-9648-c5fa0df65174 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:45.212291 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fba9e-0e70-4adf-9648-c5fa0df65174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:45.215837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d442b-b95f-448b-b285-b2eda76a7ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:45.217774 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d442b-b95f-448b-b285-b2eda76a7ce4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:45.233688 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2f9fba9e-0e70-4adf-9648-c5fa0df65174 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-4f9d442b-b95f-448b-b285-b2eda76a7ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:45.235285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:45.237699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:45.239870 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:45.239870 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:45.239870 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:45.240181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2f9fba9e-0e70-4adf-9648-c5fa0df65174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:45.240323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 238/474] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:12:45.247375 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d442b-b95f-448b-b285-b2eda76a7ce4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:45.291856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:45.325048 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:45.351271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 237/475] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:45.379789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d442b-b95f-448b-b285-b2eda76a7ce4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:45.386612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fba9e-0e70-4adf-9648-c5fa0df65174 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:45.423814 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278917b-e5d9-436c-ac4b-fbf0dfa187cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:45.424423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278917b-e5d9-436c-ac4b-fbf0dfa187cf None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:45.424739 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278917b-e5d9-436c-ac4b-fbf0dfa187cf None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:45.425017 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278917b-e5d9-436c-ac4b-fbf0dfa187cf None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:45.425673 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278917b-e5d9-436c-ac4b-fbf0dfa187cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:45.425979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278917b-e5d9-436c-ac4b-fbf0dfa187cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:45.428004 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278917b-e5d9-436c-ac4b-fbf0dfa187cf None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:45.451556 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 239/476] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:45.457916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278917b-e5d9-436c-ac4b-fbf0dfa187cf None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:45.531486 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fba9e-0e70-4adf-9648-c5fa0df65174 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:45.576212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d73ce4-338f-4f63-8fd1-93161ed09620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:45.576860 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d73ce4-338f-4f63-8fd1-93161ed09620 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:45.577475 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d73ce4-338f-4f63-8fd1-93161ed09620 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:45.577864 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d73ce4-338f-4f63-8fd1-93161ed09620 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:45.578668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d73ce4-338f-4f63-8fd1-93161ed09620 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:45.580512 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d73ce4-338f-4f63-8fd1-93161ed09620 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:45.582702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278917b-e5d9-436c-ac4b-fbf0dfa187cf None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:45.593123 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.sql.core [None req-52d73ce4-338f-4f63-8fd1-93161ed09620 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 11 16:12:45.593123 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 11 16:12:45.593123 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [parameters: {'id': 'e3b44230aa02479187c72445c3baef9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 11 16:12:45.593123 dv-cinder-852208-4-smb devstack@keystone.service[81408]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81408) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 11 16:12:45.594551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:45.618388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-52d73ce4-338f-4f63-8fd1-93161ed09620 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 11 16:12:45.618388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:45.618388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 16:12:45.618388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 16:12:45.618388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 16:12:45.618388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 16:12:45.618388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 16:12:45.618388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 16:12:45.618388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 16:12:45.618388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application conn.query(q) Aug 11 16:12:45.618388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 16:12:45.618388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 16:12:45.618388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 16:12:45.618388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result.read() Aug 11 16:12:45.618388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return ref.to_dict() Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 16:12:45.619319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application next(self.gen) Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application yield resource Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application next(self.gen) Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.session.rollback() Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.force_reraise() Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise self.value Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application session.commit() Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 11 16:12:45.620892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._prepare_impl() Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.session.flush() Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._flush(objects) Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application compat.raise_( Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application flush_context.execute() Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rec.execute(self) Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 11 16:12:45.621959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 16:12:45.623827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application conn.query(q) Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result.read() Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 16:12:45.625891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [parameters: {'id': 'e3b44230aa02479187c72445c3baef9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:45.633275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 11 16:12:45.635884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:45.637854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 238/477] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Aug 11 16:12:45 2022] POST /identity/v3/roles => generated 144 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:45.637933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c5545-9f70-4978-81fa-b357cfd6dcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:45.637933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c5545-9f70-4978-81fa-b357cfd6dcbd None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:45.637933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c5545-9f70-4978-81fa-b357cfd6dcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:45.637933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c5545-9f70-4978-81fa-b357cfd6dcbd None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:45.638247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c5545-9f70-4978-81fa-b357cfd6dcbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:45.638334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d73ce4-338f-4f63-8fd1-93161ed09620 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:45.638420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c5545-9f70-4978-81fa-b357cfd6dcbd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:45.657476 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 240/478] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:12:45 2022] POST /identity/v3/users => generated 249 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:12:45.686950 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:45.776573 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d73ce4-338f-4f63-8fd1-93161ed09620 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:45.817934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f2e73-eab5-48e3-900d-a057fb30367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:45.818990 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f2e73-eab5-48e3-900d-a057fb30367d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:45.819488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f2e73-eab5-48e3-900d-a057fb30367d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:45.819959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f2e73-eab5-48e3-900d-a057fb30367d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:45.831032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f2e73-eab5-48e3-900d-a057fb30367d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-817f2e73-eab5-48e3-900d-a057fb30367d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:45.836901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:45.837792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:45.838680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:45.838680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:45.838680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:45.838680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:45.838680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:45.838680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:45.838680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:45.838680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:45.838680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:45.838680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:45.838680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 16:12:45.838680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:45.841249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 239/479] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:12:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:12:45.847148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c5545-9f70-4978-81fa-b357cfd6dcbd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:45.969976 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c5545-9f70-4978-81fa-b357cfd6dcbd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:46.011359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee85817-586c-49f6-909f-71af55257caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:46.012330 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee85817-586c-49f6-909f-71af55257caa None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:46.012846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee85817-586c-49f6-909f-71af55257caa None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:46.013324 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee85817-586c-49f6-909f-71af55257caa None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:46.014197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee85817-586c-49f6-909f-71af55257caa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:46.014701 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee85817-586c-49f6-909f-71af55257caa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:46.016306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee85817-586c-49f6-909f-71af55257caa None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:46.026597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 241/480] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:47.139878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e058eb2-bda2-49e3-acf8-e5afa5c8d1b2 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:47.141136 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e058eb2-bda2-49e3-acf8-e5afa5c8d1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:47.141734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e058eb2-bda2-49e3-acf8-e5afa5c8d1b2 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:47.143691 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 240/481] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:47.149334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca250180-4fcd-4274-ad9b-e363fc09db37 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:47.150126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca250180-4fcd-4274-ad9b-e363fc09db37 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:47.150595 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca250180-4fcd-4274-ad9b-e363fc09db37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:47.177382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ca250180-4fcd-4274-ad9b-e363fc09db37 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:47.178867 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ca250180-4fcd-4274-ad9b-e363fc09db37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:47.205290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:47.277306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 242/482] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:47.313056 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e058eb2-bda2-49e3-acf8-e5afa5c8d1b2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:47.433749 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:47.443855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e058eb2-bda2-49e3-acf8-e5afa5c8d1b2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:47.491315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5ec4f-40a9-4628-b032-3ced17639cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:47.491946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5ec4f-40a9-4628-b032-3ced17639cab None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:47.492223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5ec4f-40a9-4628-b032-3ced17639cab None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:47.492492 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5ec4f-40a9-4628-b032-3ced17639cab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:47.505126 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5ec4f-40a9-4628-b032-3ced17639cab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-86b5ec4f-40a9-4628-b032-3ced17639cab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:47.509840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:47.510729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:47.511517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:47.511517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:47.511517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:47.511517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:47.511517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:47.511517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:47.511517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:47.511517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:47.511517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:47.511517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:47.511517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:47.511517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:47.511517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 241/483] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:12:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:47.517683 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca250180-4fcd-4274-ad9b-e363fc09db37 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:47.662773 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca250180-4fcd-4274-ad9b-e363fc09db37 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:47.715359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7cd76-daed-47a9-b4f3-4e28eed7698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:47.715887 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7cd76-daed-47a9-b4f3-4e28eed7698e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:47.716162 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7cd76-daed-47a9-b4f3-4e28eed7698e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:47.716432 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7cd76-daed-47a9-b4f3-4e28eed7698e None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:47.717142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7cd76-daed-47a9-b4f3-4e28eed7698e None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:47.717441 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7cd76-daed-47a9-b4f3-4e28eed7698e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:47.718809 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7cd76-daed-47a9-b4f3-4e28eed7698e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:47.732604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 243/484] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:12:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:47.738040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5ec4f-40a9-4628-b032-3ced17639cab None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:47.847812 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5ec4f-40a9-4628-b032-3ced17639cab None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:47.882726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a5d0-316b-4ada-a3fe-188bccbb4d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:47.883358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a5d0-316b-4ada-a3fe-188bccbb4d58 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:47.883632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a5d0-316b-4ada-a3fe-188bccbb4d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:47.883899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a5d0-316b-4ada-a3fe-188bccbb4d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:47.904217 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0a5d0-316b-4ada-a3fe-188bccbb4d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:47.905705 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0a5d0-316b-4ada-a3fe-188bccbb4d58 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:47.908705 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7b44a-9e1e-4f3b-a4bf-8f9d48103011 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:47.909240 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7b44a-9e1e-4f3b-a4bf-8f9d48103011 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:47.909240 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7b44a-9e1e-4f3b-a4bf-8f9d48103011 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:47.910718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 244/485] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:12:47.916299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0c6b2-ab61-4780-9f94-a90f33429f99 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:47.917446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0c6b2-ab61-4780-9f94-a90f33429f99 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:47.917734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0c6b2-ab61-4780-9f94-a90f33429f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-dad0a5d0-316b-4ada-a3fe-188bccbb4d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:47.924437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:47.925355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:47.926242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:47.926242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:47.926242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:47.928254 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 242/486] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:47.929692 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91167eaa-1c37-4a6a-a9f6-61620d70b6fb None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:47.930173 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91167eaa-1c37-4a6a-a9f6-61620d70b6fb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:47.930662 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91167eaa-1c37-4a6a-a9f6-61620d70b6fb None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:47.932353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 243/487] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:47.937140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91167eaa-1c37-4a6a-a9f6-61620d70b6fb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:47.937596 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c9e0c6b2-ab61-4780-9f94-a90f33429f99 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:47.938891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c9e0c6b2-ab61-4780-9f94-a90f33429f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:47.941576 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:47.956255 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:48.029313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 245/488] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:12:48.036612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05259f83-4389-4c87-8499-7768724e6ee1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:48.036612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05259f83-4389-4c87-8499-7768724e6ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:48.036612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05259f83-4389-4c87-8499-7768724e6ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:48.065124 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-05259f83-4389-4c87-8499-7768724e6ee1 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:48.065331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91167eaa-1c37-4a6a-a9f6-61620d70b6fb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:48.067594 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-05259f83-4389-4c87-8499-7768724e6ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:48.103367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cfb41-6fca-4818-8ee4-362f32444f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:48.103936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cfb41-6fca-4818-8ee4-362f32444f8f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:48.104220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cfb41-6fca-4818-8ee4-362f32444f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:48.104577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cfb41-6fca-4818-8ee4-362f32444f8f None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:48.105267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cfb41-6fca-4818-8ee4-362f32444f8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:48.105618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cfb41-6fca-4818-8ee4-362f32444f8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:48.107280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cfb41-6fca-4818-8ee4-362f32444f8f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:48.122806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 244/489] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:48.123468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cfb41-6fca-4818-8ee4-362f32444f8f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:48.164826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 246/490] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:48.166590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05259f83-4389-4c87-8499-7768724e6ee1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:48.223522 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:48.268394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cfb41-6fca-4818-8ee4-362f32444f8f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:48.272334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:48.301562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05259f83-4389-4c87-8499-7768724e6ee1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:48.313788 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54206a50-36df-4a02-89dd-ca1734302a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:48.314709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206a50-36df-4a02-89dd-ca1734302a02 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:48.315083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206a50-36df-4a02-89dd-ca1734302a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:48.315453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206a50-36df-4a02-89dd-ca1734302a02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:48.327517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54206a50-36df-4a02-89dd-ca1734302a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-54206a50-36df-4a02-89dd-ca1734302a02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:48.332161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:48.333097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:48.333878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:48.333878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:48.333878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:48.333878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:48.333878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:48.333878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:48.333878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:48.333878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:48.333878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:48.333878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:48.333878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:48.333878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:48.333878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 245/491] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:12:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:48.334609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54206a50-36df-4a02-89dd-ca1734302a02 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:48.348784 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48928908-a2bc-4226-94d1-f95476d12f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:48.349344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48928908-a2bc-4226-94d1-f95476d12f54 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:48.349616 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48928908-a2bc-4226-94d1-f95476d12f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:48.349880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48928908-a2bc-4226-94d1-f95476d12f54 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:48.357377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48928908-a2bc-4226-94d1-f95476d12f54 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:48.358805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48928908-a2bc-4226-94d1-f95476d12f54 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-48928908-a2bc-4226-94d1-f95476d12f54 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:12:48.373003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:48.373939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:48.375453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:48.375453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:48.375453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:12:48.375453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:12:48.375453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:12:48.375453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:12:48.375453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:12:48.375453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:12:48.375453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:12:48.375453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:48.375453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 247/492] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Aug 11 16:12:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:48.376019 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f56643-adf0-493a-86d5-f8b5d96828f1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:48.376019 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f56643-adf0-493a-86d5-f8b5d96828f1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:48.376347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f56643-adf0-493a-86d5-f8b5d96828f1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:48.380977 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 248/493] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:48.380977 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f56643-adf0-493a-86d5-f8b5d96828f1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:48.441925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54206a50-36df-4a02-89dd-ca1734302a02 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:48.477144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:48.485573 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407c96a-d210-43fe-8146-cd778649666c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:48.486281 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c96a-d210-43fe-8146-cd778649666c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:48.486556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c96a-d210-43fe-8146-cd778649666c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:48.486823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c96a-d210-43fe-8146-cd778649666c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:48.494919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f56643-adf0-493a-86d5-f8b5d96828f1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:48.497935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407c96a-d210-43fe-8146-cd778649666c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-9407c96a-d210-43fe-8146-cd778649666c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:48.503458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:48.504356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:48.505195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:48.505195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:48.505195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:48.505195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:48.505195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:48.505195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:48.505195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:48.505195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:48.505195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:48.505195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:48.505195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:48.505195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:48.505195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 246/494] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:12:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:48.505859 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407c96a-d210-43fe-8146-cd778649666c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:48.537869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210c0fb-866d-4b8b-b074-cf5e39b9289b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:48.538468 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c0fb-866d-4b8b-b074-cf5e39b9289b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:48.538738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c0fb-866d-4b8b-b074-cf5e39b9289b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:48.539007 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c0fb-866d-4b8b-b074-cf5e39b9289b None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:48.539690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210c0fb-866d-4b8b-b074-cf5e39b9289b None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:48.539960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210c0fb-866d-4b8b-b074-cf5e39b9289b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:48.541364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210c0fb-866d-4b8b-b074-cf5e39b9289b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:48.547490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:48.551193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 249/495] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:12:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:48.553264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cc00e-93c1-478b-88fd-a367de03abe3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:48.553729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cc00e-93c1-478b-88fd-a367de03abe3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:48.554177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cc00e-93c1-478b-88fd-a367de03abe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:48.572032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-168cc00e-93c1-478b-88fd-a367de03abe3 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:48.573270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-168cc00e-93c1-478b-88fd-a367de03abe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:48.627610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407c96a-d210-43fe-8146-cd778649666c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:48.648752 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 250/496] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:48.648752 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cc00e-93c1-478b-88fd-a367de03abe3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:48.672531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623141aa-0d05-4447-937d-290a7d9fba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:48.673377 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623141aa-0d05-4447-937d-290a7d9fba16 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:48.673723 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623141aa-0d05-4447-937d-290a7d9fba16 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:48.674062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623141aa-0d05-4447-937d-290a7d9fba16 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:48.674913 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623141aa-0d05-4447-937d-290a7d9fba16 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:48.675284 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623141aa-0d05-4447-937d-290a7d9fba16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:48.677397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623141aa-0d05-4447-937d-290a7d9fba16 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:48.713850 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 247/497] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Aug 11 16:12:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:48.714748 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623141aa-0d05-4447-937d-290a7d9fba16 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:48.750938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cc00e-93c1-478b-88fd-a367de03abe3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:48.757330 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:48.779838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:48.786342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2df36-07ab-421b-988d-0193a9404c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:48.786930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2df36-07ab-421b-988d-0193a9404c3e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:48.787205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2df36-07ab-421b-988d-0193a9404c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:48.787472 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2df36-07ab-421b-988d-0193a9404c3e None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:48.788126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2df36-07ab-421b-988d-0193a9404c3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:48.788422 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2df36-07ab-421b-988d-0193a9404c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:48.789824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2df36-07ab-421b-988d-0193a9404c3e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:48.797837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 251/498] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:12:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:48.798608 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2df36-07ab-421b-988d-0193a9404c3e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:48.817660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623141aa-0d05-4447-937d-290a7d9fba16 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:48.852530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af595cb6-d118-4aea-b480-3eeadc8500eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:48.853184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af595cb6-d118-4aea-b480-3eeadc8500eb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:48.853469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af595cb6-d118-4aea-b480-3eeadc8500eb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:48.853743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af595cb6-d118-4aea-b480-3eeadc8500eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:48.863562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af595cb6-d118-4aea-b480-3eeadc8500eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:48.865055 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af595cb6-d118-4aea-b480-3eeadc8500eb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-af595cb6-d118-4aea-b480-3eeadc8500eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:48.879221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:48.880106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:48.880973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:48.880973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:48.880973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:48.880973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 248/499] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:48.881594 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc7eaa-a4ee-40b8-9e48-d0f3fe32c274 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:48.881943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc7eaa-a4ee-40b8-9e48-d0f3fe32c274 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:48.882216 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc7eaa-a4ee-40b8-9e48-d0f3fe32c274 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:48.883570 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 249/500] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:48.884201 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc7eaa-a4ee-40b8-9e48-d0f3fe32c274 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:48.901015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2df36-07ab-421b-988d-0193a9404c3e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:48.934308 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53dec7-c52b-49af-aab7-d239a381c2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:48.934919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53dec7-c52b-49af-aab7-d239a381c2da None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:48.935196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53dec7-c52b-49af-aab7-d239a381c2da None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:48.935465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53dec7-c52b-49af-aab7-d239a381c2da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:48.945417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53dec7-c52b-49af-aab7-d239a381c2da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-1e53dec7-c52b-49af-aab7-d239a381c2da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:48.950481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:48.951323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:48.952329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:48.952329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:48.952329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:48.952329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:48.952329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:48.952329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:48.952329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:48.952329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:48.952329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:48.952329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:48.952329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:48.952329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:48.952329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 252/501] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:12:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:48.952329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53dec7-c52b-49af-aab7-d239a381c2da None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:48.983507 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:48.991277 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc7eaa-a4ee-40b8-9e48-d0f3fe32c274 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:49.004175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:49.025133 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6e8a6-28f7-4039-b12f-0217167604f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:49.025729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6e8a6-28f7-4039-b12f-0217167604f2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:49.026052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6e8a6-28f7-4039-b12f-0217167604f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:49.026331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6e8a6-28f7-4039-b12f-0217167604f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:49.051787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53dec7-c52b-49af-aab7-d239a381c2da None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:49.084974 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112d6ec-902a-4b7c-b949-7dc7ab836d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:49.085504 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112d6ec-902a-4b7c-b949-7dc7ab836d16 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:49.085783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112d6ec-902a-4b7c-b949-7dc7ab836d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:49.086058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112d6ec-902a-4b7c-b949-7dc7ab836d16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:49.092161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6e8a6-28f7-4039-b12f-0217167604f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:49.093652 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6e8a6-28f7-4039-b12f-0217167604f2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:49.096247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112d6ec-902a-4b7c-b949-7dc7ab836d16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:49.097726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112d6ec-902a-4b7c-b949-7dc7ab836d16 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a112d6ec-902a-4b7c-b949-7dc7ab836d16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:49.112101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:49.113220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:49.114070 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:49.114070 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:49.114070 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:49.114070 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 253/502] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:49.114388 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112d6ec-902a-4b7c-b949-7dc7ab836d16 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:49.187829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:49.196561 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 250/503] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:49.197796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff516fb2-d839-4aea-b4d3-f347d74a2bfb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:49.198076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff516fb2-d839-4aea-b4d3-f347d74a2bfb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:49.198343 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff516fb2-d839-4aea-b4d3-f347d74a2bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:49.215766 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ff516fb2-d839-4aea-b4d3-f347d74a2bfb None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:49.216968 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ff516fb2-d839-4aea-b4d3-f347d74a2bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:49.218080 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112d6ec-902a-4b7c-b949-7dc7ab836d16 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:49.221016 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:49.252176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9074514-ee02-4565-98c2-1d4be0a74cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:49.252791 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074514-ee02-4565-98c2-1d4be0a74cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:49.253070 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074514-ee02-4565-98c2-1d4be0a74cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:49.253340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074514-ee02-4565-98c2-1d4be0a74cd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:49.253967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9074514-ee02-4565-98c2-1d4be0a74cd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:49.254806 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9074514-ee02-4565-98c2-1d4be0a74cd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:49.256158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9074514-ee02-4565-98c2-1d4be0a74cd2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:49.267451 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 254/504] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:49.268227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9074514-ee02-4565-98c2-1d4be0a74cd2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:49.285991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 251/505] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:49.286835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff516fb2-d839-4aea-b4d3-f347d74a2bfb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:49.377964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9074514-ee02-4565-98c2-1d4be0a74cd2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:49.391556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff516fb2-d839-4aea-b4d3-f347d74a2bfb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:49.412440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4a669-6062-4ce2-acee-4c118d56bb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:49.413054 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4a669-6062-4ce2-acee-4c118d56bb7c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:49.413329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4a669-6062-4ce2-acee-4c118d56bb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:49.413594 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4a669-6062-4ce2-acee-4c118d56bb7c None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:49.414243 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4a669-6062-4ce2-acee-4c118d56bb7c None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:49.414541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4a669-6062-4ce2-acee-4c118d56bb7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:49.414672 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:49.415979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4a669-6062-4ce2-acee-4c118d56bb7c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:49.424127 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 255/506] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:12:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:49.424938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4a669-6062-4ce2-acee-4c118d56bb7c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:49.429978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679f69d-d63e-427d-996c-fef338d2778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:49.430580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679f69d-d63e-427d-996c-fef338d2778b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:49.430857 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679f69d-d63e-427d-996c-fef338d2778b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:49.431128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679f69d-d63e-427d-996c-fef338d2778b None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:49.431772 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679f69d-d63e-427d-996c-fef338d2778b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:49.432072 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679f69d-d63e-427d-996c-fef338d2778b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:49.433472 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679f69d-d63e-427d-996c-fef338d2778b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:49.445204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 252/507] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:49.445985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679f69d-d63e-427d-996c-fef338d2778b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:49.452159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:49.526214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4a669-6062-4ce2-acee-4c118d56bb7c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:49.550036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679f69d-d63e-427d-996c-fef338d2778b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:49.558969 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e70dd9-4787-48b6-b4de-3ead6b32313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:49.559584 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70dd9-4787-48b6-b4de-3ead6b32313c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:49.559862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70dd9-4787-48b6-b4de-3ead6b32313c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:49.560132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70dd9-4787-48b6-b4de-3ead6b32313c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:49.570910 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e70dd9-4787-48b6-b4de-3ead6b32313c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:49.572349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e70dd9-4787-48b6-b4de-3ead6b32313c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:49.585865 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895172e-b1f8-4dc2-828f-8845cd201169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-38e70dd9-4787-48b6-b4de-3ead6b32313c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:49.586161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:49.587067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:49.587922 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:49.587922 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:49.587922 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:49.588081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895172e-b1f8-4dc2-828f-8845cd201169 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:49.588081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895172e-b1f8-4dc2-828f-8845cd201169 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:49.588211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 256/508] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:49.588275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895172e-b1f8-4dc2-828f-8845cd201169 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:49.588339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e70dd9-4787-48b6-b4de-3ead6b32313c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:49.599054 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895172e-b1f8-4dc2-828f-8845cd201169 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:49.600491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895172e-b1f8-4dc2-828f-8845cd201169 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-6895172e-b1f8-4dc2-828f-8845cd201169 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:12:49.613232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:49.614679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:49.615553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:49.615553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:49.615553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:12:49.615553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:12:49.615553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:12:49.615553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:12:49.615553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:12:49.615553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:12:49.615553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 11 16:12:49.615553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:49.615553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 253/509] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:49.616108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895172e-b1f8-4dc2-828f-8845cd201169 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:49.659243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:49.673880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:49.696681 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e70dd9-4787-48b6-b4de-3ead6b32313c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:49.713279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895172e-b1f8-4dc2-828f-8845cd201169 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:49.729017 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fb2b5-2b36-4468-b53d-0611d251258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:49.729628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fb2b5-2b36-4468-b53d-0611d251258a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:49.729906 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fb2b5-2b36-4468-b53d-0611d251258a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:49.730176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fb2b5-2b36-4468-b53d-0611d251258a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:49.740890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fb2b5-2b36-4468-b53d-0611d251258a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:49.742333 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fb2b5-2b36-4468-b53d-0611d251258a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:49.745693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e7e46-3b26-4246-b213-d2b62b40e883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:49.746313 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e7e46-3b26-4246-b213-d2b62b40e883 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:49.746592 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e7e46-3b26-4246-b213-d2b62b40e883 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:49.746865 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e7e46-3b26-4246-b213-d2b62b40e883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-823fb2b5-2b36-4468-b53d-0611d251258a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:49.756272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:49.757245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:49.758073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:49.758073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:49.758073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:49.758073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 257/510] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:49.758290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e7e46-3b26-4246-b213-d2b62b40e883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:49.758803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fb2b5-2b36-4468-b53d-0611d251258a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:49.759404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e7e46-3b26-4246-b213-d2b62b40e883 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-253e7e46-3b26-4246-b213-d2b62b40e883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:49.773374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:49.774272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:49.775104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:49.775104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:49.775104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:49.775487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 254/511] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:49.776401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e7e46-3b26-4246-b213-d2b62b40e883 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:49.861026 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fb2b5-2b36-4468-b53d-0611d251258a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:49.868548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:49.874910 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e7e46-3b26-4246-b213-d2b62b40e883 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:49.889177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:49.895562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3aa098-1803-4ea0-a4b4-a1679788e821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:49.896175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aa098-1803-4ea0-a4b4-a1679788e821 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:49.896451 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aa098-1803-4ea0-a4b4-a1679788e821 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:49.896759 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aa098-1803-4ea0-a4b4-a1679788e821 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:49.904103 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3aa098-1803-4ea0-a4b4-a1679788e821 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:49.905583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3aa098-1803-4ea0-a4b4-a1679788e821 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:49.908037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69507c4-a857-4ad9-a2fd-fe35e74645d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:49.908653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69507c4-a857-4ad9-a2fd-fe35e74645d3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:49.908933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69507c4-a857-4ad9-a2fd-fe35e74645d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:49.909215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69507c4-a857-4ad9-a2fd-fe35e74645d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:49.909887 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69507c4-a857-4ad9-a2fd-fe35e74645d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:49.910132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69507c4-a857-4ad9-a2fd-fe35e74645d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:49.912013 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69507c4-a857-4ad9-a2fd-fe35e74645d3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-9d3aa098-1803-4ea0-a4b4-a1679788e821 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:12:49.916944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:49.917980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:49.919122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:49.919122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:49.919122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:12:49.919122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:12:49.919122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:12:49.919122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:12:49.919122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:12:49.919122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:12:49.919122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 16:12:49.919122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:49.919122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 258/512] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:49.919122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3aa098-1803-4ea0-a4b4-a1679788e821 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:49.924457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 255/513] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:49.925315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69507c4-a857-4ad9-a2fd-fe35e74645d3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:50.017473 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3aa098-1803-4ea0-a4b4-a1679788e821 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:50.021757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69507c4-a857-4ad9-a2fd-fe35e74645d3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:50.050258 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2715b8-1b2d-4408-a157-f52b76fa8984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:50.050847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2715b8-1b2d-4408-a157-f52b76fa8984 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:50.051709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2715b8-1b2d-4408-a157-f52b76fa8984 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:50.051982 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2715b8-1b2d-4408-a157-f52b76fa8984 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:50.052759 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2715b8-1b2d-4408-a157-f52b76fa8984 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:50.053040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2715b8-1b2d-4408-a157-f52b76fa8984 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:50.054461 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2715b8-1b2d-4408-a157-f52b76fa8984 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:50.055703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5080d46-e0b9-40fd-8ed7-5a3b22cd228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:50.056297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5080d46-e0b9-40fd-8ed7-5a3b22cd228b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:50.056574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5080d46-e0b9-40fd-8ed7-5a3b22cd228b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:50.056870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5080d46-e0b9-40fd-8ed7-5a3b22cd228b None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:50.057502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5080d46-e0b9-40fd-8ed7-5a3b22cd228b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:50.057803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5080d46-e0b9-40fd-8ed7-5a3b22cd228b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:50.059146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5080d46-e0b9-40fd-8ed7-5a3b22cd228b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:50.071050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 256/514] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:50.071830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5080d46-e0b9-40fd-8ed7-5a3b22cd228b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:50.090290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:50.095109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 259/515] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Aug 11 16:12:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:50.096012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2715b8-1b2d-4408-a157-f52b76fa8984 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:50.148596 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:50.172939 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5080d46-e0b9-40fd-8ed7-5a3b22cd228b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:50.199580 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2715b8-1b2d-4408-a157-f52b76fa8984 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:50.205114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fc76d-984f-419a-9cf4-35a5c5e9def0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:50.205706 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fc76d-984f-419a-9cf4-35a5c5e9def0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:50.205978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fc76d-984f-419a-9cf4-35a5c5e9def0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:50.206242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fc76d-984f-419a-9cf4-35a5c5e9def0 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:50.206868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fc76d-984f-419a-9cf4-35a5c5e9def0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:50.207159 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fc76d-984f-419a-9cf4-35a5c5e9def0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:50.209027 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fc76d-984f-419a-9cf4-35a5c5e9def0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:50.220070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 257/516] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:50.220870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fc76d-984f-419a-9cf4-35a5c5e9def0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:50.233757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e912a2-1109-4d5f-8a43-e72c464ae65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:50.234348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e912a2-1109-4d5f-8a43-e72c464ae65c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:50.234625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e912a2-1109-4d5f-8a43-e72c464ae65c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:50.234896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e912a2-1109-4d5f-8a43-e72c464ae65c None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:50.235618 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e912a2-1109-4d5f-8a43-e72c464ae65c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:50.235922 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e912a2-1109-4d5f-8a43-e72c464ae65c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:50.237366 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e912a2-1109-4d5f-8a43-e72c464ae65c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:50.254081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 260/517] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Aug 11 16:12:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:50.254868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e912a2-1109-4d5f-8a43-e72c464ae65c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:50.295225 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:50.317450 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fc76d-984f-419a-9cf4-35a5c5e9def0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:50.350445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35706808-595b-4131-9bcf-9d3cd8d0e099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:50.351067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35706808-595b-4131-9bcf-9d3cd8d0e099 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:50.351342 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35706808-595b-4131-9bcf-9d3cd8d0e099 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:50.351619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35706808-595b-4131-9bcf-9d3cd8d0e099 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:50.354253 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e912a2-1109-4d5f-8a43-e72c464ae65c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:50.358081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35706808-595b-4131-9bcf-9d3cd8d0e099 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:50.359508 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35706808-595b-4131-9bcf-9d3cd8d0e099 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:50.361478 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:50.371515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-35706808-595b-4131-9bcf-9d3cd8d0e099 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:50.371515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:50.371515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:50.371515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:50.371515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:50.371515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:50.371515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:50.371515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:50.371515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:50.371515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:50.371515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:50.371515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:50.371515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:12:50.371515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:12:50.371515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:50.372355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:50.373208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:12:50.373208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:12:50.373208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:12:50.373208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:12:50.373208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:12:50.373208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:12:50.373208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:50.373208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:50.373208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 258/518] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:50.373666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35706808-595b-4131-9bcf-9d3cd8d0e099 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:50.393829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8418bab-9cf0-46de-9e8a-fb69d92be653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:50.394425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8418bab-9cf0-46de-9e8a-fb69d92be653 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:50.394705 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8418bab-9cf0-46de-9e8a-fb69d92be653 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:50.394971 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8418bab-9cf0-46de-9e8a-fb69d92be653 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:50.395594 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8418bab-9cf0-46de-9e8a-fb69d92be653 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:50.397139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8418bab-9cf0-46de-9e8a-fb69d92be653 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:50.418271 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 261/519] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:12:50 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:12:50.419471 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8418bab-9cf0-46de-9e8a-fb69d92be653 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:50.498966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35706808-595b-4131-9bcf-9d3cd8d0e099 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:50.537734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639626ea-3903-470b-bf85-f0be6dea55d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:50.538362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639626ea-3903-470b-bf85-f0be6dea55d6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:50.538641 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639626ea-3903-470b-bf85-f0be6dea55d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:50.538917 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639626ea-3903-470b-bf85-f0be6dea55d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:50.543979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:50.560678 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8418bab-9cf0-46de-9e8a-fb69d92be653 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:50.604017 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841262a5-7980-4076-93c5-c2250808be23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:50.604972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841262a5-7980-4076-93c5-c2250808be23 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:50.605897 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841262a5-7980-4076-93c5-c2250808be23 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:50.605897 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841262a5-7980-4076-93c5-c2250808be23 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:50.614038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841262a5-7980-4076-93c5-c2250808be23 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:50.614503 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639626ea-3903-470b-bf85-f0be6dea55d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:50.615494 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841262a5-7980-4076-93c5-c2250808be23 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:50.615932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639626ea-3903-470b-bf85-f0be6dea55d6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-841262a5-7980-4076-93c5-c2250808be23 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:12:50.630000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:50.631134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:50.632113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:50.632113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:50.632113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:12:50.632113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:12:50.632113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:12:50.632113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:12:50.632113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:12:50.632113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:12:50.632113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 16:12:50.632113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:50.632113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 262/520] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:12:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:50.632113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841262a5-7980-4076-93c5-c2250808be23 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:50.659969 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:50.732129 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 259/521] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:50.732852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639626ea-3903-470b-bf85-f0be6dea55d6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:50.743805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841262a5-7980-4076-93c5-c2250808be23 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:50.771627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:50.780220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba6ce4-114c-44ac-9573-b5978b811c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:50.780851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba6ce4-114c-44ac-9573-b5978b811c3c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:50.781260 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba6ce4-114c-44ac-9573-b5978b811c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:50.781413 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba6ce4-114c-44ac-9573-b5978b811c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:50.842102 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639626ea-3903-470b-bf85-f0be6dea55d6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:50.852509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba6ce4-114c-44ac-9573-b5978b811c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:50.853999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba6ce4-114c-44ac-9573-b5978b811c3c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:50.877794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:50.880374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928d2bf-7544-4aea-8446-c10bf3cfe0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:50.881260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928d2bf-7544-4aea-8446-c10bf3cfe0dc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:50.881583 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928d2bf-7544-4aea-8446-c10bf3cfe0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:50.881883 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928d2bf-7544-4aea-8446-c10bf3cfe0dc None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:50.882753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928d2bf-7544-4aea-8446-c10bf3cfe0dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:50.882859 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928d2bf-7544-4aea-8446-c10bf3cfe0dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:50.884235 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928d2bf-7544-4aea-8446-c10bf3cfe0dc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:50.908058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 260/522] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:50.908058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928d2bf-7544-4aea-8446-c10bf3cfe0dc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:50.968488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 263/523] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:50.968488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba6ce4-114c-44ac-9573-b5978b811c3c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:51.012374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:51.019645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928d2bf-7544-4aea-8446-c10bf3cfe0dc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:51.058715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da7cb2-d598-4f19-bd76-a1b42a50e94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:51.059527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da7cb2-d598-4f19-bd76-a1b42a50e94d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:51.059948 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da7cb2-d598-4f19-bd76-a1b42a50e94d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:51.060362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da7cb2-d598-4f19-bd76-a1b42a50e94d None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:51.061268 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da7cb2-d598-4f19-bd76-a1b42a50e94d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:51.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da7cb2-d598-4f19-bd76-a1b42a50e94d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:51.063177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da7cb2-d598-4f19-bd76-a1b42a50e94d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:51.074714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba6ce4-114c-44ac-9573-b5978b811c3c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:51.086797 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 261/524] 10.222.0.40 () {56 vars in 1139 bytes} [Thu Aug 11 16:12:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:51.086797 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da7cb2-d598-4f19-bd76-a1b42a50e94d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:51.098749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:51.110582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf43696-b6fa-440b-a574-84f8e6663324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:51.111204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf43696-b6fa-440b-a574-84f8e6663324 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:51.111479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf43696-b6fa-440b-a574-84f8e6663324 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:51.111749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf43696-b6fa-440b-a574-84f8e6663324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:51.122429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf43696-b6fa-440b-a574-84f8e6663324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:51.123869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf43696-b6fa-440b-a574-84f8e6663324 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-bdf43696-b6fa-440b-a574-84f8e6663324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:51.139018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:51.139928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:51.140772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:51.140772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:51.140772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:51.140772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 264/525] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:51.141006 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf43696-b6fa-440b-a574-84f8e6663324 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:51.199563 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da7cb2-d598-4f19-bd76-a1b42a50e94d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:51.235416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b5eae-a5d1-4c42-9c58-843a579b3dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:51.236134 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b5eae-a5d1-4c42-9c58-843a579b3dae None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:51.236313 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b5eae-a5d1-4c42-9c58-843a579b3dae None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:51.236554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b5eae-a5d1-4c42-9c58-843a579b3dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:51.237309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b5eae-a5d1-4c42-9c58-843a579b3dae None admin] RBAC: Adding query filter params (role.id=b4c209d1895841af9203c4e432176eb9, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=4e91f3fbe098459dba0acf8ec1fb7098) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:51.237614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b5eae-a5d1-4c42-9c58-843a579b3dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:51.239564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b5eae-a5d1-4c42-9c58-843a579b3dae None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:51.245169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 262/526] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:51 2022] GET /identity/v3/role_assignments?user.id=4e91f3fbe098459dba0acf8ec1fb7098&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=b4c209d1895841af9203c4e432176eb9 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:51.245856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b5eae-a5d1-4c42-9c58-843a579b3dae None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:51.257477 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf43696-b6fa-440b-a574-84f8e6663324 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:51.268185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:51.313252 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb67b1-0007-49f6-ae3a-944ff4da6936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:51.314200 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb67b1-0007-49f6-ae3a-944ff4da6936 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:51.314901 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb67b1-0007-49f6-ae3a-944ff4da6936 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:51.315822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb67b1-0007-49f6-ae3a-944ff4da6936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:51.329167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb67b1-0007-49f6-ae3a-944ff4da6936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:51.330923 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb67b1-0007-49f6-ae3a-944ff4da6936 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-4dfb67b1-0007-49f6-ae3a-944ff4da6936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:51.349730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:51.350988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:51.352028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:51.352028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:51.352028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:51.353623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 265/527] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:51.354744 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb67b1-0007-49f6-ae3a-944ff4da6936 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:51.381540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b5eae-a5d1-4c42-9c58-843a579b3dae None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:51.387769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:51.429857 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e89f1-205a-4e20-bd5f-d0cb891ff522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:51.431157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e89f1-205a-4e20-bd5f-d0cb891ff522 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:51.431621 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e89f1-205a-4e20-bd5f-d0cb891ff522 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:51.432037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e89f1-205a-4e20-bd5f-d0cb891ff522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:51.477294 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb67b1-0007-49f6-ae3a-944ff4da6936 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:51.512901 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c58e7-193b-4cf9-8b61-f912d671f3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:51.513657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c58e7-193b-4cf9-8b61-f912d671f3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:51.514031 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c58e7-193b-4cf9-8b61-f912d671f3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:51.514403 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c58e7-193b-4cf9-8b61-f912d671f3b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:51.515143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c58e7-193b-4cf9-8b61-f912d671f3b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:51.515545 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c58e7-193b-4cf9-8b61-f912d671f3b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:51.517468 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c58e7-193b-4cf9-8b61-f912d671f3b1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:51.520850 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e89f1-205a-4e20-bd5f-d0cb891ff522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:51.522506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e89f1-205a-4e20-bd5f-d0cb891ff522 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:51.535245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 266/528] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:51.538786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c58e7-193b-4cf9-8b61-f912d671f3b1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:51.545637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:51.654275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 263/529] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:51.655698 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e89f1-205a-4e20-bd5f-d0cb891ff522 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:51.657042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c58e7-193b-4cf9-8b61-f912d671f3b1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:51.660940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:51.694515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e26e9a-60c3-46e6-87bf-344b9fa719c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:51.695136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e26e9a-60c3-46e6-87bf-344b9fa719c5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:51.695471 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e26e9a-60c3-46e6-87bf-344b9fa719c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:51.695741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e26e9a-60c3-46e6-87bf-344b9fa719c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:51.696545 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e26e9a-60c3-46e6-87bf-344b9fa719c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:51.696750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e26e9a-60c3-46e6-87bf-344b9fa719c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:51.698113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e26e9a-60c3-46e6-87bf-344b9fa719c5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:51.715334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 267/530] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:51.716236 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e26e9a-60c3-46e6-87bf-344b9fa719c5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:51.784993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e89f1-205a-4e20-bd5f-d0cb891ff522 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:51.804463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:51.823714 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c93aaf-21f0-4a7b-a313-39430e7066c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:51.824709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c93aaf-21f0-4a7b-a313-39430e7066c6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:51.825205 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c93aaf-21f0-4a7b-a313-39430e7066c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:51.825669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c93aaf-21f0-4a7b-a313-39430e7066c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:51.835356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c93aaf-21f0-4a7b-a313-39430e7066c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:51.837213 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c93aaf-21f0-4a7b-a313-39430e7066c6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:51.843975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e26e9a-60c3-46e6-87bf-344b9fa719c5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:51.851853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-a9c93aaf-21f0-4a7b-a313-39430e7066c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:51.851853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:51.851853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:51.851853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:51.851853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:51.851853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:51.851853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:51.851853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:51.851853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:51.851853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:51.851853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:51.851853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:51.851853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:12:51.851853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:12:51.851853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:51.852728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:51.858184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:12:51.858184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:12:51.858184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:12:51.858184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:12:51.858184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:12:51.858184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:12:51.858184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:51.858184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:51.858184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 264/531] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:51.858184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c93aaf-21f0-4a7b-a313-39430e7066c6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:51.895555 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a26147-f724-4ca8-9e41-4a90a58cafc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:51.896185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a26147-f724-4ca8-9e41-4a90a58cafc8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:51.896805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a26147-f724-4ca8-9e41-4a90a58cafc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:51.897081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a26147-f724-4ca8-9e41-4a90a58cafc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:51.911024 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a26147-f724-4ca8-9e41-4a90a58cafc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:51.912579 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a26147-f724-4ca8-9e41-4a90a58cafc8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:51.921283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-62a26147-f724-4ca8-9e41-4a90a58cafc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:51.933674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:51.934569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:51.935426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:51.935426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:51.935426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:51.939449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 268/532] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:51.940279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a26147-f724-4ca8-9e41-4a90a58cafc8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:51.984825 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c93aaf-21f0-4a7b-a313-39430e7066c6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:52.033168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c14903-d8e7-44f0-b1b5-f92eec8b6efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:52.034333 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c14903-d8e7-44f0-b1b5-f92eec8b6efd None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:52.034650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c14903-d8e7-44f0-b1b5-f92eec8b6efd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:52.034961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c14903-d8e7-44f0-b1b5-f92eec8b6efd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:52.044935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c14903-d8e7-44f0-b1b5-f92eec8b6efd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:52.046858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c14903-d8e7-44f0-b1b5-f92eec8b6efd None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:52.058985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a26147-f724-4ca8-9e41-4a90a58cafc8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:52.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-02c14903-d8e7-44f0-b1b5-f92eec8b6efd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:52.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:52.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:52.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:52.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:52.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:52.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:52.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:52.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:52.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:52.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:52.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:52.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:12:52.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:12:52.061743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:52.062596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:52.063420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:12:52.063420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:12:52.063420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:12:52.063420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:12:52.063420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:12:52.063420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:12:52.063420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:52.063420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:52.065469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 265/533] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:52.065469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c14903-d8e7-44f0-b1b5-f92eec8b6efd None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:52.099813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53843a49-bc76-4910-a2a9-c789950d4316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:52.100404 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53843a49-bc76-4910-a2a9-c789950d4316 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:52.100757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53843a49-bc76-4910-a2a9-c789950d4316 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:52.100971 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53843a49-bc76-4910-a2a9-c789950d4316 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:52.101653 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53843a49-bc76-4910-a2a9-c789950d4316 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:52.101953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53843a49-bc76-4910-a2a9-c789950d4316 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:52.103465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53843a49-bc76-4910-a2a9-c789950d4316 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:52.117801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:52.129001 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 269/534] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:12:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:52.130159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53843a49-bc76-4910-a2a9-c789950d4316 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:52.199050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:52.202098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c14903-d8e7-44f0-b1b5-f92eec8b6efd None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:52.245219 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53843a49-bc76-4910-a2a9-c789950d4316 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:52.250961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dadf38-5455-4acf-bc0b-2e3cfda155b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:52.251846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dadf38-5455-4acf-bc0b-2e3cfda155b6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:52.252329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dadf38-5455-4acf-bc0b-2e3cfda155b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:52.252799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dadf38-5455-4acf-bc0b-2e3cfda155b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:52.254171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dadf38-5455-4acf-bc0b-2e3cfda155b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:52.254656 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dadf38-5455-4acf-bc0b-2e3cfda155b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:52.257164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dadf38-5455-4acf-bc0b-2e3cfda155b6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:52.275442 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 266/535] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:52.276761 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dadf38-5455-4acf-bc0b-2e3cfda155b6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:52.281716 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4a3eb-e8e2-4aba-8f40-4f5d0294ea28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:52.282176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4a3eb-e8e2-4aba-8f40-4f5d0294ea28 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:52.282251 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4a3eb-e8e2-4aba-8f40-4f5d0294ea28 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:52.282608 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4a3eb-e8e2-4aba-8f40-4f5d0294ea28 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:52.283356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4a3eb-e8e2-4aba-8f40-4f5d0294ea28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:52.283732 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4a3eb-e8e2-4aba-8f40-4f5d0294ea28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:52.285831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4a3eb-e8e2-4aba-8f40-4f5d0294ea28 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:52.298399 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 270/536] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:12:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:52.299301 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4a3eb-e8e2-4aba-8f40-4f5d0294ea28 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:52.391279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:52.398074 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dadf38-5455-4acf-bc0b-2e3cfda155b6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:52.409755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4a3eb-e8e2-4aba-8f40-4f5d0294ea28 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:52.427877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:52.436758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9bd58-0ed7-41b4-b966-7c83bfc8016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:52.437627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9bd58-0ed7-41b4-b966-7c83bfc8016a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:52.438318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9bd58-0ed7-41b4-b966-7c83bfc8016a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:52.438766 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9bd58-0ed7-41b4-b966-7c83bfc8016a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:52.439690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9bd58-0ed7-41b4-b966-7c83bfc8016a None admin] RBAC: Adding query filter params (role.id=b4c209d1895841af9203c4e432176eb9, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=2c9158ce9d8a4aadbf86405657958c48) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:52.440232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9bd58-0ed7-41b4-b966-7c83bfc8016a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:52.442843 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9bd58-0ed7-41b4-b966-7c83bfc8016a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:52.446883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c072f-02d1-4dbd-a43c-2f8d87c6a1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:52.447661 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c072f-02d1-4dbd-a43c-2f8d87c6a1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:52.447998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c072f-02d1-4dbd-a43c-2f8d87c6a1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:52.448339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c072f-02d1-4dbd-a43c-2f8d87c6a1a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:52.451415 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 267/537] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:52 2022] GET /identity/v3/role_assignments?user.id=2c9158ce9d8a4aadbf86405657958c48&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=b4c209d1895841af9203c4e432176eb9 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:52.452454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9bd58-0ed7-41b4-b966-7c83bfc8016a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:52.465727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c072f-02d1-4dbd-a43c-2f8d87c6a1a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:52.467398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c072f-02d1-4dbd-a43c-2f8d87c6a1a9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:52.492068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-670c072f-02d1-4dbd-a43c-2f8d87c6a1a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:52.492068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:52.492068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:52.492068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:52.492068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:52.492068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:52.492068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:52.492068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:52.492068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:52.492068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:52.492068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:52.492068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:52.492068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:12:52.492068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:12:52.492068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:52.493074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:52.494203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:12:52.494203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:12:52.494203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:12:52.494203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:12:52.494203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:12:52.494203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:12:52.494203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:52.494203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:52.494203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 271/538] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:52.494758 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b8314-dc40-4796-ab37-f27176cbd836 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:52.495026 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b8314-dc40-4796-ab37-f27176cbd836 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:52.495126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b8314-dc40-4796-ab37-f27176cbd836 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:52.497415 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 272/539] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:52.501860 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5ce08-a566-4098-a552-05f54f3e608f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:52.502219 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5ce08-a566-4098-a552-05f54f3e608f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:52.502886 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5ce08-a566-4098-a552-05f54f3e608f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:52.523975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a1d5ce08-a566-4098-a552-05f54f3e608f None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:52.525380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a1d5ce08-a566-4098-a552-05f54f3e608f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:52.577033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9bd58-0ed7-41b4-b966-7c83bfc8016a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:52.605208 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 273/540] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:52.606340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5ce08-a566-4098-a552-05f54f3e608f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:52.619239 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc17d37-f610-44b3-9b89-af47a8f6d457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:52.620135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc17d37-f610-44b3-9b89-af47a8f6d457 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:52.620658 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc17d37-f610-44b3-9b89-af47a8f6d457 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:52.621104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc17d37-f610-44b3-9b89-af47a8f6d457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:52.622114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc17d37-f610-44b3-9b89-af47a8f6d457 None admin] RBAC: Adding query filter params (role.id=b4c209d1895841af9203c4e432176eb9, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=1e52aae602104cc2b48354b2d75d359c) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:52.622607 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc17d37-f610-44b3-9b89-af47a8f6d457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:52.624289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc17d37-f610-44b3-9b89-af47a8f6d457 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:52.631626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 268/541] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:52 2022] GET /identity/v3/role_assignments?user.id=1e52aae602104cc2b48354b2d75d359c&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=b4c209d1895841af9203c4e432176eb9 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:52.640648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc17d37-f610-44b3-9b89-af47a8f6d457 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:52.684906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:52.729290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5ce08-a566-4098-a552-05f54f3e608f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:52.741761 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:52.769607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136444b-cedc-4cf1-8476-f374e67a679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:52.770364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136444b-cedc-4cf1-8476-f374e67a679d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:52.770717 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136444b-cedc-4cf1-8476-f374e67a679d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:52.771039 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136444b-cedc-4cf1-8476-f374e67a679d None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:52.771887 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136444b-cedc-4cf1-8476-f374e67a679d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:52.772275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136444b-cedc-4cf1-8476-f374e67a679d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:52.773762 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136444b-cedc-4cf1-8476-f374e67a679d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:52.786371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 274/542] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:12:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:52.789645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc17d37-f610-44b3-9b89-af47a8f6d457 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:52.792359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136444b-cedc-4cf1-8476-f374e67a679d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:52.842876 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734c998-1ad4-4593-98c5-80d3568fa363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:52.843093 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734c998-1ad4-4593-98c5-80d3568fa363 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:52.843195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734c998-1ad4-4593-98c5-80d3568fa363 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:52.844757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734c998-1ad4-4593-98c5-80d3568fa363 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:52.870279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734c998-1ad4-4593-98c5-80d3568fa363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-b734c998-1ad4-4593-98c5-80d3568fa363 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:52.878299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:52.879402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:52.880364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:52.880364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:52.880364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:52.880364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:52.880364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:52.880364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:52.880364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:52.880364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:52.880364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:52.880364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:52.880364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:52.880364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:52.883326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 269/543] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:12:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:12:52.889645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734c998-1ad4-4593-98c5-80d3568fa363 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:52.930202 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136444b-cedc-4cf1-8476-f374e67a679d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:52.995023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:53.013901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734c998-1ad4-4593-98c5-80d3568fa363 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:53.021943 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7eaaa-6718-482d-8ee4-e35a9972d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:53.022562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7eaaa-6718-482d-8ee4-e35a9972d978 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:53.022846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7eaaa-6718-482d-8ee4-e35a9972d978 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:53.023117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7eaaa-6718-482d-8ee4-e35a9972d978 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:53.023851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7eaaa-6718-482d-8ee4-e35a9972d978 None admin] RBAC: Adding query filter params (role.id=b4c209d1895841af9203c4e432176eb9, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=16d2570f97234d62948762562616000c) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:53.024134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7eaaa-6718-482d-8ee4-e35a9972d978 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:53.025699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7eaaa-6718-482d-8ee4-e35a9972d978 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:53.038726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 275/544] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:52 2022] GET /identity/v3/role_assignments?user.id=16d2570f97234d62948762562616000c&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=b4c209d1895841af9203c4e432176eb9 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:53.053914 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eddd5b-4e48-41f3-8fd1-40b2b0ec9d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:53.054836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eddd5b-4e48-41f3-8fd1-40b2b0ec9d81 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:53.055251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eddd5b-4e48-41f3-8fd1-40b2b0ec9d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:53.055655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eddd5b-4e48-41f3-8fd1-40b2b0ec9d81 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:53.056454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eddd5b-4e48-41f3-8fd1-40b2b0ec9d81 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:53.056931 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eddd5b-4e48-41f3-8fd1-40b2b0ec9d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:53.058456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eddd5b-4e48-41f3-8fd1-40b2b0ec9d81 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:53.068334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 270/545] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:12:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:53.074253 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7eaaa-6718-482d-8ee4-e35a9972d978 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:53.109813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:53.189585 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7eaaa-6718-482d-8ee4-e35a9972d978 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:53.228059 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc65f2-27f0-4808-9a7c-34d8df85ae17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:53.229000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc65f2-27f0-4808-9a7c-34d8df85ae17 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:53.229418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc65f2-27f0-4808-9a7c-34d8df85ae17 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:53.229827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc65f2-27f0-4808-9a7c-34d8df85ae17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:53.242898 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc65f2-27f0-4808-9a7c-34d8df85ae17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:53.245208 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc65f2-27f0-4808-9a7c-34d8df85ae17 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-d0fc65f2-27f0-4808-9a7c-34d8df85ae17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:53.260693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:53.261808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:53.262803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:53.262803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:53.262803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:53.264488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 276/546] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:53.271006 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eddd5b-4e48-41f3-8fd1-40b2b0ec9d81 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:53.364264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a42a6-84d2-4a7d-8656-10092e6a85cf None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:53.364776 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a42a6-84d2-4a7d-8656-10092e6a85cf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:53.364776 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a42a6-84d2-4a7d-8656-10092e6a85cf None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:53.366455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 277/547] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:12:53.371965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7606b2-86a1-4b95-9869-59aff1492601 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:53.372244 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7606b2-86a1-4b95-9869-59aff1492601 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:53.372514 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7606b2-86a1-4b95-9869-59aff1492601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:53.388965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eddd5b-4e48-41f3-8fd1-40b2b0ec9d81 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:53.396112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2e7606b2-86a1-4b95-9869-59aff1492601 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:53.397750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2e7606b2-86a1-4b95-9869-59aff1492601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:53.428873 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c8a3c-e11d-42a9-85ed-5317322b0e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:53.430194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c8a3c-e11d-42a9-85ed-5317322b0e45 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:53.430670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c8a3c-e11d-42a9-85ed-5317322b0e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:53.432179 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c8a3c-e11d-42a9-85ed-5317322b0e45 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:53.433112 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c8a3c-e11d-42a9-85ed-5317322b0e45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:53.433614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c8a3c-e11d-42a9-85ed-5317322b0e45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:53.435181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c8a3c-e11d-42a9-85ed-5317322b0e45 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:53.447424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 271/548] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:53.453480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c8a3c-e11d-42a9-85ed-5317322b0e45 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:53.465921 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:53.488578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 278/549] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:53.515765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7606b2-86a1-4b95-9869-59aff1492601 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:53.533348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:53.628838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7606b2-86a1-4b95-9869-59aff1492601 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:53.667408 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82030883-493b-4754-8520-93d04ac8a2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:53.668191 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82030883-493b-4754-8520-93d04ac8a2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:53.668853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82030883-493b-4754-8520-93d04ac8a2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:53.669224 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82030883-493b-4754-8520-93d04ac8a2d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:53.680550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82030883-493b-4754-8520-93d04ac8a2d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-82030883-493b-4754-8520-93d04ac8a2d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:53.689861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:53.691407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:53.693157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:53.693157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:53.693157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:53.693157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:53.693157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:53.693157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:53.693157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:53.693157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:53.693157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:53.693157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:53.693157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:53.693157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:53.695001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c8a3c-e11d-42a9-85ed-5317322b0e45 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:53.695930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 279/550] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:12:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:12:53.705170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82030883-493b-4754-8520-93d04ac8a2d6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:53.731732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6290ed4-a8b2-439e-9565-af57d21afc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:53.732362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6290ed4-a8b2-439e-9565-af57d21afc9d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:53.732663 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6290ed4-a8b2-439e-9565-af57d21afc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:53.732937 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6290ed4-a8b2-439e-9565-af57d21afc9d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:53.741164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6290ed4-a8b2-439e-9565-af57d21afc9d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:53.742597 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6290ed4-a8b2-439e-9565-af57d21afc9d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e6290ed4-a8b2-439e-9565-af57d21afc9d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:12:53.756777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:53.757807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:53.758874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:53.758874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:53.758874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:12:53.758874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:12:53.758874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:12:53.758874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:12:53.758874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:12:53.758874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:12:53.758874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 16:12:53.758874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:53.758874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 272/551] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:12:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:53.765521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6290ed4-a8b2-439e-9565-af57d21afc9d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:53.809782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:53.839126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82030883-493b-4754-8520-93d04ac8a2d6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:53.880737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90df3f4-5b86-4aff-bb24-fe0ce5f9b590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:53.880737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90df3f4-5b86-4aff-bb24-fe0ce5f9b590 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:53.880737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90df3f4-5b86-4aff-bb24-fe0ce5f9b590 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:53.880737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90df3f4-5b86-4aff-bb24-fe0ce5f9b590 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:53.881164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90df3f4-5b86-4aff-bb24-fe0ce5f9b590 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:53.881164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90df3f4-5b86-4aff-bb24-fe0ce5f9b590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:53.881304 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90df3f4-5b86-4aff-bb24-fe0ce5f9b590 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:53.894212 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 280/552] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:12:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:53.900293 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90df3f4-5b86-4aff-bb24-fe0ce5f9b590 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:53.907234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:53.948183 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6290ed4-a8b2-439e-9565-af57d21afc9d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:53.983122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d557a64-f54c-4ed4-97bf-8053c7302672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:53.983122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d557a64-f54c-4ed4-97bf-8053c7302672 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:53.983122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d557a64-f54c-4ed4-97bf-8053c7302672 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:53.983122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d557a64-f54c-4ed4-97bf-8053c7302672 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:53.983628 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d557a64-f54c-4ed4-97bf-8053c7302672 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:53.983628 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d557a64-f54c-4ed4-97bf-8053c7302672 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:53.983628 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d557a64-f54c-4ed4-97bf-8053c7302672 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:54.000773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 273/553] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Aug 11 16:12:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:54.007045 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d557a64-f54c-4ed4-97bf-8053c7302672 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:54.098372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90df3f4-5b86-4aff-bb24-fe0ce5f9b590 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:54.167017 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2069f48-8f67-449d-ba56-25b8cd16a6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:54.170647 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2069f48-8f67-449d-ba56-25b8cd16a6cb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:54.171072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2069f48-8f67-449d-ba56-25b8cd16a6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:54.171502 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2069f48-8f67-449d-ba56-25b8cd16a6cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:54.177110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:54.193120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2069f48-8f67-449d-ba56-25b8cd16a6cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:54.194866 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2069f48-8f67-449d-ba56-25b8cd16a6cb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:54.198095 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d557a64-f54c-4ed4-97bf-8053c7302672 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e2069f48-8f67-449d-ba56-25b8cd16a6cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:54.219523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:54.220687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:54.221724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:54.221724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:54.221724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:54.225248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 281/554] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:54.231742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2069f48-8f67-449d-ba56-25b8cd16a6cb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:54.250989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:54.267540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d69edf-9a36-46d1-bfc8-ec1887d0fb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:54.268424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d69edf-9a36-46d1-bfc8-ec1887d0fb38 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:54.269116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d69edf-9a36-46d1-bfc8-ec1887d0fb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:54.270214 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d69edf-9a36-46d1-bfc8-ec1887d0fb38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:54.366940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2069f48-8f67-449d-ba56-25b8cd16a6cb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:54.408778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d69edf-9a36-46d1-bfc8-ec1887d0fb38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:54.411159 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d69edf-9a36-46d1-bfc8-ec1887d0fb38 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:54.436050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f3bad-dffe-4870-a0c4-f42c6260694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:54.436574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f3bad-dffe-4870-a0c4-f42c6260694a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:54.436882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f3bad-dffe-4870-a0c4-f42c6260694a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:54.437145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f3bad-dffe-4870-a0c4-f42c6260694a None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:54.437784 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f3bad-dffe-4870-a0c4-f42c6260694a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:54.438081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f3bad-dffe-4870-a0c4-f42c6260694a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:54.439415 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f3bad-dffe-4870-a0c4-f42c6260694a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:54.464775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 282/555] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:54.466256 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f3bad-dffe-4870-a0c4-f42c6260694a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:54.521918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 274/556] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:12:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:12:54.527064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d69edf-9a36-46d1-bfc8-ec1887d0fb38 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:54.562764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:54.575443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:54.650589 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d69edf-9a36-46d1-bfc8-ec1887d0fb38 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:54.692385 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faca4a-3e87-432a-b802-a0a47f75b6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:54.693972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faca4a-3e87-432a-b802-a0a47f75b6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:54.694606 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faca4a-3e87-432a-b802-a0a47f75b6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:54.695079 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faca4a-3e87-432a-b802-a0a47f75b6d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:54.707730 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9faca4a-3e87-432a-b802-a0a47f75b6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:54.709615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9faca4a-3e87-432a-b802-a0a47f75b6d2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:54.710701 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f3bad-dffe-4870-a0c4-f42c6260694a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c9faca4a-3e87-432a-b802-a0a47f75b6d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:54.727619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:54.729047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:54.729939 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:54.729939 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:54.729939 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:54.732835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 275/557] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:12:54.739000 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faca4a-3e87-432a-b802-a0a47f75b6d2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:54.764627 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a15cf2-809a-488a-a51f-cdf9e98503cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:54.765627 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a15cf2-809a-488a-a51f-cdf9e98503cb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:54.766487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a15cf2-809a-488a-a51f-cdf9e98503cb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:54.767012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a15cf2-809a-488a-a51f-cdf9e98503cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:54.776000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a15cf2-809a-488a-a51f-cdf9e98503cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:54.778221 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a15cf2-809a-488a-a51f-cdf9e98503cb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-94a15cf2-809a-488a-a51f-cdf9e98503cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:12:54.792062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:54.793060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:54.794227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:54.794227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:54.794227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:12:54.794227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:12:54.794227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:12:54.794227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:12:54.794227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:12:54.794227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:12:54.794227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:12:54.794227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:54.798356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 283/558] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Aug 11 16:12:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:12:54.805704 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a15cf2-809a-488a-a51f-cdf9e98503cb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:54.900682 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:54.943282 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faca4a-3e87-432a-b802-a0a47f75b6d2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:54.988822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a15cf2-809a-488a-a51f-cdf9e98503cb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:55.001620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:55.005585 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be272ab0-2015-4c05-ab27-3db6c2932a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:55.006191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be272ab0-2015-4c05-ab27-3db6c2932a8c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.006529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be272ab0-2015-4c05-ab27-3db6c2932a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.006801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be272ab0-2015-4c05-ab27-3db6c2932a8c None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.007445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be272ab0-2015-4c05-ab27-3db6c2932a8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:55.007744 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be272ab0-2015-4c05-ab27-3db6c2932a8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:55.009303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be272ab0-2015-4c05-ab27-3db6c2932a8c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:55.024655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 276/559] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:55.026108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea64ae8-d38c-4c4c-b282-c8d8965204b0 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.026544 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea64ae8-d38c-4c4c-b282-c8d8965204b0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.026946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea64ae8-d38c-4c4c-b282-c8d8965204b0 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.032433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 277/560] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:55.033361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea64ae8-d38c-4c4c-b282-c8d8965204b0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:55.036212 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea44808-293b-461d-a623-fb1731f1fa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:55.036860 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea44808-293b-461d-a623-fb1731f1fa67 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.037129 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea44808-293b-461d-a623-fb1731f1fa67 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.037401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea44808-293b-461d-a623-fb1731f1fa67 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.038128 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea44808-293b-461d-a623-fb1731f1fa67 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:55.038426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea44808-293b-461d-a623-fb1731f1fa67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:55.039831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea44808-293b-461d-a623-fb1731f1fa67 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:55.060679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 284/561] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Aug 11 16:12:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:55.063185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691c9da-5d42-4a4d-ad75-cbb78659c866 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.064328 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691c9da-5d42-4a4d-ad75-cbb78659c866 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.064997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691c9da-5d42-4a4d-ad75-cbb78659c866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.085486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3691c9da-5d42-4a4d-ad75-cbb78659c866 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:55.087189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3691c9da-5d42-4a4d-ad75-cbb78659c866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:55.160525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea64ae8-d38c-4c4c-b282-c8d8965204b0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:55.162183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 285/562] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:55.163349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691c9da-5d42-4a4d-ad75-cbb78659c866 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:55.215488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8520df-02db-4896-9de6-d6d9c8a340e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:55.216023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8520df-02db-4896-9de6-d6d9c8a340e6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.216293 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8520df-02db-4896-9de6-d6d9c8a340e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.216557 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8520df-02db-4896-9de6-d6d9c8a340e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.223125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8520df-02db-4896-9de6-d6d9c8a340e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:55.224545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8520df-02db-4896-9de6-d6d9c8a340e6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:55.226261 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:55.237135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-be8520df-02db-4896-9de6-d6d9c8a340e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:55.237135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:55.237135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:55.237135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:55.237135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:55.237135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:55.237135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:55.237135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:55.237135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:55.237135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:55.237135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:55.237135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:55.237135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:12:55.237135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:12:55.237135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:55.238200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:55.239279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:12:55.239279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:12:55.239279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:12:55.239279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:12:55.239279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:12:55.239279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:12:55.239279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:55.239279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:55.244739 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 278/563] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:55.244739 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8520df-02db-4896-9de6-d6d9c8a340e6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:55.278299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:55.285486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691c9da-5d42-4a4d-ad75-cbb78659c866 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:55.321750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb5fdd-417b-4d3d-b64f-a4380605cf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:55.322374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5fdd-417b-4d3d-b64f-a4380605cf94 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.322652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5fdd-417b-4d3d-b64f-a4380605cf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.322919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5fdd-417b-4d3d-b64f-a4380605cf94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.333425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb5fdd-417b-4d3d-b64f-a4380605cf94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:55.334857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb5fdd-417b-4d3d-b64f-a4380605cf94 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:55.349363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8520df-02db-4896-9de6-d6d9c8a340e6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-29bb5fdd-417b-4d3d-b64f-a4380605cf94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:55.349924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:55.350822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:55.351693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:55.351693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:55.351693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:55.351693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 286/564] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:55.352335 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b4ae2-bf6f-4d64-bf72-67e607fa6da9 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.352653 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b4ae2-bf6f-4d64-bf72-67e607fa6da9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.352815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b4ae2-bf6f-4d64-bf72-67e607fa6da9 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.356712 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 287/565] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:55.356712 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b4ae2-bf6f-4d64-bf72-67e607fa6da9 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:55.391476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3d713-659a-4335-ad21-de84fdbd01a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:55.392181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3d713-659a-4335-ad21-de84fdbd01a3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.392506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3d713-659a-4335-ad21-de84fdbd01a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.392848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3d713-659a-4335-ad21-de84fdbd01a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.404518 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3d713-659a-4335-ad21-de84fdbd01a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-33c3d713-659a-4335-ad21-de84fdbd01a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:55.409587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:55.410734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:55.411737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:55.411737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:55.411737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:55.411737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:55.411737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:55.411737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:55.411737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:55.411737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:55.411737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:55.411737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:55.411737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:55.411737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:55.411737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 279/566] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:12:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:55.411737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3d713-659a-4335-ad21-de84fdbd01a3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:55.476315 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b4ae2-bf6f-4d64-bf72-67e607fa6da9 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:55.478096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:55.511480 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adcefb-091c-4d9b-b5b6-7cd1e378d62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:55.512071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adcefb-091c-4d9b-b5b6-7cd1e378d62a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.512341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adcefb-091c-4d9b-b5b6-7cd1e378d62a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.512629 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adcefb-091c-4d9b-b5b6-7cd1e378d62a None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.513311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adcefb-091c-4d9b-b5b6-7cd1e378d62a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:55.513606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adcefb-091c-4d9b-b5b6-7cd1e378d62a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:55.515014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adcefb-091c-4d9b-b5b6-7cd1e378d62a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:55.521942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3d713-659a-4335-ad21-de84fdbd01a3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:55.526780 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 288/567] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:12:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:55.527932 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21374cc9-93d5-4068-a905-4b2103c2607f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.528207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21374cc9-93d5-4068-a905-4b2103c2607f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.528471 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21374cc9-93d5-4068-a905-4b2103c2607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.547346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-21374cc9-93d5-4068-a905-4b2103c2607f None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:55.548500 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-21374cc9-93d5-4068-a905-4b2103c2607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:55.550425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:55.556168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6a9bd-7afe-4dfe-897e-9e1b582797fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:55.556809 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6a9bd-7afe-4dfe-897e-9e1b582797fb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.557086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6a9bd-7afe-4dfe-897e-9e1b582797fb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.557351 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6a9bd-7afe-4dfe-897e-9e1b582797fb None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.557984 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6a9bd-7afe-4dfe-897e-9e1b582797fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:55.558280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6a9bd-7afe-4dfe-897e-9e1b582797fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:55.559617 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6a9bd-7afe-4dfe-897e-9e1b582797fb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:55.571407 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 280/568] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:55.572175 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6a9bd-7afe-4dfe-897e-9e1b582797fb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:55.616509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 289/569] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:55.617859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444f9f8-60d8-410d-834b-3f1d3bc1f9e0 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.618153 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444f9f8-60d8-410d-834b-3f1d3bc1f9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.618424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444f9f8-60d8-410d-834b-3f1d3bc1f9e0 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.619768 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 290/570] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:55.620381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444f9f8-60d8-410d-834b-3f1d3bc1f9e0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:55.667760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6a9bd-7afe-4dfe-897e-9e1b582797fb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:55.685757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:55.702507 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb95da-33ac-4125-a0db-b2262d06526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:55.703097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb95da-33ac-4125-a0db-b2262d06526a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.703370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb95da-33ac-4125-a0db-b2262d06526a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.703636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb95da-33ac-4125-a0db-b2262d06526a None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.704286 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb95da-33ac-4125-a0db-b2262d06526a None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:55.704663 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb95da-33ac-4125-a0db-b2262d06526a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:55.706019 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb95da-33ac-4125-a0db-b2262d06526a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:55.713721 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 281/571] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:12:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:55.714479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb95da-33ac-4125-a0db-b2262d06526a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:55.729562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444f9f8-60d8-410d-834b-3f1d3bc1f9e0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:55.763196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42a293-92eb-43a8-8d03-81f65674f868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:55.763782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42a293-92eb-43a8-8d03-81f65674f868 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.764057 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42a293-92eb-43a8-8d03-81f65674f868 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.764326 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42a293-92eb-43a8-8d03-81f65674f868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.765076 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42a293-92eb-43a8-8d03-81f65674f868 None admin] RBAC: Adding query filter params (role.id=b4c209d1895841af9203c4e432176eb9, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=2b629970ca1a4d7fa4c4f2365e671a80) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:55.765379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42a293-92eb-43a8-8d03-81f65674f868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:55.766777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42a293-92eb-43a8-8d03-81f65674f868 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:55.772434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 291/572] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:12:55 2022] GET /identity/v3/role_assignments?user.id=2b629970ca1a4d7fa4c4f2365e671a80&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=b4c209d1895841af9203c4e432176eb9 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:55.773598 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b162d1-df66-4c43-828d-c38228737212 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.773906 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b162d1-df66-4c43-828d-c38228737212 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.774177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b162d1-df66-4c43-828d-c38228737212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.780374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:55.794645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c1b162d1-df66-4c43-828d-c38228737212 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:55.795879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c1b162d1-df66-4c43-828d-c38228737212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:55.826615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb95da-33ac-4125-a0db-b2262d06526a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:55.863274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab9cd6-51cc-4a73-a9d1-e49ddcdbc36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:55.863907 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9cd6-51cc-4a73-a9d1-e49ddcdbc36f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:55.864184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9cd6-51cc-4a73-a9d1-e49ddcdbc36f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:55.864449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9cd6-51cc-4a73-a9d1-e49ddcdbc36f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:55.871797 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab9cd6-51cc-4a73-a9d1-e49ddcdbc36f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:55.873285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab9cd6-51cc-4a73-a9d1-e49ddcdbc36f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:55.874423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 292/573] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:55.875539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b162d1-df66-4c43-828d-c38228737212 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:55.897315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-ccab9cd6-51cc-4a73-a9d1-e49ddcdbc36f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:55.897315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:55.897315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:55.897315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:55.897315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:55.897315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:55.897315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:55.897315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:55.897315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:55.897315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:55.897315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:55.897315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:55.897315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:12:55.897315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:12:55.897315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:55.898263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:55.899138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:12:55.899138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:12:55.899138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:12:55.899138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:12:55.899138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:12:55.899138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:12:55.899138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:55.899138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:55.900766 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 282/574] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:55.901820 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab9cd6-51cc-4a73-a9d1-e49ddcdbc36f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:55.948118 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:55.998040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b162d1-df66-4c43-828d-c38228737212 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:56.009476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab9cd6-51cc-4a73-a9d1-e49ddcdbc36f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:56.027314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:56.033186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cfcb2-8ecd-4d19-a4c5-77a4ca7173bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:56.033813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cfcb2-8ecd-4d19-a4c5-77a4ca7173bf None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:56.034091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cfcb2-8ecd-4d19-a4c5-77a4ca7173bf None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:56.034360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cfcb2-8ecd-4d19-a4c5-77a4ca7173bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:56.044900 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a629a-f9f5-4845-be90-540220849fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:56.045224 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cfcb2-8ecd-4d19-a4c5-77a4ca7173bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:56.045521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a629a-f9f5-4845-be90-540220849fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:56.045798 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a629a-f9f5-4845-be90-540220849fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:56.046066 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a629a-f9f5-4845-be90-540220849fb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ad4cfcb2-8ecd-4d19-a4c5-77a4ca7173bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:56.049826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:56.050808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:56.057134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:56.057134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:56.057134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:56.057134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:56.057134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:56.057134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:56.057134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:56.057134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:56.057134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:56.057134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:56.057134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:56.057134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:56.057134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 293/575] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:12:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:56.057134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cfcb2-8ecd-4d19-a4c5-77a4ca7173bf None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:56.062773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a629a-f9f5-4845-be90-540220849fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:56.064305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a629a-f9f5-4845-be90-540220849fb9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-505a629a-f9f5-4845-be90-540220849fb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:56.082609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:56.083635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:56.084513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:56.084513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:56.084513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:56.084513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 283/576] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:56.084513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a629a-f9f5-4845-be90-540220849fb9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:56.171151 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cfcb2-8ecd-4d19-a4c5-77a4ca7173bf None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:56.189904 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:56.199087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a629a-f9f5-4845-be90-540220849fb9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:56.210404 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807589c1-5099-451e-a281-6057f41ddf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:56.211256 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807589c1-5099-451e-a281-6057f41ddf48 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:56.211704 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807589c1-5099-451e-a281-6057f41ddf48 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:56.212142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807589c1-5099-451e-a281-6057f41ddf48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:56.225286 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807589c1-5099-451e-a281-6057f41ddf48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-807589c1-5099-451e-a281-6057f41ddf48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:56.230955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:56.231835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:56.233197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:56.233197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:56.233197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:56.233197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:56.233197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:56.233197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:56.233197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:56.233197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:56.233197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:56.233197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:56.233197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:56.233197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:56.233197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 294/577] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:12:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:56.233887 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807589c1-5099-451e-a281-6057f41ddf48 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:56.242341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f9d8a-f26a-4238-a791-a173a725ad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:56.242943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f9d8a-f26a-4238-a791-a173a725ad12 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:56.243220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f9d8a-f26a-4238-a791-a173a725ad12 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:56.243490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f9d8a-f26a-4238-a791-a173a725ad12 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:56.244183 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f9d8a-f26a-4238-a791-a173a725ad12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:56.244486 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f9d8a-f26a-4238-a791-a173a725ad12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:56.245931 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f9d8a-f26a-4238-a791-a173a725ad12 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:56.259786 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 284/578] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:56.260528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f9d8a-f26a-4238-a791-a173a725ad12 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:56.299840 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:56.351002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807589c1-5099-451e-a281-6057f41ddf48 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:56.366136 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f9d8a-f26a-4238-a791-a173a725ad12 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:56.387475 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff62e8-1dba-4dec-ad27-d4565b46cce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:56.388312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff62e8-1dba-4dec-ad27-d4565b46cce9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:56.388948 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff62e8-1dba-4dec-ad27-d4565b46cce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:56.389227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff62e8-1dba-4dec-ad27-d4565b46cce9 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:56.389999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff62e8-1dba-4dec-ad27-d4565b46cce9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:56.390295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff62e8-1dba-4dec-ad27-d4565b46cce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:56.391647 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff62e8-1dba-4dec-ad27-d4565b46cce9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:56.400518 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a5c8b-f7dc-4762-b77d-daa48e2365a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:56.401160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a5c8b-f7dc-4762-b77d-daa48e2365a1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:56.405705 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a5c8b-f7dc-4762-b77d-daa48e2365a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:56.405852 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 295/579] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:12:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:56.405933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a5c8b-f7dc-4762-b77d-daa48e2365a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:56.405933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a5c8b-f7dc-4762-b77d-daa48e2365a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:56.406056 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff62e8-1dba-4dec-ad27-d4565b46cce9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:56.406154 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a5c8b-f7dc-4762-b77d-daa48e2365a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:56.406154 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a5c8b-f7dc-4762-b77d-daa48e2365a1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:56.423413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 285/580] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:56.423413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a5c8b-f7dc-4762-b77d-daa48e2365a1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:56.436347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:56.526352 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff62e8-1dba-4dec-ad27-d4565b46cce9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:56.533603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a5c8b-f7dc-4762-b77d-daa48e2365a1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:56.540839 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:56.565675 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b413b-00a7-49fb-b37e-287132197281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:56.566274 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b413b-00a7-49fb-b37e-287132197281 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:56.566587 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b413b-00a7-49fb-b37e-287132197281 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:56.566894 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b413b-00a7-49fb-b37e-287132197281 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:56.567506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b413b-00a7-49fb-b37e-287132197281 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:56.567805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b413b-00a7-49fb-b37e-287132197281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:56.569188 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b413b-00a7-49fb-b37e-287132197281 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:56.570966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c90fb-e285-49a9-9b29-5bc2b911a59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:56.571607 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c90fb-e285-49a9-9b29-5bc2b911a59a None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:56.571879 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c90fb-e285-49a9-9b29-5bc2b911a59a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:56.572144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c90fb-e285-49a9-9b29-5bc2b911a59a None admin] PATH_INFO: `/v3/projects/3b0514f7236d42d1955e895adaf41389/users/4e91f3fbe098459dba0acf8ec1fb7098/roles/b4c209d1895841af9203c4e432176eb9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:56.581558 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 296/581] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:12:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:56.581558 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b413b-00a7-49fb-b37e-287132197281 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:56.589510 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c90fb-e285-49a9-9b29-5bc2b911a59a None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0514f7236d42d1955e895adaf41389, user_id=4e91f3fbe098459dba0acf8ec1fb7098, role_id=b4c209d1895841af9203c4e432176eb9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:56.590947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c90fb-e285-49a9-9b29-5bc2b911a59a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:56.604944 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 286/582] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:12:56 2022] PUT /identity/v3/projects/3b0514f7236d42d1955e895adaf41389/users/4e91f3fbe098459dba0acf8ec1fb7098/roles/b4c209d1895841af9203c4e432176eb9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:56.605765 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c90fb-e285-49a9-9b29-5bc2b911a59a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:56.692682 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:56.736635 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b413b-00a7-49fb-b37e-287132197281 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:56.742341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c90fb-e285-49a9-9b29-5bc2b911a59a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:56.777847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43904d-0775-4bdb-8f25-132f160fdfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:56.778768 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43904d-0775-4bdb-8f25-132f160fdfeb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:56.779045 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43904d-0775-4bdb-8f25-132f160fdfeb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:56.779315 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43904d-0775-4bdb-8f25-132f160fdfeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:56.786918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d3df-e8ec-471f-962c-621d5642cafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:56.787726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d3df-e8ec-471f-962c-621d5642cafd None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:56.787835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d3df-e8ec-471f-962c-621d5642cafd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:56.788082 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d3df-e8ec-471f-962c-621d5642cafd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:56.794135 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43904d-0775-4bdb-8f25-132f160fdfeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:56.795609 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43904d-0775-4bdb-8f25-132f160fdfeb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:56.800406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2d3df-e8ec-471f-962c-621d5642cafd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:56.801866 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2d3df-e8ec-471f-962c-621d5642cafd None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-fd43904d-0775-4bdb-8f25-132f160fdfeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:56.814058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:56.815032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:56.816034 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:56.816034 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:56.816034 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:56.816034 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 297/583] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:56.816873 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43904d-0775-4bdb-8f25-132f160fdfeb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-77c2d3df-e8ec-471f-962c-621d5642cafd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:12:56.816946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:56.817991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:56.826580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:56.826580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:56.826580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:12:56.826580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:12:56.826580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:12:56.826580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:12:56.826580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:12:56.826580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:12:56.826580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 16:12:56.826580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:56.826580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 287/584] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:56.826580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d3df-e8ec-471f-962c-621d5642cafd None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:56.854405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:56.934472 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43904d-0775-4bdb-8f25-132f160fdfeb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:56.963885 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d3df-e8ec-471f-962c-621d5642cafd None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:56.977566 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc67096-aaed-4ac2-9a8d-3ab21a383891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:56.978484 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc67096-aaed-4ac2-9a8d-3ab21a383891 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:56.978957 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc67096-aaed-4ac2-9a8d-3ab21a383891 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:56.979687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc67096-aaed-4ac2-9a8d-3ab21a383891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:56.988312 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:56.995202 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc67096-aaed-4ac2-9a8d-3ab21a383891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:56.997591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc67096-aaed-4ac2-9a8d-3ab21a383891 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:57.001433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb07f96-bb23-42e1-8fd6-e6829fdafe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:57.002157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb07f96-bb23-42e1-8fd6-e6829fdafe44 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:57.002499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb07f96-bb23-42e1-8fd6-e6829fdafe44 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:57.002835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb07f96-bb23-42e1-8fd6-e6829fdafe44 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:57.003593 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb07f96-bb23-42e1-8fd6-e6829fdafe44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:57.003984 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb07f96-bb23-42e1-8fd6-e6829fdafe44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:57.005484 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb07f96-bb23-42e1-8fd6-e6829fdafe44 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-8bc67096-aaed-4ac2-9a8d-3ab21a383891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:57.015757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:57.016869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:57.018088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:57.018088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:57.018088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:57.020380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 298/585] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:57.025169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 288/586] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:57.025690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb07f96-bb23-42e1-8fd6-e6829fdafe44 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:57.025835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc67096-aaed-4ac2-9a8d-3ab21a383891 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:57.129150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:57.136251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb07f96-bb23-42e1-8fd6-e6829fdafe44 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:57.152249 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc67096-aaed-4ac2-9a8d-3ab21a383891 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:57.179930 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17991ad-b59a-4f16-be8a-056029340f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:57.180968 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17991ad-b59a-4f16-be8a-056029340f3a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:57.181388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17991ad-b59a-4f16-be8a-056029340f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:57.182108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17991ad-b59a-4f16-be8a-056029340f3a None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:57.183159 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17991ad-b59a-4f16-be8a-056029340f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:57.183619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17991ad-b59a-4f16-be8a-056029340f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:57.185641 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17991ad-b59a-4f16-be8a-056029340f3a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:57.190032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea263e-1510-4d93-8350-297378691d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:57.190746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea263e-1510-4d93-8350-297378691d25 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:57.191119 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea263e-1510-4d93-8350-297378691d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:57.191637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea263e-1510-4d93-8350-297378691d25 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:57.192454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea263e-1510-4d93-8350-297378691d25 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:57.192882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea263e-1510-4d93-8350-297378691d25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:57.194720 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea263e-1510-4d93-8350-297378691d25 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:57.199837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 289/587] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:57.200863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17991ad-b59a-4f16-be8a-056029340f3a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:57.219963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 299/588] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Aug 11 16:12:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:57.219963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea263e-1510-4d93-8350-297378691d25 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:57.249780 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:57.308096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17991ad-b59a-4f16-be8a-056029340f3a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:57.337293 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea263e-1510-4d93-8350-297378691d25 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:57.342208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a90018-bb5e-4895-80f7-9b4bf349a62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:57.342838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a90018-bb5e-4895-80f7-9b4bf349a62e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:57.343112 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a90018-bb5e-4895-80f7-9b4bf349a62e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:57.343381 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a90018-bb5e-4895-80f7-9b4bf349a62e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:57.352717 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a90018-bb5e-4895-80f7-9b4bf349a62e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:57.354284 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a90018-bb5e-4895-80f7-9b4bf349a62e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-12a90018-bb5e-4895-80f7-9b4bf349a62e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:12:57.365757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:57.366690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:57.368003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:57.368003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:57.368003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:12:57.368003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:12:57.368003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:12:57.368003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:12:57.368003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:12:57.368003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:12:57.368003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 11 16:12:57.368003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:57.368003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 290/589] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:12:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:57.368003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a90018-bb5e-4895-80f7-9b4bf349a62e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:57.381427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd135bb-4b7b-4602-89c1-c3026972396e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:57.382542 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd135bb-4b7b-4602-89c1-c3026972396e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:57.383088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd135bb-4b7b-4602-89c1-c3026972396e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:57.383586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd135bb-4b7b-4602-89c1-c3026972396e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:57.395371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd135bb-4b7b-4602-89c1-c3026972396e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:57.397301 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd135bb-4b7b-4602-89c1-c3026972396e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:57.399740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ecd135bb-4b7b-4602-89c1-c3026972396e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:12:57.413303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:57.414261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:57.415197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:57.415197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:57.415197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:12:57.415197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:12:57.415197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:12:57.415197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:12:57.415197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:12:57.415197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:12:57.415197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 16:12:57.415197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:57.418045 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 300/590] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:12:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:57.419411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd135bb-4b7b-4602-89c1-c3026972396e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:57.487045 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a90018-bb5e-4895-80f7-9b4bf349a62e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:57.488615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:57.522979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d48c0-7eee-4eaf-87e7-223e1d2c0eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:57.523605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d48c0-7eee-4eaf-87e7-223e1d2c0eed None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:57.523878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d48c0-7eee-4eaf-87e7-223e1d2c0eed None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:57.524146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d48c0-7eee-4eaf-87e7-223e1d2c0eed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:57.533968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd135bb-4b7b-4602-89c1-c3026972396e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:57.534819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d48c0-7eee-4eaf-87e7-223e1d2c0eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:57.536323 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d48c0-7eee-4eaf-87e7-223e1d2c0eed None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e46d48c0-7eee-4eaf-87e7-223e1d2c0eed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:57.551770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:57.553028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:57.554229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:57.554229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:57.554229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:57.557519 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 291/591] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:57.558354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d48c0-7eee-4eaf-87e7-223e1d2c0eed None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:57.576016 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47e6aa-012d-48e7-b472-5af900307f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:57.576935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47e6aa-012d-48e7-b472-5af900307f32 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:57.577426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47e6aa-012d-48e7-b472-5af900307f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:57.578042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47e6aa-012d-48e7-b472-5af900307f32 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:57.579050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47e6aa-012d-48e7-b472-5af900307f32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:57.579586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47e6aa-012d-48e7-b472-5af900307f32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:57.581311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47e6aa-012d-48e7-b472-5af900307f32 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:57.601026 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 301/592] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Aug 11 16:12:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:57.602204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47e6aa-012d-48e7-b472-5af900307f32 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:57.667212 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:57.670088 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d48c0-7eee-4eaf-87e7-223e1d2c0eed None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:57.705359 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d75f8b-d0bd-490d-92bb-1ef06f562b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:57.706052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d75f8b-d0bd-490d-92bb-1ef06f562b32 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:57.706230 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d75f8b-d0bd-490d-92bb-1ef06f562b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:57.706492 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d75f8b-d0bd-490d-92bb-1ef06f562b32 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:57.707777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d75f8b-d0bd-490d-92bb-1ef06f562b32 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:57.708078 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d75f8b-d0bd-490d-92bb-1ef06f562b32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:57.709574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d75f8b-d0bd-490d-92bb-1ef06f562b32 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:57.718937 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47e6aa-012d-48e7-b472-5af900307f32 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:57.727385 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 292/593] 10.222.0.40 () {56 vars in 1139 bytes} [Thu Aug 11 16:12:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:57.728284 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d75f8b-d0bd-490d-92bb-1ef06f562b32 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:57.743411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:57.757724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98804842-08c7-490c-889a-22e3a9f34fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:57.758727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804842-08c7-490c-889a-22e3a9f34fdc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:57.759225 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804842-08c7-490c-889a-22e3a9f34fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:57.759704 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804842-08c7-490c-889a-22e3a9f34fdc None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:57.760545 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98804842-08c7-490c-889a-22e3a9f34fdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:57.761075 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98804842-08c7-490c-889a-22e3a9f34fdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:57.762699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98804842-08c7-490c-889a-22e3a9f34fdc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:57.779617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 302/594] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:57.781043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98804842-08c7-490c-889a-22e3a9f34fdc None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:57.836168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d75f8b-d0bd-490d-92bb-1ef06f562b32 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:57.871744 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab50d3-a95b-4d55-9a82-3039c66d93cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:57.872463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab50d3-a95b-4d55-9a82-3039c66d93cc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:57.872831 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab50d3-a95b-4d55-9a82-3039c66d93cc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:57.873172 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab50d3-a95b-4d55-9a82-3039c66d93cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:57.883830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab50d3-a95b-4d55-9a82-3039c66d93cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:57.885287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab50d3-a95b-4d55-9a82-3039c66d93cc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:57.889606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98804842-08c7-490c-889a-22e3a9f34fdc None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5bab50d3-a95b-4d55-9a82-3039c66d93cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:57.899781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:57.900774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:57.901693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:57.901693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:57.901693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:57.901693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 293/595] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:57.902625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc3441-c724-4221-aa25-afc17657fd8b None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:57.902625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc3441-c724-4221-aa25-afc17657fd8b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:57.902625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc3441-c724-4221-aa25-afc17657fd8b None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:57.907834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 294/596] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:57.907834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc3441-c724-4221-aa25-afc17657fd8b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:57.914550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:57.934814 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc35898-9edd-4778-b261-bf5967fda165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:57.935768 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc35898-9edd-4778-b261-bf5967fda165 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:57.936178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc35898-9edd-4778-b261-bf5967fda165 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:57.936483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc35898-9edd-4778-b261-bf5967fda165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:57.948277 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc35898-9edd-4778-b261-bf5967fda165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:57.949834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc35898-9edd-4778-b261-bf5967fda165 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-adc35898-9edd-4778-b261-bf5967fda165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:57.966339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:57.967464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:57.968532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:57.968532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:57.968532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:57.972940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:57.973980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 303/597] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:57.974861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc35898-9edd-4778-b261-bf5967fda165 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:58.015353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc3441-c724-4221-aa25-afc17657fd8b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:58.049350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ece0-1b47-4f6e-a626-6c87cdf5d66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:58.050058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ece0-1b47-4f6e-a626-6c87cdf5d66e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:58.050398 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ece0-1b47-4f6e-a626-6c87cdf5d66e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:58.051250 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ece0-1b47-4f6e-a626-6c87cdf5d66e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:58.058333 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37ece0-1b47-4f6e-a626-6c87cdf5d66e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:58.059848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37ece0-1b47-4f6e-a626-6c87cdf5d66e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:58.072215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-fb37ece0-1b47-4f6e-a626-6c87cdf5d66e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:58.072215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:58.072215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:58.072215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:58.072215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:58.072215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:58.072215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:58.072215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:58.072215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:58.072215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:58.072215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:58.072215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:58.072215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:12:58.072215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:12:58.072215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:58.073274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:58.074328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:12:58.074328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:12:58.074328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:12:58.074328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:12:58.074328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:12:58.074328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:12:58.074328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:58.074328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:58.079463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 295/598] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:58.079463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c4c17-a036-485b-acc9-793ce00455a4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:58.079463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c4c17-a036-485b-acc9-793ce00455a4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:58.079463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c4c17-a036-485b-acc9-793ce00455a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:58.086802 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc35898-9edd-4778-b261-bf5967fda165 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:58.095423 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-067c4c17-a036-485b-acc9-793ce00455a4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:58.096973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-067c4c17-a036-485b-acc9-793ce00455a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:58.124043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcd909-c2c3-4822-90dc-7d8676011f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:58.124833 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcd909-c2c3-4822-90dc-7d8676011f9b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:58.125120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcd909-c2c3-4822-90dc-7d8676011f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:58.125388 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcd909-c2c3-4822-90dc-7d8676011f9b None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:58.126338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcd909-c2c3-4822-90dc-7d8676011f9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:58.126893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcd909-c2c3-4822-90dc-7d8676011f9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:58.128422 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcd909-c2c3-4822-90dc-7d8676011f9b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:58.148675 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 304/599] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:58.148675 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcd909-c2c3-4822-90dc-7d8676011f9b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:58.172783 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 296/600] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:58.172783 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c4c17-a036-485b-acc9-793ce00455a4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:58.192908 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:58.229641 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:58.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcd909-c2c3-4822-90dc-7d8676011f9b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:58.277275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c4c17-a036-485b-acc9-793ce00455a4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:58.308568 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fe5e8-cace-49fb-afe6-43bae727b2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:58.309294 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fe5e8-cace-49fb-afe6-43bae727b2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:58.309502 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fe5e8-cace-49fb-afe6-43bae727b2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:58.309731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fe5e8-cace-49fb-afe6-43bae727b2b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:58.310360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fe5e8-cace-49fb-afe6-43bae727b2b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:58.310791 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fe5e8-cace-49fb-afe6-43bae727b2b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:58.311986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fe5e8-cace-49fb-afe6-43bae727b2b5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:58.315941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b152f-f35f-4934-96a5-d9fc54edf437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:58.316567 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b152f-f35f-4934-96a5-d9fc54edf437 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:58.316872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b152f-f35f-4934-96a5-d9fc54edf437 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:58.317138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b152f-f35f-4934-96a5-d9fc54edf437 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:58.317825 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b152f-f35f-4934-96a5-d9fc54edf437 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:58.318127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b152f-f35f-4934-96a5-d9fc54edf437 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:58.319987 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b152f-f35f-4934-96a5-d9fc54edf437 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:58.323121 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 305/601] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:58.327841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fe5e8-cace-49fb-afe6-43bae727b2b5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:58.337637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 297/602] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:58.337637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b152f-f35f-4934-96a5-d9fc54edf437 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:58.425207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:58.439834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fe5e8-cace-49fb-afe6-43bae727b2b5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:58.444867 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b152f-f35f-4934-96a5-d9fc54edf437 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:58.460426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:58.481023 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55734b-f318-4317-910c-327fa03bbb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:58.481652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55734b-f318-4317-910c-327fa03bbb6b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:58.481926 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55734b-f318-4317-910c-327fa03bbb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:58.482193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55734b-f318-4317-910c-327fa03bbb6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:58.484219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990f9a2-c024-42e1-bd41-80a84ae329b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:58.484884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990f9a2-c024-42e1-bd41-80a84ae329b9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:58.485158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990f9a2-c024-42e1-bd41-80a84ae329b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:58.485425 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990f9a2-c024-42e1-bd41-80a84ae329b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:58.490211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55734b-f318-4317-910c-327fa03bbb6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:58.491877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55734b-f318-4317-910c-327fa03bbb6b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:58.495785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990f9a2-c024-42e1-bd41-80a84ae329b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5990f9a2-c024-42e1-bd41-80a84ae329b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:58.500988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:58.501906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:58.503354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:58.503354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:58.503354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:58.503354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:58.503354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:58.503354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:58.503354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:58.503354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:58.503354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:58.503354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:58.503354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:58.503354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:58.503354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 298/603] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:12:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:58.503354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990f9a2-c024-42e1-bd41-80a84ae329b9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:58.508259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-7a55734b-f318-4317-910c-327fa03bbb6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:58.508259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:58.508259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:58.508259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:58.508259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:58.508259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:58.508259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:58.508259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:58.508259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:58.508259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:58.508259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:58.508259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:58.508259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:12:58.508259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:12:58.508259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:58.509150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:58.510079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:12:58.510079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:12:58.510079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:12:58.510079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:12:58.510079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:12:58.510079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:12:58.510079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:58.510079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:58.513878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 306/604] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:58.514528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55734b-f318-4317-910c-327fa03bbb6b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:58.611241 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990f9a2-c024-42e1-bd41-80a84ae329b9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:58.626001 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55734b-f318-4317-910c-327fa03bbb6b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:58.651182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fce9e-b0c7-4272-bc8d-dfaa04957aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:58.651816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fce9e-b0c7-4272-bc8d-dfaa04957aba None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:58.652089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fce9e-b0c7-4272-bc8d-dfaa04957aba None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:58.652369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fce9e-b0c7-4272-bc8d-dfaa04957aba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:58.659142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fce9e-b0c7-4272-bc8d-dfaa04957aba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:58.661194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fce9e-b0c7-4272-bc8d-dfaa04957aba None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:58.664148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb2f2c-3c4e-4de0-b048-a5a5167e73b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:58.664995 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2f2c-3c4e-4de0-b048-a5a5167e73b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:58.665411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2f2c-3c4e-4de0-b048-a5a5167e73b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:58.665823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2f2c-3c4e-4de0-b048-a5a5167e73b9 None admin] PATH_INFO: `/v3/projects/3b0514f7236d42d1955e895adaf41389/users/1e52aae602104cc2b48354b2d75d359c/roles/b4c209d1895841af9203c4e432176eb9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:58.672521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-992fce9e-b0c7-4272-bc8d-dfaa04957aba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:58.672521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:58.672521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:58.672521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:58.672521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:58.672521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:58.672521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:58.672521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:58.672521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:58.672521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:58.672521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:58.672521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:58.672521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:12:58.672521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:12:58.672521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:58.673611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:58.674684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:12:58.674684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:12:58.674684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:12:58.674684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:12:58.674684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:12:58.674684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:12:58.674684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:12:58.674684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:58.678356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 299/605] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:12:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:58.679242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fce9e-b0c7-4272-bc8d-dfaa04957aba None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:58.685297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb2f2c-3c4e-4de0-b048-a5a5167e73b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0514f7236d42d1955e895adaf41389, user_id=1e52aae602104cc2b48354b2d75d359c, role_id=b4c209d1895841af9203c4e432176eb9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:58.686970 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb2f2c-3c4e-4de0-b048-a5a5167e73b9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:58.698199 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:58.703529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 307/606] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:12:58 2022] PUT /identity/v3/projects/3b0514f7236d42d1955e895adaf41389/users/1e52aae602104cc2b48354b2d75d359c/roles/b4c209d1895841af9203c4e432176eb9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:58.704790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb2f2c-3c4e-4de0-b048-a5a5167e73b9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:58.720364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:58.802391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fce9e-b0c7-4272-bc8d-dfaa04957aba None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:58.818708 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb2f2c-3c4e-4de0-b048-a5a5167e73b9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:58.840758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec64ac3-f201-4ed6-85e9-d9d409b76a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:58.841384 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec64ac3-f201-4ed6-85e9-d9d409b76a00 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:58.841664 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec64ac3-f201-4ed6-85e9-d9d409b76a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:58.841936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec64ac3-f201-4ed6-85e9-d9d409b76a00 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:58.842730 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec64ac3-f201-4ed6-85e9-d9d409b76a00 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:58.842919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec64ac3-f201-4ed6-85e9-d9d409b76a00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:58.844347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec64ac3-f201-4ed6-85e9-d9d409b76a00 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:58.854574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 300/607] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:12:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:58.856086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec64ac3-f201-4ed6-85e9-d9d409b76a00 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:58.867645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550a033-3dda-42ac-8ddb-c072e33e51e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:58.868639 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550a033-3dda-42ac-8ddb-c072e33e51e1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:58.868918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550a033-3dda-42ac-8ddb-c072e33e51e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:58.869185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550a033-3dda-42ac-8ddb-c072e33e51e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:58.870193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550a033-3dda-42ac-8ddb-c072e33e51e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:58.870649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550a033-3dda-42ac-8ddb-c072e33e51e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:58.872063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550a033-3dda-42ac-8ddb-c072e33e51e1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:58.884889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 308/608] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:58.886120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1c9a2-71af-4948-9fce-a180f8ba0d5c None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:58.886403 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1c9a2-71af-4948-9fce-a180f8ba0d5c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:58.886673 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1c9a2-71af-4948-9fce-a180f8ba0d5c None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:58.887915 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 309/609] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:12:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:12:58.888725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1c9a2-71af-4948-9fce-a180f8ba0d5c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:58.949468 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:58.958029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:58.964964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec64ac3-f201-4ed6-85e9-d9d409b76a00 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:58.997449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1c9a2-71af-4948-9fce-a180f8ba0d5c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:59.000755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42ed9b-e1a6-464e-ae7b-df9c7a0c9a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:59.001513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42ed9b-e1a6-464e-ae7b-df9c7a0c9a8d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:59.001949 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42ed9b-e1a6-464e-ae7b-df9c7a0c9a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:59.002354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42ed9b-e1a6-464e-ae7b-df9c7a0c9a8d None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:59.003177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42ed9b-e1a6-464e-ae7b-df9c7a0c9a8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:59.003621 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42ed9b-e1a6-464e-ae7b-df9c7a0c9a8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:59.005781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42ed9b-e1a6-464e-ae7b-df9c7a0c9a8d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:59.018476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 301/610] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:59.020514 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42ed9b-e1a6-464e-ae7b-df9c7a0c9a8d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:59.033482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2898a-7730-4860-b053-72e469b17aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:59.034128 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2898a-7730-4860-b053-72e469b17aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:59.034371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2898a-7730-4860-b053-72e469b17aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:59.034638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2898a-7730-4860-b053-72e469b17aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:59.045698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2898a-7730-4860-b053-72e469b17aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:59.047131 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2898a-7730-4860-b053-72e469b17aa7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-0ba2898a-7730-4860-b053-72e469b17aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:12:59.061015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:59.061968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:12:59.062824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:12:59.062824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:12:59.062824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:59.062824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 310/611] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:59.063470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af03a2-acfd-4bb7-8363-4cb09bf0cc6e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:59.063470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af03a2-acfd-4bb7-8363-4cb09bf0cc6e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:59.063748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af03a2-acfd-4bb7-8363-4cb09bf0cc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:59.082983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-45af03a2-acfd-4bb7-8363-4cb09bf0cc6e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:12:59.084153 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-45af03a2-acfd-4bb7-8363-4cb09bf0cc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:12:59.131163 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42ed9b-e1a6-464e-ae7b-df9c7a0c9a8d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:59.164611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 311/612] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:12:59.164611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af03a2-acfd-4bb7-8363-4cb09bf0cc6e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:59.180241 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ca697-1360-4b1b-b2e7-caa51d53501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:59.180937 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ca697-1360-4b1b-b2e7-caa51d53501b None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:59.181221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ca697-1360-4b1b-b2e7-caa51d53501b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:59.181493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ca697-1360-4b1b-b2e7-caa51d53501b None admin] PATH_INFO: `/v3/projects/3b0514f7236d42d1955e895adaf41389/users/2c9158ce9d8a4aadbf86405657958c48/roles/b4c209d1895841af9203c4e432176eb9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:59.197727 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ca697-1360-4b1b-b2e7-caa51d53501b None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0514f7236d42d1955e895adaf41389, user_id=2c9158ce9d8a4aadbf86405657958c48, role_id=b4c209d1895841af9203c4e432176eb9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:59.200186 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ca697-1360-4b1b-b2e7-caa51d53501b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:59.207572 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:59.214839 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 302/613] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:12:59 2022] PUT /identity/v3/projects/3b0514f7236d42d1955e895adaf41389/users/2c9158ce9d8a4aadbf86405657958c48/roles/b4c209d1895841af9203c4e432176eb9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:59.215865 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ca697-1360-4b1b-b2e7-caa51d53501b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:59.233803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:59.306394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af03a2-acfd-4bb7-8363-4cb09bf0cc6e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:59.351724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ca697-1360-4b1b-b2e7-caa51d53501b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:59.353669 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a76ee-132d-4054-8af7-5280aa0079b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:59.354755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a76ee-132d-4054-8af7-5280aa0079b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:59.355238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a76ee-132d-4054-8af7-5280aa0079b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:59.355740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a76ee-132d-4054-8af7-5280aa0079b4 None admin] PATH_INFO: `/v3/projects/3b0514f7236d42d1955e895adaf41389/users/16d2570f97234d62948762562616000c/roles/b4c209d1895841af9203c4e432176eb9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:59.374370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a76ee-132d-4054-8af7-5280aa0079b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0514f7236d42d1955e895adaf41389, user_id=16d2570f97234d62948762562616000c, role_id=b4c209d1895841af9203c4e432176eb9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:59.376360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a76ee-132d-4054-8af7-5280aa0079b4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:59.392668 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 312/614] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:12:59 2022] PUT /identity/v3/projects/3b0514f7236d42d1955e895adaf41389/users/16d2570f97234d62948762562616000c/roles/b4c209d1895841af9203c4e432176eb9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:12:59.393816 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a76ee-132d-4054-8af7-5280aa0079b4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:59.394735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b6d1a-f03e-4e83-96bf-605b2e000458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:59.395323 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b6d1a-f03e-4e83-96bf-605b2e000458 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:59.395597 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b6d1a-f03e-4e83-96bf-605b2e000458 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:59.395867 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b6d1a-f03e-4e83-96bf-605b2e000458 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:59.396521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b6d1a-f03e-4e83-96bf-605b2e000458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:59.396862 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b6d1a-f03e-4e83-96bf-605b2e000458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:59.398501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b6d1a-f03e-4e83-96bf-605b2e000458 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:59.414454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 303/615] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:12:59.421535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b6d1a-f03e-4e83-96bf-605b2e000458 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:59.522790 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:59.558538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:59.571992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b6d1a-f03e-4e83-96bf-605b2e000458 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:59.581440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a76ee-132d-4054-8af7-5280aa0079b4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:59.614894 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094cf57-36e7-4cab-9e06-135081030776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:59.616306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094cf57-36e7-4cab-9e06-135081030776 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:59.616824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094cf57-36e7-4cab-9e06-135081030776 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:59.617627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094cf57-36e7-4cab-9e06-135081030776 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:59.627143 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094cf57-36e7-4cab-9e06-135081030776 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:59.629664 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094cf57-36e7-4cab-9e06-135081030776 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-d094cf57-36e7-4cab-9e06-135081030776 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:12:59.644121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:59.645892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:59.647037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:59.647037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:59.647037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:12:59.647037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:12:59.647037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:12:59.647037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:12:59.647037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:12:59.647037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:12:59.647037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 16:12:59.647037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:12:59.649790 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 304/616] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:12:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:12:59.655187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094cf57-36e7-4cab-9e06-135081030776 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:59.659232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1821e1-989e-4a7c-976d-15c81648f0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:59.660072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1821e1-989e-4a7c-976d-15c81648f0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:59.660615 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1821e1-989e-4a7c-976d-15c81648f0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:59.661403 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1821e1-989e-4a7c-976d-15c81648f0e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:59.680230 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1821e1-989e-4a7c-976d-15c81648f0e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6e1821e1-989e-4a7c-976d-15c81648f0e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:12:59.685042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:12:59.686079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:12:59.686975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:12:59.686975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:12:59.686975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:12:59.686975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:12:59.686975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:12:59.686975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:12:59.686975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:12:59.686975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:12:59.686975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:12:59.686975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:12:59.686975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:12:59.686975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:12:59.689041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 313/617] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:12:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:12:59.697212 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1821e1-989e-4a7c-976d-15c81648f0e8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:59.806268 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094cf57-36e7-4cab-9e06-135081030776 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:59.841115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:12:59.849288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aa8a8-a032-4493-b318-bd4a6eb2c0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:59.850378 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aa8a8-a032-4493-b318-bd4a6eb2c0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:59.850671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aa8a8-a032-4493-b318-bd4a6eb2c0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:59.850921 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aa8a8-a032-4493-b318-bd4a6eb2c0d6 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:59.851670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aa8a8-a032-4493-b318-bd4a6eb2c0d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:59.851974 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aa8a8-a032-4493-b318-bd4a6eb2c0d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:59.853649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aa8a8-a032-4493-b318-bd4a6eb2c0d6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:59.878111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 305/618] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Aug 11 16:12:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:12:59.880522 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aa8a8-a032-4493-b318-bd4a6eb2c0d6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:12:59.915281 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1821e1-989e-4a7c-976d-15c81648f0e8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:12:59.975990 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc065d9-4321-4e06-ba2f-df1af9be872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:12:59.984766 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc065d9-4321-4e06-ba2f-df1af9be872a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:12:59.985182 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc065d9-4321-4e06-ba2f-df1af9be872a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:12:59.985474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc065d9-4321-4e06-ba2f-df1af9be872a None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:12:59.986272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc065d9-4321-4e06-ba2f-df1af9be872a None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:12:59.986578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc065d9-4321-4e06-ba2f-df1af9be872a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:12:59.987946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc065d9-4321-4e06-ba2f-df1af9be872a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:12:59.989451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aa8a8-a032-4493-b318-bd4a6eb2c0d6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:00.001908 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 314/619] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:12:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:00.008264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc065d9-4321-4e06-ba2f-df1af9be872a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:00.031162 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c234db-388e-4ca7-a2eb-2fc87f4653dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:00.032547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c234db-388e-4ca7-a2eb-2fc87f4653dd None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:00.033051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c234db-388e-4ca7-a2eb-2fc87f4653dd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:00.033327 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c234db-388e-4ca7-a2eb-2fc87f4653dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:00.035795 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:00.057362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c234db-388e-4ca7-a2eb-2fc87f4653dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:00.059099 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c234db-388e-4ca7-a2eb-2fc87f4653dd None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-73c234db-388e-4ca7-a2eb-2fc87f4653dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:00.084686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:00.085969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:00.087032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:00.087032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:00.087032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:00.088838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 306/620] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:00.095438 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c234db-388e-4ca7-a2eb-2fc87f4653dd None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:00.172724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:00.214533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc065d9-4321-4e06-ba2f-df1af9be872a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:00.248370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c234db-388e-4ca7-a2eb-2fc87f4653dd None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:00.289622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4bf41-094f-4997-9b00-0d66ebd43d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:00.290232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4bf41-094f-4997-9b00-0d66ebd43d69 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:00.290506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4bf41-094f-4997-9b00-0d66ebd43d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:00.290774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4bf41-094f-4997-9b00-0d66ebd43d69 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:00.291417 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4bf41-094f-4997-9b00-0d66ebd43d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:00.291713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4bf41-094f-4997-9b00-0d66ebd43d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:00.294106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4bf41-094f-4997-9b00-0d66ebd43d69 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:00.299390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec131552-027e-4d73-815d-79a0d78a9cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:00.300011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec131552-027e-4d73-815d-79a0d78a9cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:00.300283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec131552-027e-4d73-815d-79a0d78a9cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:00.301103 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec131552-027e-4d73-815d-79a0d78a9cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:00.321486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec131552-027e-4d73-815d-79a0d78a9cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:00.323008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec131552-027e-4d73-815d-79a0d78a9cc7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:00.327878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 307/621] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:00.333898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4bf41-094f-4997-9b00-0d66ebd43d69 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ec131552-027e-4d73-815d-79a0d78a9cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:00.356486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:00.357610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:00.358465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:00.358465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:00.358465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:00.364915 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 315/622] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:00.380458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec131552-027e-4d73-815d-79a0d78a9cc7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:00.493035 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:00.502292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4bf41-094f-4997-9b00-0d66ebd43d69 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:00.536937 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:00.547541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73c41f-f30e-42ee-b4d8-685806d04b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:00.548179 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73c41f-f30e-42ee-b4d8-685806d04b76 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:00.548542 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73c41f-f30e-42ee-b4d8-685806d04b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:00.548755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73c41f-f30e-42ee-b4d8-685806d04b76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:00.565571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73c41f-f30e-42ee-b4d8-685806d04b76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:00.567562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73c41f-f30e-42ee-b4d8-685806d04b76 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:00.587340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-ea73c41f-f30e-42ee-b4d8-685806d04b76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:00.587340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:00.587340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:00.587340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:00.587340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:00.587340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:00.587340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:00.587340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:00.587340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:00.587340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:00.587340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:00.587340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:00.587340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:00.587340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:00.587340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:00.588233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:00.589142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:00.589142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:00.589142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:00.589142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:00.589142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:00.589142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:00.589142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:00.589142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:00.591144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 308/623] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:00.595164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73c41f-f30e-42ee-b4d8-685806d04b76 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:00.608405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec131552-027e-4d73-815d-79a0d78a9cc7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:00.666644 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31353cf1-8209-4f5c-82d8-62a9a79e339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:00.667367 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31353cf1-8209-4f5c-82d8-62a9a79e339a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:00.667579 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31353cf1-8209-4f5c-82d8-62a9a79e339a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:00.667753 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31353cf1-8209-4f5c-82d8-62a9a79e339a None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:00.669795 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31353cf1-8209-4f5c-82d8-62a9a79e339a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:00.670113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31353cf1-8209-4f5c-82d8-62a9a79e339a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:00.672268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31353cf1-8209-4f5c-82d8-62a9a79e339a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:00.695440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 316/624] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:00.699574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31353cf1-8209-4f5c-82d8-62a9a79e339a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:00.750512 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73c41f-f30e-42ee-b4d8-685806d04b76 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:00.791512 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5418008-7fc8-4907-8782-a32e40324d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:00.792119 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5418008-7fc8-4907-8782-a32e40324d58 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:00.792392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5418008-7fc8-4907-8782-a32e40324d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:00.792679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5418008-7fc8-4907-8782-a32e40324d58 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:00.793632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5418008-7fc8-4907-8782-a32e40324d58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:00.793935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5418008-7fc8-4907-8782-a32e40324d58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:00.795345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5418008-7fc8-4907-8782-a32e40324d58 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:00.824052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 309/625] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:00.837726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5418008-7fc8-4907-8782-a32e40324d58 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:00.872157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31353cf1-8209-4f5c-82d8-62a9a79e339a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:00.873978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:00.908813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:00.923535 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5964dc0-8eae-4f31-93db-8d43335f1809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:00.924277 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5964dc0-8eae-4f31-93db-8d43335f1809 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:00.925138 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5964dc0-8eae-4f31-93db-8d43335f1809 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:00.925437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5964dc0-8eae-4f31-93db-8d43335f1809 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:00.935546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5964dc0-8eae-4f31-93db-8d43335f1809 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:00.937010 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5964dc0-8eae-4f31-93db-8d43335f1809 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b5964dc0-8eae-4f31-93db-8d43335f1809 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:00.949398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:00.950359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:00.951382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:00.951382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:00.951382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:00.951382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:00.951382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:00.951382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:00.951382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:00.951382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:00.951382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:13:00.951382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:00.955204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 317/626] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Aug 11 16:13:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:00.956306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f62fe-2ce0-434d-b2b2-8c0c9e685da0 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:00.956596 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f62fe-2ce0-434d-b2b2-8c0c9e685da0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:00.956921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f62fe-2ce0-434d-b2b2-8c0c9e685da0 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:00.958414 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 318/627] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:00.959107 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f62fe-2ce0-434d-b2b2-8c0c9e685da0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:00.986370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5418008-7fc8-4907-8782-a32e40324d58 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:01.034553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24ddcf-7867-4931-b586-f08c8eb05f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:01.035239 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24ddcf-7867-4931-b586-f08c8eb05f67 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:01.035516 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24ddcf-7867-4931-b586-f08c8eb05f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:01.035787 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24ddcf-7867-4931-b586-f08c8eb05f67 None admin] PATH_INFO: `/v3/projects/3b0514f7236d42d1955e895adaf41389/users/2b629970ca1a4d7fa4c4f2365e671a80/roles/b4c209d1895841af9203c4e432176eb9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:01.056289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24ddcf-7867-4931-b586-f08c8eb05f67 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0514f7236d42d1955e895adaf41389, user_id=2b629970ca1a4d7fa4c4f2365e671a80, role_id=b4c209d1895841af9203c4e432176eb9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:01.058032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24ddcf-7867-4931-b586-f08c8eb05f67 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:01.080709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 310/628] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:13:00 2022] PUT /identity/v3/projects/3b0514f7236d42d1955e895adaf41389/users/2b629970ca1a4d7fa4c4f2365e671a80/roles/b4c209d1895841af9203c4e432176eb9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:13:01.082216 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a61feb-4e6d-41f7-b97c-f812d36030f6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:01.082496 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a61feb-4e6d-41f7-b97c-f812d36030f6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:01.082766 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a61feb-4e6d-41f7-b97c-f812d36030f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:01.088157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f62fe-2ce0-434d-b2b2-8c0c9e685da0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:01.121095 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-43a61feb-4e6d-41f7-b97c-f812d36030f6 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:01.123747 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-43a61feb-4e6d-41f7-b97c-f812d36030f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:01.163493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca2738-2af3-4e0f-9cf3-8c37ab66f200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:01.164158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca2738-2af3-4e0f-9cf3-8c37ab66f200 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:01.164441 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca2738-2af3-4e0f-9cf3-8c37ab66f200 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:01.164736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca2738-2af3-4e0f-9cf3-8c37ab66f200 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:01.165535 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca2738-2af3-4e0f-9cf3-8c37ab66f200 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:01.165906 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca2738-2af3-4e0f-9cf3-8c37ab66f200 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:01.168823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca2738-2af3-4e0f-9cf3-8c37ab66f200 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:01.204095 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 319/629] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Aug 11 16:13:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:01.209534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca2738-2af3-4e0f-9cf3-8c37ab66f200 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:01.247946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:01.259643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 311/630] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:13:01.263144 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:01.299318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a61feb-4e6d-41f7-b97c-f812d36030f6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:01.325706 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca2738-2af3-4e0f-9cf3-8c37ab66f200 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:01.370426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c0504-49df-495f-959c-07f82e1ae4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:01.370963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c0504-49df-495f-959c-07f82e1ae4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:01.371241 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c0504-49df-495f-959c-07f82e1ae4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:01.371536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c0504-49df-495f-959c-07f82e1ae4c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:01.458324 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c0504-49df-495f-959c-07f82e1ae4c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:01.459800 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c0504-49df-495f-959c-07f82e1ae4c1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:01.481322 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a61feb-4e6d-41f7-b97c-f812d36030f6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:01.503538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:01.515847 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3305be-7d54-4731-ba04-40fdd6fea4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:01.516639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3305be-7d54-4731-ba04-40fdd6fea4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:01.516919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3305be-7d54-4731-ba04-40fdd6fea4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:01.517212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3305be-7d54-4731-ba04-40fdd6fea4b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:01.529065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3305be-7d54-4731-ba04-40fdd6fea4b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5f3305be-7d54-4731-ba04-40fdd6fea4b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:01.534023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:01.535580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:01.537526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:01.537526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:01.537526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:01.537526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:01.537526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:01.537526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:01.537526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:01.537526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:01.537526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:01.537526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:01.537526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:13:01.537526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:01.537526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 312/631] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:13:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:01.537526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede733a-79a9-4d0f-9e45-013f00639a12 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:01.539501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede733a-79a9-4d0f-9e45-013f00639a12 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:01.539501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede733a-79a9-4d0f-9e45-013f00639a12 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:01.539501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 313/632] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:01.544090 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede733a-79a9-4d0f-9e45-013f00639a12 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:01.569051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 320/633] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:13:01.570409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34069186-bc4e-4478-9139-1a8962a84a9a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:01.570695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34069186-bc4e-4478-9139-1a8962a84a9a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:01.570973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34069186-bc4e-4478-9139-1a8962a84a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:01.594038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-34069186-bc4e-4478-9139-1a8962a84a9a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:01.595492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-34069186-bc4e-4478-9139-1a8962a84a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:01.612083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:01.660629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede733a-79a9-4d0f-9e45-013f00639a12 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:01.674939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 321/634] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:13:01.676371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34069186-bc4e-4478-9139-1a8962a84a9a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:01.699215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc81cfc-7f3a-4b7f-949b-6443d2fe7acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:01.699895 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc81cfc-7f3a-4b7f-949b-6443d2fe7acb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:01.700216 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc81cfc-7f3a-4b7f-949b-6443d2fe7acb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:01.700498 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc81cfc-7f3a-4b7f-949b-6443d2fe7acb None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:01.701260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc81cfc-7f3a-4b7f-949b-6443d2fe7acb None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:01.701565 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc81cfc-7f3a-4b7f-949b-6443d2fe7acb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:01.703038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc81cfc-7f3a-4b7f-949b-6443d2fe7acb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:01.712980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 314/635] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:13:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:01.718363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc81cfc-7f3a-4b7f-949b-6443d2fe7acb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:01.768791 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:01.808429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34069186-bc4e-4478-9139-1a8962a84a9a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:01.857570 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc81cfc-7f3a-4b7f-949b-6443d2fe7acb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:01.859321 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2acce-3a8d-4569-a932-b1c1a847d0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:01.861211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2acce-3a8d-4569-a932-b1c1a847d0fd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:01.861708 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2acce-3a8d-4569-a932-b1c1a847d0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:01.862175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2acce-3a8d-4569-a932-b1c1a847d0fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:01.875975 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:01.877976 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2acce-3a8d-4569-a932-b1c1a847d0fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:01.880277 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2acce-3a8d-4569-a932-b1c1a847d0fd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:01.894001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178c1c8-148b-4379-8e68-4d005e78a197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:01.894849 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178c1c8-148b-4379-8e68-4d005e78a197 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:01.895171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178c1c8-148b-4379-8e68-4d005e78a197 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:01.895502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178c1c8-148b-4379-8e68-4d005e78a197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-91a2acce-3a8d-4569-a932-b1c1a847d0fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:01.901264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:01.902160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:01.903067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:01.903067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:01.903067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:01.909680 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 322/636] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:01.909680 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2acce-3a8d-4569-a932-b1c1a847d0fd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:01.912475 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178c1c8-148b-4379-8e68-4d005e78a197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:01.913903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178c1c8-148b-4379-8e68-4d005e78a197 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-6178c1c8-148b-4379-8e68-4d005e78a197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:01.931813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:01.932852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:01.933754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:01.933754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:01.933754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:01.933754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 315/637] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:01.934428 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178c1c8-148b-4379-8e68-4d005e78a197 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:02.027843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2acce-3a8d-4569-a932-b1c1a847d0fd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:02.038458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178c1c8-148b-4379-8e68-4d005e78a197 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:02.054049 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:02.065841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472a9d5-cc99-4496-a237-65839e54656d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:02.066505 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472a9d5-cc99-4496-a237-65839e54656d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:02.066780 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472a9d5-cc99-4496-a237-65839e54656d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:02.067045 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472a9d5-cc99-4496-a237-65839e54656d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:02.076465 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c80640-5a44-48b2-9a69-5943e535e458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:02.077360 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c80640-5a44-48b2-9a69-5943e535e458 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:02.077617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472a9d5-cc99-4496-a237-65839e54656d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:02.077928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c80640-5a44-48b2-9a69-5943e535e458 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:02.078351 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c80640-5a44-48b2-9a69-5943e535e458 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:02.079124 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c80640-5a44-48b2-9a69-5943e535e458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:02.079595 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c80640-5a44-48b2-9a69-5943e535e458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:02.081116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c80640-5a44-48b2-9a69-5943e535e458 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f472a9d5-cc99-4496-a237-65839e54656d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:02.082651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:02.083749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:02.084724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:02.084724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:02.084724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:02.084724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:02.084724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:02.084724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:02.084724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:02.084724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:02.084724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:02.084724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:02.084724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:13:02.084724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:02.084724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 323/638] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:13:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:02.089170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472a9d5-cc99-4496-a237-65839e54656d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:02.096675 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 316/639] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:02.098636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3995faa-b42b-4b00-a7c0-196a9814586b None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:02.098912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3995faa-b42b-4b00-a7c0-196a9814586b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:02.099179 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3995faa-b42b-4b00-a7c0-196a9814586b None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:02.100536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 317/640] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:02.101102 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3995faa-b42b-4b00-a7c0-196a9814586b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:02.138141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:02.203181 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472a9d5-cc99-4496-a237-65839e54656d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:02.213426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3995faa-b42b-4b00-a7c0-196a9814586b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:02.240459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d597ae-112a-4ff5-be7e-2c45c9b17d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:02.241325 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d597ae-112a-4ff5-be7e-2c45c9b17d43 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:02.241596 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d597ae-112a-4ff5-be7e-2c45c9b17d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:02.241864 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d597ae-112a-4ff5-be7e-2c45c9b17d43 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:02.242503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d597ae-112a-4ff5-be7e-2c45c9b17d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:02.242798 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d597ae-112a-4ff5-be7e-2c45c9b17d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:02.244151 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d597ae-112a-4ff5-be7e-2c45c9b17d43 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:02.248853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155d1d7-64f9-4a77-828a-2ffa7d026577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:02.249656 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155d1d7-64f9-4a77-828a-2ffa7d026577 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:02.250137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155d1d7-64f9-4a77-828a-2ffa7d026577 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:02.250590 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155d1d7-64f9-4a77-828a-2ffa7d026577 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:02.251425 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155d1d7-64f9-4a77-828a-2ffa7d026577 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:02.251901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155d1d7-64f9-4a77-828a-2ffa7d026577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:02.253456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155d1d7-64f9-4a77-828a-2ffa7d026577 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:02.260394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 324/641] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:02.261265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d597ae-112a-4ff5-be7e-2c45c9b17d43 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:02.262820 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 318/642] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:13:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:02.264261 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62dc03-13b6-4668-af31-8f6df6c48013 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:02.264544 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62dc03-13b6-4668-af31-8f6df6c48013 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:02.264840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62dc03-13b6-4668-af31-8f6df6c48013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:02.284287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7f62dc03-13b6-4668-af31-8f6df6c48013 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:02.286135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7f62dc03-13b6-4668-af31-8f6df6c48013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:02.313070 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:02.359730 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 319/643] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:13:02.360424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62dc03-13b6-4668-af31-8f6df6c48013 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:02.386195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:02.391615 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d597ae-112a-4ff5-be7e-2c45c9b17d43 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:02.430397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eaee96-ff36-4a84-9e03-58b9a5741e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:02.431014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eaee96-ff36-4a84-9e03-58b9a5741e4b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:02.431287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eaee96-ff36-4a84-9e03-58b9a5741e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:02.431554 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eaee96-ff36-4a84-9e03-58b9a5741e4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:02.438291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eaee96-ff36-4a84-9e03-58b9a5741e4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:02.439865 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eaee96-ff36-4a84-9e03-58b9a5741e4b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:02.450968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-78eaee96-ff36-4a84-9e03-58b9a5741e4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:02.450968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:02.450968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:02.450968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:02.450968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:02.450968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:02.450968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:02.450968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:02.450968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:02.450968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:02.450968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:02.450968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:02.450968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:02.450968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:02.450968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:02.451916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:02.452829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:02.452829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:02.452829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:02.452829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:02.452829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:02.452829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:02.452829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:02.452829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:02.452829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 325/644] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:02.452829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eaee96-ff36-4a84-9e03-58b9a5741e4b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:02.477913 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62dc03-13b6-4668-af31-8f6df6c48013 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:02.514550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58ceff-d3c8-4081-a842-d1403d4ebec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:02.515234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58ceff-d3c8-4081-a842-d1403d4ebec2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:02.515507 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58ceff-d3c8-4081-a842-d1403d4ebec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:02.515772 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58ceff-d3c8-4081-a842-d1403d4ebec2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:02.523597 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58ceff-d3c8-4081-a842-d1403d4ebec2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:02.525123 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58ceff-d3c8-4081-a842-d1403d4ebec2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-8a58ceff-d3c8-4081-a842-d1403d4ebec2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:02.537161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:02.538408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:02.539890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:02.539890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:02.539890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:02.539890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:02.539890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:02.539890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:02.539890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:02.539890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:02.539890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 16:13:02.539890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:02.539890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 320/645] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:13:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:02.541432 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58ceff-d3c8-4081-a842-d1403d4ebec2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:02.572326 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eaee96-ff36-4a84-9e03-58b9a5741e4b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:02.574698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:02.608897 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08775c-47b7-42ef-8d1c-e9534c3b2b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:02.609621 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08775c-47b7-42ef-8d1c-e9534c3b2b15 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:02.609963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08775c-47b7-42ef-8d1c-e9534c3b2b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:02.610302 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08775c-47b7-42ef-8d1c-e9534c3b2b15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:02.621532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08775c-47b7-42ef-8d1c-e9534c3b2b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:02.623099 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08775c-47b7-42ef-8d1c-e9534c3b2b15 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:02.629874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-1a08775c-47b7-42ef-8d1c-e9534c3b2b15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:02.641000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:02.641973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:02.642849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:02.642849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:02.642849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:02.642849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 326/646] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:02.642849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08775c-47b7-42ef-8d1c-e9534c3b2b15 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:02.655358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58ceff-d3c8-4081-a842-d1403d4ebec2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:02.689840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbfca5-ab04-4bf7-a4b1-860a4945115e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:02.690456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbfca5-ab04-4bf7-a4b1-860a4945115e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:02.690729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbfca5-ab04-4bf7-a4b1-860a4945115e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:02.690993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbfca5-ab04-4bf7-a4b1-860a4945115e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:02.702451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbfca5-ab04-4bf7-a4b1-860a4945115e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-bfdbfca5-ab04-4bf7-a4b1-860a4945115e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:02.708087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:02.709309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:02.710122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:02.710122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:02.710122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:02.710122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:02.710122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:02.710122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:02.710122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:02.710122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:02.710122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:02.710122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:02.710122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:13:02.710122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:02.710122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 321/647] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:13:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:02.710122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbfca5-ab04-4bf7-a4b1-860a4945115e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:02.753425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08775c-47b7-42ef-8d1c-e9534c3b2b15 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:02.788761 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f14fb-f825-4118-b52c-cce1044f54d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:02.789509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f14fb-f825-4118-b52c-cce1044f54d9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:02.789895 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f14fb-f825-4118-b52c-cce1044f54d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:02.790172 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f14fb-f825-4118-b52c-cce1044f54d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:02.790859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f14fb-f825-4118-b52c-cce1044f54d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:02.791163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f14fb-f825-4118-b52c-cce1044f54d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:02.792577 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f14fb-f825-4118-b52c-cce1044f54d9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:02.805033 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 327/648] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:02.810450 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f14fb-f825-4118-b52c-cce1044f54d9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:02.818916 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbfca5-ab04-4bf7-a4b1-860a4945115e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:02.829327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:02.856035 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82383655-bb08-4384-8886-8cd937074f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:02.856671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82383655-bb08-4384-8886-8cd937074f02 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:02.856956 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82383655-bb08-4384-8886-8cd937074f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:02.857228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82383655-bb08-4384-8886-8cd937074f02 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:02.857963 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82383655-bb08-4384-8886-8cd937074f02 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:02.858498 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82383655-bb08-4384-8886-8cd937074f02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:02.859676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82383655-bb08-4384-8886-8cd937074f02 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:02.875005 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:02.883552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 322/649] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Aug 11 16:13:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:02.883552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82383655-bb08-4384-8886-8cd937074f02 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:02.924996 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f14fb-f825-4118-b52c-cce1044f54d9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:02.964275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bc961-93ac-4927-90bf-e66a4d221d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:02.965476 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bc961-93ac-4927-90bf-e66a4d221d77 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:02.965912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bc961-93ac-4927-90bf-e66a4d221d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:02.966175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bc961-93ac-4927-90bf-e66a4d221d77 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:02.966805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bc961-93ac-4927-90bf-e66a4d221d77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:02.967096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bc961-93ac-4927-90bf-e66a4d221d77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:02.968446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bc961-93ac-4927-90bf-e66a4d221d77 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:02.980508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 328/650] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:02.981655 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bc961-93ac-4927-90bf-e66a4d221d77 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:02.992944 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82383655-bb08-4384-8886-8cd937074f02 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:03.028566 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae08db-c6ba-4d0c-a49d-c406c70eb43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:03.029129 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae08db-c6ba-4d0c-a49d-c406c70eb43d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:03.029409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae08db-c6ba-4d0c-a49d-c406c70eb43d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:03.029684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae08db-c6ba-4d0c-a49d-c406c70eb43d None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:03.030351 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae08db-c6ba-4d0c-a49d-c406c70eb43d None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:03.030650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae08db-c6ba-4d0c-a49d-c406c70eb43d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:03.032020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae08db-c6ba-4d0c-a49d-c406c70eb43d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:03.046503 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 323/651] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:13:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:03.046503 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae08db-c6ba-4d0c-a49d-c406c70eb43d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:03.067633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:03.093273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bc961-93ac-4927-90bf-e66a4d221d77 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:03.109642 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:03.131982 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309b67e-4a32-4bd8-9c64-088c9fe35982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:03.132598 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309b67e-4a32-4bd8-9c64-088c9fe35982 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:03.132911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309b67e-4a32-4bd8-9c64-088c9fe35982 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:03.133222 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309b67e-4a32-4bd8-9c64-088c9fe35982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:03.133859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309b67e-4a32-4bd8-9c64-088c9fe35982 None admin] RBAC: Adding query filter params (role.id=b4c209d1895841af9203c4e432176eb9, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=4e91f3fbe098459dba0acf8ec1fb7098) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:03.134159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309b67e-4a32-4bd8-9c64-088c9fe35982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:03.135558 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309b67e-4a32-4bd8-9c64-088c9fe35982 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:03.142872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 329/652] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:02 2022] GET /identity/v3/role_assignments?user.id=4e91f3fbe098459dba0acf8ec1fb7098&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=b4c209d1895841af9203c4e432176eb9 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:03.143665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309b67e-4a32-4bd8-9c64-088c9fe35982 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:03.158296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae08db-c6ba-4d0c-a49d-c406c70eb43d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:03.201666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0712588-27e3-40ea-8e1f-61d6878ec6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:03.202395 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0712588-27e3-40ea-8e1f-61d6878ec6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:03.202675 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0712588-27e3-40ea-8e1f-61d6878ec6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:03.202944 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0712588-27e3-40ea-8e1f-61d6878ec6e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:03.277595 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309b67e-4a32-4bd8-9c64-088c9fe35982 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:03.288359 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0712588-27e3-40ea-8e1f-61d6878ec6e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:03.289795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0712588-27e3-40ea-8e1f-61d6878ec6e4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:03.322610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e47d83-ce65-4696-b1ea-d69bbdce950d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:03.323363 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e47d83-ce65-4696-b1ea-d69bbdce950d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:03.323640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e47d83-ce65-4696-b1ea-d69bbdce950d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:03.323910 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e47d83-ce65-4696-b1ea-d69bbdce950d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:03.332531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e47d83-ce65-4696-b1ea-d69bbdce950d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:03.334073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e47d83-ce65-4696-b1ea-d69bbdce950d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:03.337398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e0e47d83-ce65-4696-b1ea-d69bbdce950d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:03.349746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:03.351126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:03.352245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:03.352245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:03.352245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:03.352245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:03.352245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:03.352245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:03.352245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:03.352245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:03.352245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 11 16:13:03.352245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:03.352245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 330/653] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:13:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:03.352245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e47d83-ce65-4696-b1ea-d69bbdce950d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:03.369821 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:03.415865 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 324/654] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:13:03.417262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bf2d1-4737-441f-81f6-bbab355e2957 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:03.417548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bf2d1-4737-441f-81f6-bbab355e2957 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:03.417819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bf2d1-4737-441f-81f6-bbab355e2957 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:03.419592 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 325/655] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:03.420298 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bf2d1-4737-441f-81f6-bbab355e2957 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:03.467074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e47d83-ce65-4696-b1ea-d69bbdce950d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:03.508865 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fb1df-0071-4670-9e6f-0ca692797361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:03.509487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fb1df-0071-4670-9e6f-0ca692797361 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:03.509766 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fb1df-0071-4670-9e6f-0ca692797361 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:03.510040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fb1df-0071-4670-9e6f-0ca692797361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:03.527009 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fb1df-0071-4670-9e6f-0ca692797361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:03.528994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fb1df-0071-4670-9e6f-0ca692797361 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:03.539925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bf2d1-4737-441f-81f6-bbab355e2957 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-229fb1df-0071-4670-9e6f-0ca692797361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:03.544209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:03.545348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:03.546268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:03.546268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:03.546268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:03.546268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 331/656] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:03.546939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fb1df-0071-4670-9e6f-0ca692797361 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:03.581150 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c42ce6-f9b4-499b-9653-596fdabbfd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:03.581785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c42ce6-f9b4-499b-9653-596fdabbfd2e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:03.582067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c42ce6-f9b4-499b-9653-596fdabbfd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:03.582341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c42ce6-f9b4-499b-9653-596fdabbfd2e None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:03.583081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c42ce6-f9b4-499b-9653-596fdabbfd2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:03.583445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c42ce6-f9b4-499b-9653-596fdabbfd2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:03.584901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c42ce6-f9b4-499b-9653-596fdabbfd2e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:03.602457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 326/657] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Aug 11 16:13:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:03.603516 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0f87f-8c57-4041-8d30-002ec59f0435 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:03.603807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0f87f-8c57-4041-8d30-002ec59f0435 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:03.604079 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0f87f-8c57-4041-8d30-002ec59f0435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:03.609349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:03.622715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7fd0f87f-8c57-4041-8d30-002ec59f0435 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:03.623907 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7fd0f87f-8c57-4041-8d30-002ec59f0435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:03.639178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:03.663377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fb1df-0071-4670-9e6f-0ca692797361 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:03.698812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7300b8-9153-4144-a81c-9f176a6df55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:03.699443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7300b8-9153-4144-a81c-9f176a6df55f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:03.699720 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7300b8-9153-4144-a81c-9f176a6df55f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:03.699995 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7300b8-9153-4144-a81c-9f176a6df55f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:03.709544 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 327/658] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:13:03.710868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0f87f-8c57-4041-8d30-002ec59f0435 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:03.712197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7300b8-9153-4144-a81c-9f176a6df55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:03.713902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7300b8-9153-4144-a81c-9f176a6df55f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ee7300b8-9153-4144-a81c-9f176a6df55f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:03.728693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:03.729738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:03.730707 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:03.730707 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:03.730707 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:03.732453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 332/659] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:03.733481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7300b8-9153-4144-a81c-9f176a6df55f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:03.829933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0f87f-8c57-4041-8d30-002ec59f0435 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:03.845308 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7300b8-9153-4144-a81c-9f176a6df55f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:03.849725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:03.869737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be28344-8956-43fb-930f-373621ef74d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:03.870338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be28344-8956-43fb-930f-373621ef74d2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:03.870623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be28344-8956-43fb-930f-373621ef74d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:03.870892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be28344-8956-43fb-930f-373621ef74d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:03.871538 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be28344-8956-43fb-930f-373621ef74d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:03.871838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be28344-8956-43fb-930f-373621ef74d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:03.873312 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be28344-8956-43fb-930f-373621ef74d2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:03.885797 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf65728-cc7a-4c21-a589-28b506e135fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:03.885967 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 328/660] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:03.886598 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be28344-8956-43fb-930f-373621ef74d2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:03.887033 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf65728-cc7a-4c21-a589-28b506e135fb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:03.887374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf65728-cc7a-4c21-a589-28b506e135fb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:03.887714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf65728-cc7a-4c21-a589-28b506e135fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:03.902032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:03.959831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf65728-cc7a-4c21-a589-28b506e135fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:03.961316 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf65728-cc7a-4c21-a589-28b506e135fb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:03.990983 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be28344-8956-43fb-930f-373621ef74d2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:04.025721 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb1d10-7462-4558-a553-5215ea005284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:04.026678 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb1d10-7462-4558-a553-5215ea005284 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:04.026967 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb1d10-7462-4558-a553-5215ea005284 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:04.027254 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb1d10-7462-4558-a553-5215ea005284 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:04.037532 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb1d10-7462-4558-a553-5215ea005284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-b6cb1d10-7462-4558-a553-5215ea005284 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:04.043577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:04.044732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:04.045568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:04.045568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:04.045568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:04.045568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:04.045568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:04.045568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:04.045568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:04.045568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:04.045568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:04.045568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:04.045568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:13:04.045568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:04.045568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 329/661] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:13:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:04.045568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb1d10-7462-4558-a553-5215ea005284 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:04.067436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 333/662] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:13:04.068542 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf65728-cc7a-4c21-a589-28b506e135fb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:04.072922 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:04.126120 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:04.159380 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb1d10-7462-4558-a553-5215ea005284 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:04.173571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf65728-cc7a-4c21-a589-28b506e135fb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:04.197191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d441f4-00ea-4f8e-bd94-ae917a88adb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:04.197826 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d441f4-00ea-4f8e-bd94-ae917a88adb0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:04.198093 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d441f4-00ea-4f8e-bd94-ae917a88adb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:04.198607 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d441f4-00ea-4f8e-bd94-ae917a88adb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:04.199079 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d441f4-00ea-4f8e-bd94-ae917a88adb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:04.199379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d441f4-00ea-4f8e-bd94-ae917a88adb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:04.200764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d441f4-00ea-4f8e-bd94-ae917a88adb0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:04.211555 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670de303-57e5-4a24-af4e-9c80250efefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:04.212195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670de303-57e5-4a24-af4e-9c80250efefe None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:04.217073 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 330/663] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:04.217219 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670de303-57e5-4a24-af4e-9c80250efefe None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:04.217219 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670de303-57e5-4a24-af4e-9c80250efefe None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:04.217353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d441f4-00ea-4f8e-bd94-ae917a88adb0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:04.226185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670de303-57e5-4a24-af4e-9c80250efefe None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:04.227698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670de303-57e5-4a24-af4e-9c80250efefe None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-670de303-57e5-4a24-af4e-9c80250efefe None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:04.239905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:04.240862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:04.241793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:04.241793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:04.241793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:04.241793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:04.241793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:04.241793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:04.241793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:04.241793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:04.241793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 16:13:04.241793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:04.241793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 334/664] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:13:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:04.242397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670de303-57e5-4a24-af4e-9c80250efefe None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:04.310528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:04.324174 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d441f4-00ea-4f8e-bd94-ae917a88adb0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:04.354003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:04.355169 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670de303-57e5-4a24-af4e-9c80250efefe None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:04.360229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07843f65-dc80-4e6e-a184-290920558b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:04.360861 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07843f65-dc80-4e6e-a184-290920558b83 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:04.361136 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07843f65-dc80-4e6e-a184-290920558b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:04.361402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07843f65-dc80-4e6e-a184-290920558b83 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:04.362069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07843f65-dc80-4e6e-a184-290920558b83 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:04.362367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07843f65-dc80-4e6e-a184-290920558b83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:04.364305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07843f65-dc80-4e6e-a184-290920558b83 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:04.376783 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 331/665] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:13:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:04.376783 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07843f65-dc80-4e6e-a184-290920558b83 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:04.396470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fda22-58a7-4e61-8337-d5ab1adfd2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:04.397120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fda22-58a7-4e61-8337-d5ab1adfd2fb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:04.397394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fda22-58a7-4e61-8337-d5ab1adfd2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:04.397662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fda22-58a7-4e61-8337-d5ab1adfd2fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:04.408363 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fda22-58a7-4e61-8337-d5ab1adfd2fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:04.410364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fda22-58a7-4e61-8337-d5ab1adfd2fb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-037fda22-58a7-4e61-8337-d5ab1adfd2fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:04.424662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:04.426192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:04.427101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:04.427101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:04.427101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:04.427101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 335/666] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:04.427101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fda22-58a7-4e61-8337-d5ab1adfd2fb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:04.493135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07843f65-dc80-4e6e-a184-290920558b83 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:04.529023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079c2ad-5db2-470e-b559-0c619a6abdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:04.529642 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079c2ad-5db2-470e-b559-0c619a6abdab None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:04.529921 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079c2ad-5db2-470e-b559-0c619a6abdab None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:04.530191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079c2ad-5db2-470e-b559-0c619a6abdab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:04.530499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fda22-58a7-4e61-8337-d5ab1adfd2fb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:04.537410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079c2ad-5db2-470e-b559-0c619a6abdab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:04.538847 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079c2ad-5db2-470e-b559-0c619a6abdab None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:04.548405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:04.550336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2079c2ad-5db2-470e-b559-0c619a6abdab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:04.550336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:04.550336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:04.550336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:04.550336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:04.550336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:04.550336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:04.550336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:04.550336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:04.550336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:04.550336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:04.550336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:04.550336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:04.550336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:04.550336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:04.551194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:04.557096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:04.557096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:04.557096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:04.557096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:04.557096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:04.557096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:04.557096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:04.557096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:04.557096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 332/667] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:04.557096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079c2ad-5db2-470e-b559-0c619a6abdab None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:04.572015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc1938-c1fa-404f-b4bb-e42e6f05bf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:04.572638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc1938-c1fa-404f-b4bb-e42e6f05bf36 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:04.572918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc1938-c1fa-404f-b4bb-e42e6f05bf36 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:04.573186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc1938-c1fa-404f-b4bb-e42e6f05bf36 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:04.573903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc1938-c1fa-404f-b4bb-e42e6f05bf36 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:04.574200 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc1938-c1fa-404f-b4bb-e42e6f05bf36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:04.575803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc1938-c1fa-404f-b4bb-e42e6f05bf36 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:04.599718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 336/668] 10.222.0.40 () {56 vars in 1139 bytes} [Thu Aug 11 16:13:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:04.599718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc1938-c1fa-404f-b4bb-e42e6f05bf36 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:04.623021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:04.676425 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079c2ad-5db2-470e-b559-0c619a6abdab None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:04.700244 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc1938-c1fa-404f-b4bb-e42e6f05bf36 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:04.714179 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4acf37-d3ff-4295-8fbb-ab0df2fd6ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:04.714913 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4acf37-d3ff-4295-8fbb-ab0df2fd6ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:04.715188 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4acf37-d3ff-4295-8fbb-ab0df2fd6ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:04.715540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4acf37-d3ff-4295-8fbb-ab0df2fd6ba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:04.727452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4acf37-d3ff-4295-8fbb-ab0df2fd6ba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:04.728968 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4acf37-d3ff-4295-8fbb-ab0df2fd6ba3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:04.735214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740379e2-ea33-4cfe-9d68-f6b360b66b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:04.735815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740379e2-ea33-4cfe-9d68-f6b360b66b06 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:04.736090 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740379e2-ea33-4cfe-9d68-f6b360b66b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:04.736357 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740379e2-ea33-4cfe-9d68-f6b360b66b06 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:04.737030 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740379e2-ea33-4cfe-9d68-f6b360b66b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:04.737333 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740379e2-ea33-4cfe-9d68-f6b360b66b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:04.739223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740379e2-ea33-4cfe-9d68-f6b360b66b06 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-7d4acf37-d3ff-4295-8fbb-ab0df2fd6ba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:04.746146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:04.747077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:04.748031 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:04.748031 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:04.748031 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:04.749717 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 333/669] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:04.750621 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4acf37-d3ff-4295-8fbb-ab0df2fd6ba3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:04.755280 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 337/670] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:04.756357 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740379e2-ea33-4cfe-9d68-f6b360b66b06 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:04.791396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:04.862462 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4acf37-d3ff-4295-8fbb-ab0df2fd6ba3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:04.866290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:04.866426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740379e2-ea33-4cfe-9d68-f6b360b66b06 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:04.897817 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aa55d-931f-4e12-8492-492a4d30e49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:04.898423 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aa55d-931f-4e12-8492-492a4d30e49a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:04.898702 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aa55d-931f-4e12-8492-492a4d30e49a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:04.898971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aa55d-931f-4e12-8492-492a4d30e49a None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:04.899668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230aa55d-931f-4e12-8492-492a4d30e49a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:04.899968 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230aa55d-931f-4e12-8492-492a4d30e49a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:04.901410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230aa55d-931f-4e12-8492-492a4d30e49a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:04.902865 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb563e3d-d6c4-4a92-a2c1-391c7d0659e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:04.903532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb563e3d-d6c4-4a92-a2c1-391c7d0659e5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:04.903805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb563e3d-d6c4-4a92-a2c1-391c7d0659e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:04.904274 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb563e3d-d6c4-4a92-a2c1-391c7d0659e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:04.919350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 334/671] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:04.919350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aa55d-931f-4e12-8492-492a4d30e49a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:04.981360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb563e3d-d6c4-4a92-a2c1-391c7d0659e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:04.982836 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb563e3d-d6c4-4a92-a2c1-391c7d0659e5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:05.019049 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:05.019897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aa55d-931f-4e12-8492-492a4d30e49a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:05.057113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76e773-fd27-4747-bd00-ea1f8f802a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:05.057767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76e773-fd27-4747-bd00-ea1f8f802a2e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:05.057984 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76e773-fd27-4747-bd00-ea1f8f802a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:05.058250 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76e773-fd27-4747-bd00-ea1f8f802a2e None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:05.058962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76e773-fd27-4747-bd00-ea1f8f802a2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:05.059185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76e773-fd27-4747-bd00-ea1f8f802a2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:05.060541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76e773-fd27-4747-bd00-ea1f8f802a2e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:05.071995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 335/672] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:05.072737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76e773-fd27-4747-bd00-ea1f8f802a2e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:05.097846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 338/673] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:13:05.098544 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb563e3d-d6c4-4a92-a2c1-391c7d0659e5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:05.104075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:05.185398 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76e773-fd27-4747-bd00-ea1f8f802a2e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:05.207607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb563e3d-d6c4-4a92-a2c1-391c7d0659e5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:05.221239 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dfd81-0811-4377-9083-0de571629ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:05.221863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dfd81-0811-4377-9083-0de571629ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:05.222146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dfd81-0811-4377-9083-0de571629ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:05.222959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dfd81-0811-4377-9083-0de571629ff4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:05.230040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dfd81-0811-4377-9083-0de571629ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:05.231857 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dfd81-0811-4377-9083-0de571629ff4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:05.241749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd97484-cd94-44ef-9197-03af0ec1a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:05.242338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd97484-cd94-44ef-9197-03af0ec1a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:05.242607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd97484-cd94-44ef-9197-03af0ec1a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:05.242873 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd97484-cd94-44ef-9197-03af0ec1a2f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:05.243523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-230dfd81-0811-4377-9083-0de571629ff4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:05.243523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:05.243523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:05.243523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:05.243523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:05.243523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:05.243523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:05.243523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:05.243523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:05.243523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:05.243523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:05.243523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:05.243523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:05.243523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:05.243523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:05.244434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:05.245623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:05.245623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:05.245623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:05.245623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:05.245623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:05.245623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:05.245623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:05.245623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:05.246378 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd97484-cd94-44ef-9197-03af0ec1a2f0 None admin] RBAC: Adding query filter params (role.id=b4c209d1895841af9203c4e432176eb9, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=1e52aae602104cc2b48354b2d75d359c) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:05.246378 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd97484-cd94-44ef-9197-03af0ec1a2f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:05.246510 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 336/674] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:05.246586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd97484-cd94-44ef-9197-03af0ec1a2f0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:05.246660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dfd81-0811-4377-9083-0de571629ff4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:05.249366 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:05.251734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 339/675] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:05 2022] GET /identity/v3/role_assignments?user.id=1e52aae602104cc2b48354b2d75d359c&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=b4c209d1895841af9203c4e432176eb9 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:05.252775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd97484-cd94-44ef-9197-03af0ec1a2f0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:05.344322 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:05.362505 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dfd81-0811-4377-9083-0de571629ff4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:05.376349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd97484-cd94-44ef-9197-03af0ec1a2f0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:05.403780 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ffd95-d111-4761-9e63-234f17f99976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:05.403780 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ffd95-d111-4761-9e63-234f17f99976 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:05.404073 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ffd95-d111-4761-9e63-234f17f99976 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:05.404303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ffd95-d111-4761-9e63-234f17f99976 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:05.412637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ffd95-d111-4761-9e63-234f17f99976 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:05.414699 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ffd95-d111-4761-9e63-234f17f99976 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:05.422302 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adda5a-3ccd-48ed-92b2-3b7868e2a826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:05.422936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adda5a-3ccd-48ed-92b2-3b7868e2a826 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:05.423211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adda5a-3ccd-48ed-92b2-3b7868e2a826 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:05.423481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adda5a-3ccd-48ed-92b2-3b7868e2a826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-ff7ffd95-d111-4761-9e63-234f17f99976 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:05.427062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:05.427970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:05.429347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:05.429347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:05.429347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:05.429347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:05.429347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:05.429347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:05.429347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:05.429347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:05.429347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 16:13:05.429347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:05.429347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 337/676] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:13:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:05.430075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebf7f5-43e8-42b1-89f0-b27905c08851 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:05.430075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebf7f5-43e8-42b1-89f0-b27905c08851 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:05.430075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebf7f5-43e8-42b1-89f0-b27905c08851 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:05.431151 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 338/677] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:05.431831 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebf7f5-43e8-42b1-89f0-b27905c08851 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:05.446060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adda5a-3ccd-48ed-92b2-3b7868e2a826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:05.447872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adda5a-3ccd-48ed-92b2-3b7868e2a826 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-c6adda5a-3ccd-48ed-92b2-3b7868e2a826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:05.466233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:05.467265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:05.468803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:05.468803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:05.468803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:05.468803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 340/678] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:05.468803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adda5a-3ccd-48ed-92b2-3b7868e2a826 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:05.520381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:05.555674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebf7f5-43e8-42b1-89f0-b27905c08851 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:05.576044 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adda5a-3ccd-48ed-92b2-3b7868e2a826 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:05.594098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7ee14-065c-439b-b50b-80f678339fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:05.594704 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7ee14-065c-439b-b50b-80f678339fca None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:05.594986 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7ee14-065c-439b-b50b-80f678339fca None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:05.595249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7ee14-065c-439b-b50b-80f678339fca None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:05.596401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7ee14-065c-439b-b50b-80f678339fca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:05.597021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7ee14-065c-439b-b50b-80f678339fca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:05.599135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7ee14-065c-439b-b50b-80f678339fca None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:05.612444 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de883c2-b227-40db-9aaa-c5957d21bfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:05.613631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de883c2-b227-40db-9aaa-c5957d21bfab None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:05.613929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de883c2-b227-40db-9aaa-c5957d21bfab None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:05.614198 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de883c2-b227-40db-9aaa-c5957d21bfab None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:05.619221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 339/679] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:05.619355 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de883c2-b227-40db-9aaa-c5957d21bfab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:05.619355 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de883c2-b227-40db-9aaa-c5957d21bfab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:05.619520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010e484-7aa9-48d0-b1b9-a43c8201a761 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:05.619520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010e484-7aa9-48d0-b1b9-a43c8201a761 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:05.619520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010e484-7aa9-48d0-b1b9-a43c8201a761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:05.619697 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de883c2-b227-40db-9aaa-c5957d21bfab None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:05.626004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:05.639491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8010e484-7aa9-48d0-b1b9-a43c8201a761 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:05.640510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 341/680] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Aug 11 16:13:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:05.640930 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8010e484-7aa9-48d0-b1b9-a43c8201a761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:05.641421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de883c2-b227-40db-9aaa-c5957d21bfab None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:05.717452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 340/681] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:13:05.717807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010e484-7aa9-48d0-b1b9-a43c8201a761 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:05.750305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de883c2-b227-40db-9aaa-c5957d21bfab None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:05.760053 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:05.787501 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ba7c5-119d-47f1-99f6-4ec031916cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:05.787945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ba7c5-119d-47f1-99f6-4ec031916cbc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:05.788223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ba7c5-119d-47f1-99f6-4ec031916cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:05.788500 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ba7c5-119d-47f1-99f6-4ec031916cbc None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:05.789176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ba7c5-119d-47f1-99f6-4ec031916cbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:05.789475 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ba7c5-119d-47f1-99f6-4ec031916cbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:05.790871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ba7c5-119d-47f1-99f6-4ec031916cbc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:05.803501 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 342/682] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:05.804315 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ba7c5-119d-47f1-99f6-4ec031916cbc None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:05.834162 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010e484-7aa9-48d0-b1b9-a43c8201a761 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:05.874000 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d47224-0f84-4718-a8f9-6a7b6b994057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:05.874600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d47224-0f84-4718-a8f9-6a7b6b994057 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:05.874875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d47224-0f84-4718-a8f9-6a7b6b994057 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:05.875143 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d47224-0f84-4718-a8f9-6a7b6b994057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:05.875859 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d47224-0f84-4718-a8f9-6a7b6b994057 None admin] RBAC: Adding query filter params (role.id=b4c209d1895841af9203c4e432176eb9, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=2c9158ce9d8a4aadbf86405657958c48) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:05.876164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d47224-0f84-4718-a8f9-6a7b6b994057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:05.877597 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d47224-0f84-4718-a8f9-6a7b6b994057 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:05.879661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:05.896961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 341/683] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:05 2022] GET /identity/v3/role_assignments?user.id=2c9158ce9d8a4aadbf86405657958c48&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=b4c209d1895841af9203c4e432176eb9 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:05.897797 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d47224-0f84-4718-a8f9-6a7b6b994057 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:05.917985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ba7c5-119d-47f1-99f6-4ec031916cbc None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:05.957430 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe1f77-c6b0-490c-8a62-170e46c4d9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:05.958055 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe1f77-c6b0-490c-8a62-170e46c4d9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:05.958392 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe1f77-c6b0-490c-8a62-170e46c4d9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:05.958665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe1f77-c6b0-490c-8a62-170e46c4d9a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:05.998176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:06.032541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d47224-0f84-4718-a8f9-6a7b6b994057 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:06.037273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe1f77-c6b0-490c-8a62-170e46c4d9a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:06.038273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe1f77-c6b0-490c-8a62-170e46c4d9a2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:06.072379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ca12a-914e-4d07-87f0-85045ab873f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:06.073065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ca12a-914e-4d07-87f0-85045ab873f1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:06.073345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ca12a-914e-4d07-87f0-85045ab873f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:06.073613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ca12a-914e-4d07-87f0-85045ab873f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:06.086387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ca12a-914e-4d07-87f0-85045ab873f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-ba8ca12a-914e-4d07-87f0-85045ab873f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:06.092830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:06.093923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:06.094829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:06.094829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:06.094829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:06.094829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:06.094829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:06.094829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:06.094829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:06.094829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:06.094829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:06.094829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:06.094829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:06.094829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:06.094829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 342/684] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:06.095517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ca12a-914e-4d07-87f0-85045ab873f1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:06.167438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 343/685] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:13:06.167438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe1f77-c6b0-490c-8a62-170e46c4d9a2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:06.174309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:06.225715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ca12a-914e-4d07-87f0-85045ab873f1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:06.263261 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7e0be-7120-4723-987e-174780853366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:06.263994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7e0be-7120-4723-987e-174780853366 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:06.264280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7e0be-7120-4723-987e-174780853366 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:06.264554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7e0be-7120-4723-987e-174780853366 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:06.269439 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:06.273084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7e0be-7120-4723-987e-174780853366 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:06.275232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7e0be-7120-4723-987e-174780853366 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:06.287499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-13e7e0be-7120-4723-987e-174780853366 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:06.287499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:06.287499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:06.287499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:06.287499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:06.287499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:06.287499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:06.287499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:06.287499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:06.287499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:06.287499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:06.287499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:06.287499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:06.287499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:06.287499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:06.288433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:06.289367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:06.289367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:06.289367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:06.289367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:06.289367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:06.289367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:06.289367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:06.289367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:06.289367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 343/686] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:06.290355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7e0be-7120-4723-987e-174780853366 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:06.315653 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe1f77-c6b0-490c-8a62-170e46c4d9a2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:06.363604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a0f5d-d31b-485d-a557-3e7cbfb03d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:06.364214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a0f5d-d31b-485d-a557-3e7cbfb03d22 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:06.364492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a0f5d-d31b-485d-a557-3e7cbfb03d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:06.364792 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a0f5d-d31b-485d-a557-3e7cbfb03d22 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:06.365593 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a0f5d-d31b-485d-a557-3e7cbfb03d22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:06.365912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a0f5d-d31b-485d-a557-3e7cbfb03d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:06.367763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a0f5d-d31b-485d-a557-3e7cbfb03d22 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:06.378657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 344/687] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:13:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:06.379509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a0f5d-d31b-485d-a557-3e7cbfb03d22 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:06.408615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7e0be-7120-4723-987e-174780853366 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:06.431445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:06.452689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3263c1-f1f0-4dcd-9bf2-fb94572b6c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:06.453342 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3263c1-f1f0-4dcd-9bf2-fb94572b6c2b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:06.453852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3263c1-f1f0-4dcd-9bf2-fb94572b6c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:06.454133 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3263c1-f1f0-4dcd-9bf2-fb94572b6c2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:06.466964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3263c1-f1f0-4dcd-9bf2-fb94572b6c2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:06.469237 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3263c1-f1f0-4dcd-9bf2-fb94572b6c2b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-9d3263c1-f1f0-4dcd-9bf2-fb94572b6c2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:06.489410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:06.490801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:06.491875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:06.491875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:06.491875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:06.493190 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 344/688] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:06.494156 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3263c1-f1f0-4dcd-9bf2-fb94572b6c2b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:06.527303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a0f5d-d31b-485d-a557-3e7cbfb03d22 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:06.559931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:06.567293 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de9cd6-dfd0-4e00-a8d6-85a0570be6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:06.568103 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de9cd6-dfd0-4e00-a8d6-85a0570be6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:06.568537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de9cd6-dfd0-4e00-a8d6-85a0570be6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:06.569002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de9cd6-dfd0-4e00-a8d6-85a0570be6c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:06.570398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de9cd6-dfd0-4e00-a8d6-85a0570be6c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:06.570856 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de9cd6-dfd0-4e00-a8d6-85a0570be6c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:06.572421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de9cd6-dfd0-4e00-a8d6-85a0570be6c4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:06.591101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 345/689] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:06.592296 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de9cd6-dfd0-4e00-a8d6-85a0570be6c4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:06.615479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3263c1-f1f0-4dcd-9bf2-fb94572b6c2b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:06.657754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a63f1-7fe4-44e4-a4d1-27967619e04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:06.658657 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a63f1-7fe4-44e4-a4d1-27967619e04f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:06.659088 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a63f1-7fe4-44e4-a4d1-27967619e04f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:06.659513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a63f1-7fe4-44e4-a4d1-27967619e04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:06.671853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a63f1-7fe4-44e4-a4d1-27967619e04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:06.673756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a63f1-7fe4-44e4-a4d1-27967619e04f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-ad6a63f1-7fe4-44e4-a4d1-27967619e04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:06.690148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:06.691483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:06.692669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:06.692669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:06.692669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:06.694382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 345/690] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:06.695462 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a63f1-7fe4-44e4-a4d1-27967619e04f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:06.720963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de9cd6-dfd0-4e00-a8d6-85a0570be6c4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:06.732010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:06.770270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748560b-f996-4803-be35-1274d2d849e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:06.770966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748560b-f996-4803-be35-1274d2d849e4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:06.771310 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748560b-f996-4803-be35-1274d2d849e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:06.771893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748560b-f996-4803-be35-1274d2d849e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:06.773014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748560b-f996-4803-be35-1274d2d849e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:06.773406 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748560b-f996-4803-be35-1274d2d849e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:06.775084 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748560b-f996-4803-be35-1274d2d849e4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:06.789101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 346/691] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:06.790208 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748560b-f996-4803-be35-1274d2d849e4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:06.822275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a63f1-7fe4-44e4-a4d1-27967619e04f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:06.857458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:06.858746 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41be3d-7ca0-4813-a12a-c0a089f10b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:06.859647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41be3d-7ca0-4813-a12a-c0a089f10b1b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:06.860114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41be3d-7ca0-4813-a12a-c0a089f10b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:06.860527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41be3d-7ca0-4813-a12a-c0a089f10b1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:06.861492 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41be3d-7ca0-4813-a12a-c0a089f10b1b None admin] RBAC: Adding query filter params (role.id=b4c209d1895841af9203c4e432176eb9, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=16d2570f97234d62948762562616000c) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:06.861980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41be3d-7ca0-4813-a12a-c0a089f10b1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:06.864123 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41be3d-7ca0-4813-a12a-c0a089f10b1b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:06.876627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 346/692] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:06 2022] GET /identity/v3/role_assignments?user.id=16d2570f97234d62948762562616000c&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=b4c209d1895841af9203c4e432176eb9 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:06.877885 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41be3d-7ca0-4813-a12a-c0a089f10b1b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:06.925796 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748560b-f996-4803-be35-1274d2d849e4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:06.967996 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2015a4-7e64-4456-b1e6-6dec667fe3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:06.968814 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2015a4-7e64-4456-b1e6-6dec667fe3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:06.969183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2015a4-7e64-4456-b1e6-6dec667fe3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:06.969557 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2015a4-7e64-4456-b1e6-6dec667fe3d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:06.970324 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2015a4-7e64-4456-b1e6-6dec667fe3d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:06.976612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2015a4-7e64-4456-b1e6-6dec667fe3d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:06.976612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2015a4-7e64-4456-b1e6-6dec667fe3d6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:06.993052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 347/693] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:06.994532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2015a4-7e64-4456-b1e6-6dec667fe3d6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:07.110911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2015a4-7e64-4456-b1e6-6dec667fe3d6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:07.127064 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:07.133890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:07.161210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cb2a5-b748-4872-8ef6-e9bb48b031e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:07.162309 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cb2a5-b748-4872-8ef6-e9bb48b031e4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:07.162703 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cb2a5-b748-4872-8ef6-e9bb48b031e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:07.163077 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cb2a5-b748-4872-8ef6-e9bb48b031e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:07.170988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41be3d-7ca0-4813-a12a-c0a089f10b1b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:07.176978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cb2a5-b748-4872-8ef6-e9bb48b031e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:07.178756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cb2a5-b748-4872-8ef6-e9bb48b031e4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-4e6cb2a5-b748-4872-8ef6-e9bb48b031e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:07.198435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:07.199423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:07.200455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:07.200455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:07.200455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:07.200455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:07.200455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:07.200455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:07.200455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:07.200455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:07.200455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:13:07.200455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:07.206946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 348/694] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Aug 11 16:13:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:07.209533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cb2a5-b748-4872-8ef6-e9bb48b031e4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:07.223856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01227324-fb0f-4951-bb3e-d12184334e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:07.224801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01227324-fb0f-4951-bb3e-d12184334e7a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:07.225517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01227324-fb0f-4951-bb3e-d12184334e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:07.225942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01227324-fb0f-4951-bb3e-d12184334e7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:07.235477 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01227324-fb0f-4951-bb3e-d12184334e7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:07.238447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01227324-fb0f-4951-bb3e-d12184334e7a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:07.253926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-01227324-fb0f-4951-bb3e-d12184334e7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:07.253926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:07.253926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:07.253926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:07.253926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:07.253926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:07.253926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:07.253926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:07.253926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:07.253926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:07.253926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:07.253926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:07.253926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:07.253926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:07.253926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:07.254964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:07.256039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:07.256039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:07.256039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:07.256039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:07.256039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:07.256039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:07.256039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:07.256039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:07.259375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 347/695] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:07.264743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01227324-fb0f-4951-bb3e-d12184334e7a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:07.339725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cb2a5-b748-4872-8ef6-e9bb48b031e4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:07.375716 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad92a7-c1a7-4314-aeda-9b3c49a1def9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:07.376562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad92a7-c1a7-4314-aeda-9b3c49a1def9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:07.377018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad92a7-c1a7-4314-aeda-9b3c49a1def9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:07.377435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad92a7-c1a7-4314-aeda-9b3c49a1def9 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:07.378285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad92a7-c1a7-4314-aeda-9b3c49a1def9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:07.378724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad92a7-c1a7-4314-aeda-9b3c49a1def9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:07.380390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad92a7-c1a7-4314-aeda-9b3c49a1def9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:07.383762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01227324-fb0f-4951-bb3e-d12184334e7a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:07.403168 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 349/696] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Aug 11 16:13:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:07.404826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e4b80-77d2-41d6-8018-b9be2c759182 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:07.405258 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e4b80-77d2-41d6-8018-b9be2c759182 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:07.405704 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e4b80-77d2-41d6-8018-b9be2c759182 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:07.407529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 350/697] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:07.408698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e4b80-77d2-41d6-8018-b9be2c759182 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:07.421843 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c090a-b91c-4783-a51b-a9589ed9a723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:07.422809 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c090a-b91c-4783-a51b-a9589ed9a723 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:07.423066 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c090a-b91c-4783-a51b-a9589ed9a723 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:07.423430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c090a-b91c-4783-a51b-a9589ed9a723 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:07.424274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c090a-b91c-4783-a51b-a9589ed9a723 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:07.424841 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c090a-b91c-4783-a51b-a9589ed9a723 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:07.426915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c090a-b91c-4783-a51b-a9589ed9a723 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:07.440342 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 348/698] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:07.442232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:07.442602 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22107a6f-2969-4bfc-8210-abce45095ea0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:07.443726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22107a6f-2969-4bfc-8210-abce45095ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:07.444270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22107a6f-2969-4bfc-8210-abce45095ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:07.460920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:07.465058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-22107a6f-2969-4bfc-8210-abce45095ea0 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:07.481646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-22107a6f-2969-4bfc-8210-abce45095ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:07.521631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e4b80-77d2-41d6-8018-b9be2c759182 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:07.565076 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d81b4-63fd-45c0-9aed-f84f49054002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:07.566634 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d81b4-63fd-45c0-9aed-f84f49054002 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:07.567378 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d81b4-63fd-45c0-9aed-f84f49054002 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:07.567852 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d81b4-63fd-45c0-9aed-f84f49054002 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:07.573361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 349/699] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:13:07.574164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22107a6f-2969-4bfc-8210-abce45095ea0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:07.657468 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d81b4-63fd-45c0-9aed-f84f49054002 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:07.659243 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d81b4-63fd-45c0-9aed-f84f49054002 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:07.687755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:07.694571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22107a6f-2969-4bfc-8210-abce45095ea0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:07.735185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82632a3-cd48-4da3-b00a-931586221769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:07.735787 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82632a3-cd48-4da3-b00a-931586221769 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:07.736063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82632a3-cd48-4da3-b00a-931586221769 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:07.736330 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82632a3-cd48-4da3-b00a-931586221769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:07.737094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82632a3-cd48-4da3-b00a-931586221769 None admin] RBAC: Adding query filter params (role.id=b4c209d1895841af9203c4e432176eb9, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=2b629970ca1a4d7fa4c4f2365e671a80) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:07.737399 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82632a3-cd48-4da3-b00a-931586221769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:07.739558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82632a3-cd48-4da3-b00a-931586221769 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:07.742961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:07.746834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 350/700] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:07 2022] GET /identity/v3/role_assignments?user.id=2b629970ca1a4d7fa4c4f2365e671a80&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=b4c209d1895841af9203c4e432176eb9 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:07.747819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82632a3-cd48-4da3-b00a-931586221769 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:07.772518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 351/701] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 16:13:07.781766 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d81b4-63fd-45c0-9aed-f84f49054002 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:07.882531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82632a3-cd48-4da3-b00a-931586221769 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:07.924663 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab5aac-b5db-48f8-8e96-cad2bd9e3a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:07.925917 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab5aac-b5db-48f8-8e96-cad2bd9e3a0b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:07.926187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab5aac-b5db-48f8-8e96-cad2bd9e3a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:07.926440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab5aac-b5db-48f8-8e96-cad2bd9e3a0b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:07.927030 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab5aac-b5db-48f8-8e96-cad2bd9e3a0b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:07.928486 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab5aac-b5db-48f8-8e96-cad2bd9e3a0b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-82ab5aac-b5db-48f8-8e96-cad2bd9e3a0b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:07.941024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:07.942144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:07.943033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:07.943033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:07.943033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:07.943033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:07.943033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:07.943033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:07.943033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:07.943033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:07.943033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:07.943033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:07.943033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:07.943033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:07.943033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 16:13:07.943033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:07.943033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 351/702] 10.222.0.40 () {56 vars in 1129 bytes} [Thu Aug 11 16:13:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:07.948309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab5aac-b5db-48f8-8e96-cad2bd9e3a0b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:08.008418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d81b4-63fd-45c0-9aed-f84f49054002 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:08.021388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:08.039711 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:08.051089 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797f7e7-921f-46aa-add4-d250793035dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:08.052019 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797f7e7-921f-46aa-add4-d250793035dd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:08.052570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797f7e7-921f-46aa-add4-d250793035dd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:08.053072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797f7e7-921f-46aa-add4-d250793035dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:08.066430 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797f7e7-921f-46aa-add4-d250793035dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:08.067945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797f7e7-921f-46aa-add4-d250793035dd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:08.069651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab5aac-b5db-48f8-8e96-cad2bd9e3a0b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-5797f7e7-921f-46aa-add4-d250793035dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:08.089775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:08.090777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:08.091645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:08.091645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:08.091645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:08.091645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 352/703] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:08.096843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797f7e7-921f-46aa-add4-d250793035dd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:08.136698 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4e1a7-99f8-4a3d-8d52-bdf9923bbd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:08.138090 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4e1a7-99f8-4a3d-8d52-bdf9923bbd12 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:08.138694 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4e1a7-99f8-4a3d-8d52-bdf9923bbd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:08.139747 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4e1a7-99f8-4a3d-8d52-bdf9923bbd12 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:08.140621 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4e1a7-99f8-4a3d-8d52-bdf9923bbd12 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:08.141347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4e1a7-99f8-4a3d-8d52-bdf9923bbd12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:08.142918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4e1a7-99f8-4a3d-8d52-bdf9923bbd12 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:08.153946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 352/704] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Aug 11 16:13:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:08.161537 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4e1a7-99f8-4a3d-8d52-bdf9923bbd12 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:08.271642 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797f7e7-921f-46aa-add4-d250793035dd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:08.323038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67cb57-53f6-491d-ae52-8ada52b10ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:08.323664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67cb57-53f6-491d-ae52-8ada52b10ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:08.323940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67cb57-53f6-491d-ae52-8ada52b10ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:08.324209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67cb57-53f6-491d-ae52-8ada52b10ed1 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:08.324898 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67cb57-53f6-491d-ae52-8ada52b10ed1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:08.325197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67cb57-53f6-491d-ae52-8ada52b10ed1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:08.326259 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4e1a7-99f8-4a3d-8d52-bdf9923bbd12 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:08.326592 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67cb57-53f6-491d-ae52-8ada52b10ed1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:08.342607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 353/705] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:08.344576 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622b18b-1b11-43c6-b803-15cd6bbe004e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:08.344881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622b18b-1b11-43c6-b803-15cd6bbe004e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:08.345155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622b18b-1b11-43c6-b803-15cd6bbe004e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:08.348715 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 354/706] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:08.349740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622b18b-1b11-43c6-b803-15cd6bbe004e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:08.370626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:08.381198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccf52a-5217-4df0-8b8d-4e2701d9f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:08.381857 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccf52a-5217-4df0-8b8d-4e2701d9f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:08.382130 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccf52a-5217-4df0-8b8d-4e2701d9f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:08.382443 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccf52a-5217-4df0-8b8d-4e2701d9f3d2 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:08.383176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccf52a-5217-4df0-8b8d-4e2701d9f3d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:08.383477 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccf52a-5217-4df0-8b8d-4e2701d9f3d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:08.385170 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccf52a-5217-4df0-8b8d-4e2701d9f3d2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:08.396763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 353/707] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Aug 11 16:13:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:08.397589 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:08.399209 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9da0f-fec0-4ac4-85ef-94f0799cf6d0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:08.399652 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9da0f-fec0-4ac4-85ef-94f0799cf6d0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:08.400629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9da0f-fec0-4ac4-85ef-94f0799cf6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:08.428170 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2bc9da0f-fec0-4ac4-85ef-94f0799cf6d0 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:08.429691 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2bc9da0f-fec0-4ac4-85ef-94f0799cf6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:08.465453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622b18b-1b11-43c6-b803-15cd6bbe004e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:08.508946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 354/708] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:13:08.534069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9da0f-fec0-4ac4-85ef-94f0799cf6d0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:08.556128 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849531a-1491-410d-9306-ea25a20ebc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:08.556801 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849531a-1491-410d-9306-ea25a20ebc23 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:08.557085 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849531a-1491-410d-9306-ea25a20ebc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:08.557358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849531a-1491-410d-9306-ea25a20ebc23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:08.575824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849531a-1491-410d-9306-ea25a20ebc23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:08.578140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849531a-1491-410d-9306-ea25a20ebc23 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:08.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-8849531a-1491-410d-9306-ea25a20ebc23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:08.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:08.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:08.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:08.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:08.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:08.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:08.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:08.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:08.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:08.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:08.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:08.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:08.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:08.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:08.599345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:08.600421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:08.600421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:08.600421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:08.600421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:08.600421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:08.600421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:08.600421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:08.600421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:08.604819 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 355/709] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:08.605796 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849531a-1491-410d-9306-ea25a20ebc23 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:08.652244 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9da0f-fec0-4ac4-85ef-94f0799cf6d0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:08.678375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:08.692326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8b396-621f-437e-9ee3-a1c4c6cc31cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:08.693231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8b396-621f-437e-9ee3-a1c4c6cc31cb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:08.693687 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8b396-621f-437e-9ee3-a1c4c6cc31cb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:08.694127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8b396-621f-437e-9ee3-a1c4c6cc31cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:08.705948 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8b396-621f-437e-9ee3-a1c4c6cc31cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:08.707740 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8b396-621f-437e-9ee3-a1c4c6cc31cb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:08.713937 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:08.717059 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849531a-1491-410d-9306-ea25a20ebc23 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-04d8b396-621f-437e-9ee3-a1c4c6cc31cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:08.726562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:08.727524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:08.728410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:08.728410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:08.728410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:08.730686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 355/710] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:08.736898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8b396-621f-437e-9ee3-a1c4c6cc31cb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:08.756387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57e348-b091-4068-ab7e-a562cea84f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:08.757036 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57e348-b091-4068-ab7e-a562cea84f02 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:08.757311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57e348-b091-4068-ab7e-a562cea84f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:08.757579 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57e348-b091-4068-ab7e-a562cea84f02 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:08.758409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57e348-b091-4068-ab7e-a562cea84f02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:08.758755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57e348-b091-4068-ab7e-a562cea84f02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:08.760205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57e348-b091-4068-ab7e-a562cea84f02 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:08.775588 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 356/711] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:08.781193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57e348-b091-4068-ab7e-a562cea84f02 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:08.849295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8b396-621f-437e-9ee3-a1c4c6cc31cb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:08.886286 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57e348-b091-4068-ab7e-a562cea84f02 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:08.886996 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d50a41-0134-42d2-94d1-f6d51af9950f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:08.887877 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d50a41-0134-42d2-94d1-f6d51af9950f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:08.888326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d50a41-0134-42d2-94d1-f6d51af9950f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:08.888834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d50a41-0134-42d2-94d1-f6d51af9950f None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:08.889745 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d50a41-0134-42d2-94d1-f6d51af9950f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:08.890241 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d50a41-0134-42d2-94d1-f6d51af9950f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:08.891791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d50a41-0134-42d2-94d1-f6d51af9950f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:08.905358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 356/712] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:08.911524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d50a41-0134-42d2-94d1-f6d51af9950f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:08.923540 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498b482-3266-4b90-95db-acfaca89c182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:08.924036 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498b482-3266-4b90-95db-acfaca89c182 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:08.924363 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498b482-3266-4b90-95db-acfaca89c182 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:08.924669 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498b482-3266-4b90-95db-acfaca89c182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:08.926043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498b482-3266-4b90-95db-acfaca89c182 None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=4e91f3fbe098459dba0acf8ec1fb7098) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:08.926341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498b482-3266-4b90-95db-acfaca89c182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:08.927980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498b482-3266-4b90-95db-acfaca89c182 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:08.934211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 357/713] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:08 2022] GET /identity/v3/role_assignments?user.id=4e91f3fbe098459dba0acf8ec1fb7098&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:08.951137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:09.026046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d50a41-0134-42d2-94d1-f6d51af9950f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:09.063974 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec1d86-f3af-411a-8220-d80151504cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:09.065024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec1d86-f3af-411a-8220-d80151504cd6 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:09.065507 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec1d86-f3af-411a-8220-d80151504cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:09.066032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec1d86-f3af-411a-8220-d80151504cd6 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:09.066880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec1d86-f3af-411a-8220-d80151504cd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:09.068543 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec1d86-f3af-411a-8220-d80151504cd6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:09.098584 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 357/714] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:13:08 2022] POST /identity/v3/users => generated 254 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:13:09.432076 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e805b7-014d-400d-a029-e5045ee2bec8 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:09.432614 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e805b7-014d-400d-a029-e5045ee2bec8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:09.432614 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e805b7-014d-400d-a029-e5045ee2bec8 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:09.434086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 358/715] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:09.440804 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880f6c3-766f-4862-8432-cffe92d6a529 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:09.441611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880f6c3-766f-4862-8432-cffe92d6a529 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:09.442078 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880f6c3-766f-4862-8432-cffe92d6a529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:09.460752 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f880f6c3-766f-4862-8432-cffe92d6a529 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:09.462227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f880f6c3-766f-4862-8432-cffe92d6a529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:09.538252 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 358/716] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:13:09.560760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e805b7-014d-400d-a029-e5045ee2bec8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:09.589386 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:09.670996 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e805b7-014d-400d-a029-e5045ee2bec8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:09.707210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef449b0-b183-4131-8792-82a130dd4200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:09.707763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef449b0-b183-4131-8792-82a130dd4200 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:09.708035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef449b0-b183-4131-8792-82a130dd4200 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:09.708299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef449b0-b183-4131-8792-82a130dd4200 None admin] PATH_INFO: `/v3/services/network` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:09.709008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef449b0-b183-4131-8792-82a130dd4200 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:09.710414 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef449b0-b183-4131-8792-82a130dd4200 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-eef449b0-b183-4131-8792-82a130dd4200 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:09.722925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:09.723929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:09.724807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:09.724807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:09.724807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:09.724807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:09.724807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:09.724807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:09.724807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:09.724807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:09.724807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:09.724807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:09.724807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:09.724807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:09.724807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 16:13:09.724807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:09.724807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 359/717] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:09 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:09.730606 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880f6c3-766f-4862-8432-cffe92d6a529 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:09.755073 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:09.969296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880f6c3-766f-4862-8432-cffe92d6a529 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:10.012572 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6509c-6458-45b7-b5d8-56bac46affe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:10.013197 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6509c-6458-45b7-b5d8-56bac46affe1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:10.013470 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6509c-6458-45b7-b5d8-56bac46affe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:10.013737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6509c-6458-45b7-b5d8-56bac46affe1 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:10.014366 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6509c-6458-45b7-b5d8-56bac46affe1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:10.014663 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6509c-6458-45b7-b5d8-56bac46affe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:10.016011 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6509c-6458-45b7-b5d8-56bac46affe1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:10.024561 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 359/718] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Aug 11 16:13:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:10.030254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef449b0-b183-4131-8792-82a130dd4200 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:10.133481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:10.145720 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef449b0-b183-4131-8792-82a130dd4200 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:10.183338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e278fe-bec9-4680-99b6-d730fa92122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:10.183944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e278fe-bec9-4680-99b6-d730fa92122e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:10.184218 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e278fe-bec9-4680-99b6-d730fa92122e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:10.184482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e278fe-bec9-4680-99b6-d730fa92122e None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:10.185143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e278fe-bec9-4680-99b6-d730fa92122e None admin] RBAC: Adding query filter params (type=network) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:10.185440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e278fe-bec9-4680-99b6-d730fa92122e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:10.186874 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e278fe-bec9-4680-99b6-d730fa92122e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:10.193389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 360/719] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Aug 11 16:13:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:10.289084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6bffa-cfac-4901-9a03-6cbc50c85710 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:10.289401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6bffa-cfac-4901-9a03-6cbc50c85710 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:10.289624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6bffa-cfac-4901-9a03-6cbc50c85710 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:10.291171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 360/720] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:10.302319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf80b6-bbc0-41f1-969a-29ef1dcb9a85 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:10.302651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf80b6-bbc0-41f1-969a-29ef1dcb9a85 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:10.302862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf80b6-bbc0-41f1-969a-29ef1dcb9a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:10.322326 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fdbf80b6-bbc0-41f1-969a-29ef1dcb9a85 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:10.323514 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fdbf80b6-bbc0-41f1-969a-29ef1dcb9a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:10.396371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 361/721] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:13:10.423573 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6bffa-cfac-4901-9a03-6cbc50c85710 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:10.518981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:10.538461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6bffa-cfac-4901-9a03-6cbc50c85710 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:10.579936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21752c-a9ff-437e-adfe-28d049f11b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:10.580569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21752c-a9ff-437e-adfe-28d049f11b91 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:10.580865 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21752c-a9ff-437e-adfe-28d049f11b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:10.581132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21752c-a9ff-437e-adfe-28d049f11b91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:10.591981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21752c-a9ff-437e-adfe-28d049f11b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-cb21752c-a9ff-437e-adfe-28d049f11b91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:10.597528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:10.598392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:10.598392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:10.598392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:10.598392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:10.598392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:10.598392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:10.598392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:10.598392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:10.598392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:10.598392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:10.598392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:10.598392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:10.601860 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 361/722] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:13:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:10.607770 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf80b6-bbc0-41f1-969a-29ef1dcb9a85 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:10.722444 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:10.749612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf80b6-bbc0-41f1-969a-29ef1dcb9a85 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:10.800704 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b6392-87e8-49bd-9581-67c2234283ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:10.801389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b6392-87e8-49bd-9581-67c2234283ff None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:10.801670 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b6392-87e8-49bd-9581-67c2234283ff None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:10.801936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b6392-87e8-49bd-9581-67c2234283ff None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:10.802600 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b6392-87e8-49bd-9581-67c2234283ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:10.802896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b6392-87e8-49bd-9581-67c2234283ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:10.804285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b6392-87e8-49bd-9581-67c2234283ff None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:10.816845 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 362/723] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:13:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:10.819939 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21752c-a9ff-437e-adfe-28d049f11b91 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:10.936530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21752c-a9ff-437e-adfe-28d049f11b91 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:10.980045 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dba450-21b1-4e70-9d84-8830ea866054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:10.980710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dba450-21b1-4e70-9d84-8830ea866054 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:10.980991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dba450-21b1-4e70-9d84-8830ea866054 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:10.981260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dba450-21b1-4e70-9d84-8830ea866054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:11.002488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dba450-21b1-4e70-9d84-8830ea866054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:11.004469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dba450-21b1-4e70-9d84-8830ea866054 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:11.009932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-13dba450-21b1-4e70-9d84-8830ea866054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:11.026581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:11.027545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:11.028405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:11.028405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:11.028405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:11.028405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 362/724] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:11.033562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b6392-87e8-49bd-9581-67c2234283ff None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:11.111081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be8a59-b128-466f-8a46-cf34965d731f None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:11.111716 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be8a59-b128-466f-8a46-cf34965d731f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:11.112250 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be8a59-b128-466f-8a46-cf34965d731f None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:11.114204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 363/725] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:11.121607 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6f01a-19d2-4392-8617-2a89a58aa3f7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:11.122326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6f01a-19d2-4392-8617-2a89a58aa3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:11.123478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6f01a-19d2-4392-8617-2a89a58aa3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:11.159019 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a5e6f01a-19d2-4392-8617-2a89a58aa3f7 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:11.160827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a5e6f01a-19d2-4392-8617-2a89a58aa3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:11.316523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 364/726] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:13:11.324766 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3175d58-6e55-4581-8c47-dcdd79784b31 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:11.324766 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3175d58-6e55-4581-8c47-dcdd79784b31 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:11.324766 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3175d58-6e55-4581-8c47-dcdd79784b31 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:11.324766 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 365/727] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:11.325405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ea05a-b1bc-449c-b986-e27c72b92675 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:11.325405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ea05a-b1bc-449c-b986-e27c72b92675 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:11.325706 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ea05a-b1bc-449c-b986-e27c72b92675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:11.344051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-776ea05a-b1bc-449c-b986-e27c72b92675 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:11.345268 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-776ea05a-b1bc-449c-b986-e27c72b92675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:11.384101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b6392-87e8-49bd-9581-67c2234283ff None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:11.420231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 366/728] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 16:13:11.421450 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ea05a-b1bc-449c-b986-e27c72b92675 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:11.428073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045bc4e-7714-45c9-b6f6-5014c7974b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:11.428764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045bc4e-7714-45c9-b6f6-5014c7974b56 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:11.429041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045bc4e-7714-45c9-b6f6-5014c7974b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:11.429310 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045bc4e-7714-45c9-b6f6-5014c7974b56 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:11.430001 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045bc4e-7714-45c9-b6f6-5014c7974b56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:11.430300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045bc4e-7714-45c9-b6f6-5014c7974b56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:11.431744 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045bc4e-7714-45c9-b6f6-5014c7974b56 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:11.452315 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 363/729] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:11.457744 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045bc4e-7714-45c9-b6f6-5014c7974b56 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:11.465571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:11.483711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:11.531644 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ea05a-b1bc-449c-b986-e27c72b92675 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:11.568938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343193d-9507-4b77-a387-b413547f99cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:11.569709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343193d-9507-4b77-a387-b413547f99cf None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:11.570012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343193d-9507-4b77-a387-b413547f99cf None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:11.570347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343193d-9507-4b77-a387-b413547f99cf None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:11.571052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343193d-9507-4b77-a387-b413547f99cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:11.572489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343193d-9507-4b77-a387-b413547f99cf None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:11.583630 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045bc4e-7714-45c9-b6f6-5014c7974b56 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:11.596606 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 367/730] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Aug 11 16:13:11 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:13:11.596606 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343193d-9507-4b77-a387-b413547f99cf None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:11.678111 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fa761-28b1-42b1-81ad-6a8363b04807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:11.679531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fa761-28b1-42b1-81ad-6a8363b04807 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:11.679992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fa761-28b1-42b1-81ad-6a8363b04807 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:11.680449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fa761-28b1-42b1-81ad-6a8363b04807 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:11.696815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fa761-28b1-42b1-81ad-6a8363b04807 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:11.698699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fa761-28b1-42b1-81ad-6a8363b04807 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f38fa761-28b1-42b1-81ad-6a8363b04807 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:11.711331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:11.712372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:11.713374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:11.713374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:11.713374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:11.713374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:11.713374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:11.713374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:11.713374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:11.713374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:11.713374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 16:13:11.713374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:11.715995 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 364/731] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:13:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:11.722459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fa761-28b1-42b1-81ad-6a8363b04807 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:11.733376 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343193d-9507-4b77-a387-b413547f99cf None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:11.773025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:11.795324 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:11.817369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dc5d1-b438-4a0e-9c4d-4883632c4cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:11.818084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dc5d1-b438-4a0e-9c4d-4883632c4cba None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:11.818361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dc5d1-b438-4a0e-9c4d-4883632c4cba None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:11.818627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dc5d1-b438-4a0e-9c4d-4883632c4cba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:11.846524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dc5d1-b438-4a0e-9c4d-4883632c4cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:11.850129 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fa761-28b1-42b1-81ad-6a8363b04807 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-d75dc5d1-b438-4a0e-9c4d-4883632c4cba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:11.852086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:11.853198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:11.854042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:11.854042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:11.854042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:11.854042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:11.854042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:11.854042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:11.854042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:11.854042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:11.854042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:11.854042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:11.854042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:11.854042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:11.864623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 368/732] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:13:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:11.876649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dc5d1-b438-4a0e-9c4d-4883632c4cba None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:11.896831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b54819-e0db-4b85-9789-4c0e0e9f6b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:11.897788 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b54819-e0db-4b85-9789-4c0e0e9f6b6e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:11.898310 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b54819-e0db-4b85-9789-4c0e0e9f6b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:11.898841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b54819-e0db-4b85-9789-4c0e0e9f6b6e None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:11.900182 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b54819-e0db-4b85-9789-4c0e0e9f6b6e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:11.900999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b54819-e0db-4b85-9789-4c0e0e9f6b6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:11.902849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b54819-e0db-4b85-9789-4c0e0e9f6b6e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:11.927187 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 365/733] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Aug 11 16:13:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:11.932098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b54819-e0db-4b85-9789-4c0e0e9f6b6e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:12.005244 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dc5d1-b438-4a0e-9c4d-4883632c4cba None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:12.044401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd51363-3db1-4064-8334-a05036caf5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:12.044941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd51363-3db1-4064-8334-a05036caf5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:12.045217 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd51363-3db1-4064-8334-a05036caf5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:12.045488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd51363-3db1-4064-8334-a05036caf5e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:12.046157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd51363-3db1-4064-8334-a05036caf5e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:12.046456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd51363-3db1-4064-8334-a05036caf5e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:12.047822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd51363-3db1-4064-8334-a05036caf5e7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:12.058132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 369/734] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:13:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:12.059936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b54819-e0db-4b85-9789-4c0e0e9f6b6e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:12.063668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd51363-3db1-4064-8334-a05036caf5e7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:12.082239 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:12.104245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f0048-0dcc-4a99-92f0-f1ff4475ff58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:12.105371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f0048-0dcc-4a99-92f0-f1ff4475ff58 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:12.105578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f0048-0dcc-4a99-92f0-f1ff4475ff58 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:12.105832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f0048-0dcc-4a99-92f0-f1ff4475ff58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:12.121034 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:12.204518 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd51363-3db1-4064-8334-a05036caf5e7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:12.216123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f0048-0dcc-4a99-92f0-f1ff4475ff58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:12.217803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f0048-0dcc-4a99-92f0-f1ff4475ff58 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:12.242651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fe864-f1ca-4c2e-b308-dd182318d4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:12.243394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fe864-f1ca-4c2e-b308-dd182318d4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:12.243671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fe864-f1ca-4c2e-b308-dd182318d4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:12.243942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fe864-f1ca-4c2e-b308-dd182318d4c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:12.255685 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fe864-f1ca-4c2e-b308-dd182318d4c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:12.257228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fe864-f1ca-4c2e-b308-dd182318d4c1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-fb3fe864-f1ca-4c2e-b308-dd182318d4c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:12.272823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:12.273971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:12.275018 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:12.275018 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:12.275018 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:12.275018 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 370/735] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:12.275571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cceb07-ecf3-47b5-886c-1c529a60693c None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:12.275851 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cceb07-ecf3-47b5-886c-1c529a60693c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:12.276119 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cceb07-ecf3-47b5-886c-1c529a60693c None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:12.281408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 371/736] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:12.281408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cceb07-ecf3-47b5-886c-1c529a60693c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:12.341877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 366/737] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:11 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 16:13:12.343579 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1468c02-f7bc-485b-9e41-29ff6926002e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:12.344002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1468c02-f7bc-485b-9e41-29ff6926002e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:12.344469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1468c02-f7bc-485b-9e41-29ff6926002e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:12.367618 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f1468c02-f7bc-485b-9e41-29ff6926002e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:12.369155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f1468c02-f7bc-485b-9e41-29ff6926002e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:12.383248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:12.385028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:12.393946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cceb07-ecf3-47b5-886c-1c529a60693c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:12.431859 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f716768-7fca-43be-8405-e4b21999912d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:12.432644 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f716768-7fca-43be-8405-e4b21999912d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:12.432846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f716768-7fca-43be-8405-e4b21999912d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:12.433116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f716768-7fca-43be-8405-e4b21999912d None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:12.433811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f716768-7fca-43be-8405-e4b21999912d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:12.434112 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f716768-7fca-43be-8405-e4b21999912d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:12.435583 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f716768-7fca-43be-8405-e4b21999912d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:12.452334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 372/738] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:12.452334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f716768-7fca-43be-8405-e4b21999912d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:12.452941 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 367/739] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:13:12.454043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1468c02-f7bc-485b-9e41-29ff6926002e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:12.553832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f716768-7fca-43be-8405-e4b21999912d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:12.582311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1468c02-f7bc-485b-9e41-29ff6926002e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:12.588755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e4f35-7beb-4c33-b619-5a33a1f22c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:12.589379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e4f35-7beb-4c33-b619-5a33a1f22c0b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:12.589653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e4f35-7beb-4c33-b619-5a33a1f22c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:12.589919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e4f35-7beb-4c33-b619-5a33a1f22c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:12.601011 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e4f35-7beb-4c33-b619-5a33a1f22c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:12.602447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e4f35-7beb-4c33-b619-5a33a1f22c0b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-132e4f35-7beb-4c33-b619-5a33a1f22c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:12.618296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:12.619412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:12.620398 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:12.620398 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:12.620398 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:12.623915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 373/740] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:12.624887 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e4f35-7beb-4c33-b619-5a33a1f22c0b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:12.627528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c9722-7de8-4001-9298-fde99bdbe00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:12.628433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:12.629739 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c9722-7de8-4001-9298-fde99bdbe00b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:12.630313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c9722-7de8-4001-9298-fde99bdbe00b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:12.630723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c9722-7de8-4001-9298-fde99bdbe00b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:12.639253 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c9722-7de8-4001-9298-fde99bdbe00b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:12.640906 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c9722-7de8-4001-9298-fde99bdbe00b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-bd7c9722-7de8-4001-9298-fde99bdbe00b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:12.652631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:12.653723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:12.654778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:12.654778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:12.654778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:12.654778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:12.654778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:12.654778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:12.654778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:12.654778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:12.654778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:13:12.654778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:12.656559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 368/741] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Aug 11 16:13:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:12.657478 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c9722-7de8-4001-9298-fde99bdbe00b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:12.670114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:12.735067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e4f35-7beb-4c33-b619-5a33a1f22c0b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:12.766081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c9722-7de8-4001-9298-fde99bdbe00b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:12.769221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f5282-0105-455f-a099-89adc02e096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:12.769850 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f5282-0105-455f-a099-89adc02e096f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:12.770123 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f5282-0105-455f-a099-89adc02e096f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:12.770386 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f5282-0105-455f-a099-89adc02e096f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:12.780840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f5282-0105-455f-a099-89adc02e096f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-7c7f5282-0105-455f-a099-89adc02e096f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:12.786430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:12.787328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:12.788141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:12.788141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:12.788141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:12.788141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:12.788141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:12.788141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:12.788141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:12.788141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:12.788141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:12.788141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:12.788141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:13:12.788141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:12.788141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 374/742] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:13:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:12.790702 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34dec2-57e8-4d96-9605-fa123dded19c None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:12.790702 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34dec2-57e8-4d96-9605-fa123dded19c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:12.790702 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34dec2-57e8-4d96-9605-fa123dded19c None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:12.791217 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 375/743] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:12.793379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34dec2-57e8-4d96-9605-fa123dded19c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:12.810059 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d40fb7-3526-490e-a1df-2830e9709048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:12.810663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d40fb7-3526-490e-a1df-2830e9709048 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:12.810962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d40fb7-3526-490e-a1df-2830e9709048 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:12.811203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d40fb7-3526-490e-a1df-2830e9709048 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:12.811835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d40fb7-3526-490e-a1df-2830e9709048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:12.812145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d40fb7-3526-490e-a1df-2830e9709048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:12.813502 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d40fb7-3526-490e-a1df-2830e9709048 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:12.829590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 369/744] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:12.829590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d40fb7-3526-490e-a1df-2830e9709048 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:12.861059 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:12.896150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:12.902226 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34dec2-57e8-4d96-9605-fa123dded19c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:12.933976 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d40fb7-3526-490e-a1df-2830e9709048 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:12.936611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce6f55-629e-43bd-894e-a30097a68bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:12.937233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce6f55-629e-43bd-894e-a30097a68bdc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:12.937519 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce6f55-629e-43bd-894e-a30097a68bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:12.937793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce6f55-629e-43bd-894e-a30097a68bdc None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:12.938518 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce6f55-629e-43bd-894e-a30097a68bdc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:12.938824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce6f55-629e-43bd-894e-a30097a68bdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:12.940247 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce6f55-629e-43bd-894e-a30097a68bdc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:12.962945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 376/745] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Aug 11 16:13:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:12.962945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc311f67-6cad-4321-97ae-db061d9ea016 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:12.962945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc311f67-6cad-4321-97ae-db061d9ea016 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:12.962945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc311f67-6cad-4321-97ae-db061d9ea016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:12.977624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a193f32-c801-4806-9a74-50fea84455e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:12.978408 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a193f32-c801-4806-9a74-50fea84455e7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:12.978978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a193f32-c801-4806-9a74-50fea84455e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:12.979404 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a193f32-c801-4806-9a74-50fea84455e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:12.979531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-dc311f67-6cad-4321-97ae-db061d9ea016 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:12.980306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a193f32-c801-4806-9a74-50fea84455e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:12.980615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dc311f67-6cad-4321-97ae-db061d9ea016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:12.980931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a193f32-c801-4806-9a74-50fea84455e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:12.982564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a193f32-c801-4806-9a74-50fea84455e7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:12.991779 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 370/746] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:13:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:12.992838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a193f32-c801-4806-9a74-50fea84455e7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:13.056351 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 377/747] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 16:13:13.064824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc311f67-6cad-4321-97ae-db061d9ea016 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:13.114965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:13.119577 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a193f32-c801-4806-9a74-50fea84455e7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:13.149763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:13.156234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcb21d-1998-4d45-9ef0-fc3bd27125bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:13.156892 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcb21d-1998-4d45-9ef0-fc3bd27125bd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:13.157171 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcb21d-1998-4d45-9ef0-fc3bd27125bd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:13.157441 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcb21d-1998-4d45-9ef0-fc3bd27125bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:13.164167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcb21d-1998-4d45-9ef0-fc3bd27125bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:13.165614 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcb21d-1998-4d45-9ef0-fc3bd27125bd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:13.170005 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc311f67-6cad-4321-97ae-db061d9ea016 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:13.176972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-d3fcb21d-1998-4d45-9ef0-fc3bd27125bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:13.176972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:13.176972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:13.176972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:13.176972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:13.176972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:13.176972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:13.176972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:13.176972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:13.176972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:13.176972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:13.176972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:13.176972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:13.176972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:13.176972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:13.177859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:13.178742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:13.178742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:13.178742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:13.178742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:13.178742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:13.178742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:13.178742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:13.178742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:13.178742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 371/748] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:13.179223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcb21d-1998-4d45-9ef0-fc3bd27125bd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:13.218713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de42b3-d972-4785-b968-305ef5a45af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:13.219338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de42b3-d972-4785-b968-305ef5a45af0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:13.219675 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de42b3-d972-4785-b968-305ef5a45af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:13.219947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de42b3-d972-4785-b968-305ef5a45af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:13.230338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de42b3-d972-4785-b968-305ef5a45af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:13.231776 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de42b3-d972-4785-b968-305ef5a45af0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-b2de42b3-d972-4785-b968-305ef5a45af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:13.246541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:13.247466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:13.248345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:13.248345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:13.248345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:13.248345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 378/749] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:13.248345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de42b3-d972-4785-b968-305ef5a45af0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:13.288637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcb21d-1998-4d45-9ef0-fc3bd27125bd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:13.323225 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cb37d-ecc5-40f1-a89b-e9cf30878a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:13.323840 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cb37d-ecc5-40f1-a89b-e9cf30878a76 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:13.324113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cb37d-ecc5-40f1-a89b-e9cf30878a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:13.324380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cb37d-ecc5-40f1-a89b-e9cf30878a76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:13.335301 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cb37d-ecc5-40f1-a89b-e9cf30878a76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:13.336759 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cb37d-ecc5-40f1-a89b-e9cf30878a76 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-d31cb37d-ecc5-40f1-a89b-e9cf30878a76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:13.351341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:13.352305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:13.353247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:13.353247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:13.353247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:13.357015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 372/750] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:13.357137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de42b3-d972-4785-b968-305ef5a45af0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:13.357891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cb37d-ecc5-40f1-a89b-e9cf30878a76 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:13.358921 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:13.394821 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f880a-e5b5-4c12-9a80-3c30416fa502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:13.395430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f880a-e5b5-4c12-9a80-3c30416fa502 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:13.395711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f880a-e5b5-4c12-9a80-3c30416fa502 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:13.395985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f880a-e5b5-4c12-9a80-3c30416fa502 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:13.396668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f880a-e5b5-4c12-9a80-3c30416fa502 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:13.398065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f880a-e5b5-4c12-9a80-3c30416fa502 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:13.402495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:13.417611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 379/751] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Aug 11 16:13:13 2022] POST /identity/v3/services => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:13:13.419068 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f880a-e5b5-4c12-9a80-3c30416fa502 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:13.485190 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cb37d-ecc5-40f1-a89b-e9cf30878a76 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:13.535435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993bf95-09f0-4768-bbff-c66990fa6e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:13.536499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993bf95-09f0-4768-bbff-c66990fa6e5f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:13.536985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993bf95-09f0-4768-bbff-c66990fa6e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:13.537467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993bf95-09f0-4768-bbff-c66990fa6e5f None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:13.538519 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993bf95-09f0-4768-bbff-c66990fa6e5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:13.539157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993bf95-09f0-4768-bbff-c66990fa6e5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:13.541029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993bf95-09f0-4768-bbff-c66990fa6e5f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:13.558754 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 373/752] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:13.560044 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993bf95-09f0-4768-bbff-c66990fa6e5f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:13.571622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f880a-e5b5-4c12-9a80-3c30416fa502 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:13.615323 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ce25-75cf-44a2-b975-a36789790d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:13.615924 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ce25-75cf-44a2-b975-a36789790d56 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:13.616222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ce25-75cf-44a2-b975-a36789790d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:13.616462 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ce25-75cf-44a2-b975-a36789790d56 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:13.617306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15ce25-75cf-44a2-b975-a36789790d56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:13.617415 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15ce25-75cf-44a2-b975-a36789790d56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:13.618875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15ce25-75cf-44a2-b975-a36789790d56 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:13.630954 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 380/753] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:13.632327 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ce25-75cf-44a2-b975-a36789790d56 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:13.660464 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:13.683562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:13.687958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993bf95-09f0-4768-bbff-c66990fa6e5f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:13.733272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecc2fe-3eb2-4fec-bd09-8c19e8740ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:13.734129 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecc2fe-3eb2-4fec-bd09-8c19e8740ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:13.734426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecc2fe-3eb2-4fec-bd09-8c19e8740ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:13.734702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecc2fe-3eb2-4fec-bd09-8c19e8740ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:13.735590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecc2fe-3eb2-4fec-bd09-8c19e8740ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:13.736300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecc2fe-3eb2-4fec-bd09-8c19e8740ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:13.738478 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecc2fe-3eb2-4fec-bd09-8c19e8740ad6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:13.742294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ce25-75cf-44a2-b975-a36789790d56 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:13.756672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 374/754] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:13.757588 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecc2fe-3eb2-4fec-bd09-8c19e8740ad6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:13.789347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a828b-956a-4034-8df9-69ae503df46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:13.789945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a828b-956a-4034-8df9-69ae503df46b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:13.790219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a828b-956a-4034-8df9-69ae503df46b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:13.790486 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a828b-956a-4034-8df9-69ae503df46b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:13.791264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a828b-956a-4034-8df9-69ae503df46b None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=2b629970ca1a4d7fa4c4f2365e671a80) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:13.791569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a828b-956a-4034-8df9-69ae503df46b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:13.793020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a828b-956a-4034-8df9-69ae503df46b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:13.799249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 381/755] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:13 2022] GET /identity/v3/role_assignments?user.id=2b629970ca1a4d7fa4c4f2365e671a80&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:13.800576 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a828b-956a-4034-8df9-69ae503df46b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:13.907311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:13.927502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a828b-956a-4034-8df9-69ae503df46b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:13.973410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6dd62-ae82-427c-ac55-50cf29ecb2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:13.974445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6dd62-ae82-427c-ac55-50cf29ecb2cd None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:13.976487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6dd62-ae82-427c-ac55-50cf29ecb2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:13.976979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6dd62-ae82-427c-ac55-50cf29ecb2cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:13.991554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6dd62-ae82-427c-ac55-50cf29ecb2cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:13.993860 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6dd62-ae82-427c-ac55-50cf29ecb2cd None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:14.006869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecc2fe-3eb2-4fec-bd09-8c19e8740ad6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-aee6dd62-ae82-427c-ac55-50cf29ecb2cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:14.021063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:14.022198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:14.023292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:14.023292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:14.023292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:14.023292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:14.023292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:14.023292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:14.023292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:14.023292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:14.023292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 16:13:14.023292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:14.025487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 382/756] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Aug 11 16:13:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:14.030823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6dd62-ae82-427c-ac55-50cf29ecb2cd None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:14.044161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7fba3-29ac-4c51-a1a2-5017eee12289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:14.044844 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7fba3-29ac-4c51-a1a2-5017eee12289 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:14.045202 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7fba3-29ac-4c51-a1a2-5017eee12289 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:14.045479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7fba3-29ac-4c51-a1a2-5017eee12289 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:14.053672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7fba3-29ac-4c51-a1a2-5017eee12289 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:14.055117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7fba3-29ac-4c51-a1a2-5017eee12289 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:14.067359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-13f7fba3-29ac-4c51-a1a2-5017eee12289 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:14.067359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:14.067359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:14.067359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:14.067359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:14.067359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:14.067359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:14.067359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:14.067359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:14.067359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:14.067359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:14.067359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:14.067359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:14.067359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:14.067359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:14.068234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:14.069147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:14.069147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:14.069147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:14.069147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:14.069147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:14.069147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:14.069147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:14.069147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:14.069147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 375/757] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:14.070057 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4c435-86ff-4741-a7b6-fae530f81c89 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:14.070213 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4c435-86ff-4741-a7b6-fae530f81c89 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:14.070472 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4c435-86ff-4741-a7b6-fae530f81c89 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:14.075686 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 376/758] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:14.077590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4c435-86ff-4741-a7b6-fae530f81c89 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:14.100065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:14.161592 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6dd62-ae82-427c-ac55-50cf29ecb2cd None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:14.197147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4c435-86ff-4741-a7b6-fae530f81c89 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:14.208829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15255c5-92da-43ec-8c22-2ad01c9ae51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:14.209476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15255c5-92da-43ec-8c22-2ad01c9ae51d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:14.209750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15255c5-92da-43ec-8c22-2ad01c9ae51d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:14.210013 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15255c5-92da-43ec-8c22-2ad01c9ae51d None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:14.210739 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15255c5-92da-43ec-8c22-2ad01c9ae51d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:14.211039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15255c5-92da-43ec-8c22-2ad01c9ae51d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:14.212449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15255c5-92da-43ec-8c22-2ad01c9ae51d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:14.244621 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f6029-ea04-4e34-88ff-2a4550541ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:14.244621 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f6029-ea04-4e34-88ff-2a4550541ade None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:14.244621 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f6029-ea04-4e34-88ff-2a4550541ade None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:14.244946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 383/759] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Aug 11 16:13:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:14.245043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f6029-ea04-4e34-88ff-2a4550541ade None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:14.245043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f6029-ea04-4e34-88ff-2a4550541ade None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:14.245043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f6029-ea04-4e34-88ff-2a4550541ade None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:14.245243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805ce4c-703c-4cd1-9a68-10c5e34f93da None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:14.245243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805ce4c-703c-4cd1-9a68-10c5e34f93da None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:14.245243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805ce4c-703c-4cd1-9a68-10c5e34f93da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:14.245425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f6029-ea04-4e34-88ff-2a4550541ade None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:14.256398 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:14.261917 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 377/760] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:14.262542 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0805ce4c-703c-4cd1-9a68-10c5e34f93da None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:14.263072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f6029-ea04-4e34-88ff-2a4550541ade None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:14.268493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0805ce4c-703c-4cd1-9a68-10c5e34f93da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:14.349848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 384/761] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:14.350806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805ce4c-703c-4cd1-9a68-10c5e34f93da None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:14.371127 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:14.401974 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f6029-ea04-4e34-88ff-2a4550541ade None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:14.449620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412472f2-5a3c-45c3-a635-f17799ae58b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:14.450641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412472f2-5a3c-45c3-a635-f17799ae58b4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:14.451490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412472f2-5a3c-45c3-a635-f17799ae58b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:14.451905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412472f2-5a3c-45c3-a635-f17799ae58b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:14.470422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805ce4c-703c-4cd1-9a68-10c5e34f93da None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:14.507625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94516ee9-9ab6-4939-bb34-3ed4ad9b7fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:14.508287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94516ee9-9ab6-4939-bb34-3ed4ad9b7fe5 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:14.508734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94516ee9-9ab6-4939-bb34-3ed4ad9b7fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:14.509132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94516ee9-9ab6-4939-bb34-3ed4ad9b7fe5 None admin] PATH_INFO: `/v3/projects/3b0514f7236d42d1955e895adaf41389/users/4e91f3fbe098459dba0acf8ec1fb7098/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:14.511386 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94516ee9-9ab6-4939-bb34-3ed4ad9b7fe5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0514f7236d42d1955e895adaf41389, user_id=4e91f3fbe098459dba0acf8ec1fb7098, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:14.513009 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94516ee9-9ab6-4939-bb34-3ed4ad9b7fe5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:14.515483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:14.533023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 385/762] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:13:14 2022] PUT /identity/v3/projects/3b0514f7236d42d1955e895adaf41389/users/4e91f3fbe098459dba0acf8ec1fb7098/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:13:14.534033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94516ee9-9ab6-4939-bb34-3ed4ad9b7fe5 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:14.570302 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412472f2-5a3c-45c3-a635-f17799ae58b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:14.572047 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412472f2-5a3c-45c3-a635-f17799ae58b4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:14.739432 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94516ee9-9ab6-4939-bb34-3ed4ad9b7fe5 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:14.745318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:14.772728 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 378/763] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 16:13:14.777756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e168405-1a8f-49a1-9f13-59d95bb79a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:14.777756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e168405-1a8f-49a1-9f13-59d95bb79a53 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:14.778004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e168405-1a8f-49a1-9f13-59d95bb79a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:14.778082 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e168405-1a8f-49a1-9f13-59d95bb79a53 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:14.778678 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e168405-1a8f-49a1-9f13-59d95bb79a53 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:14.779468 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412472f2-5a3c-45c3-a635-f17799ae58b4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:14.780161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e168405-1a8f-49a1-9f13-59d95bb79a53 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5e168405-1a8f-49a1-9f13-59d95bb79a53 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:14.790890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:14.791868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:14.792715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:14.792715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:14.792715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:14.792715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:14.792715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:14.792715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:14.792715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:14.792715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:14.792715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:14.792715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:14.792715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:14.792715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:14.792715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 16:13:14.792715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:14.792715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 386/764] 10.222.0.40 () {56 vars in 1129 bytes} [Thu Aug 11 16:13:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:14.798366 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e168405-1a8f-49a1-9f13-59d95bb79a53 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:14.861278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:14.895288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412472f2-5a3c-45c3-a635-f17799ae58b4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:14.907370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e168405-1a8f-49a1-9f13-59d95bb79a53 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:14.933295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3266409-1ad5-4245-a2ac-3ad0ab55112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:14.934348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3266409-1ad5-4245-a2ac-3ad0ab55112c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:14.934826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3266409-1ad5-4245-a2ac-3ad0ab55112c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:14.935290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3266409-1ad5-4245-a2ac-3ad0ab55112c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:14.944500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4165ce0-b02a-4dd8-b0b1-f21a2779668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:14.945107 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4165ce0-b02a-4dd8-b0b1-f21a2779668c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:14.945383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4165ce0-b02a-4dd8-b0b1-f21a2779668c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:14.945658 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4165ce0-b02a-4dd8-b0b1-f21a2779668c None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:14.946321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4165ce0-b02a-4dd8-b0b1-f21a2779668c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:14.946571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4165ce0-b02a-4dd8-b0b1-f21a2779668c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:14.947646 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3266409-1ad5-4245-a2ac-3ad0ab55112c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:14.947940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4165ce0-b02a-4dd8-b0b1-f21a2779668c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:14.949624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3266409-1ad5-4245-a2ac-3ad0ab55112c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:14.953311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 387/765] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Aug 11 16:13:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:14.959282 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4165ce0-b02a-4dd8-b0b1-f21a2779668c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e3266409-1ad5-4245-a2ac-3ad0ab55112c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:14.966921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:14.967958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:14.968863 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:14.968863 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:14.968863 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:14.970900 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 379/766] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:14.977594 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3266409-1ad5-4245-a2ac-3ad0ab55112c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:15.032538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:15.076645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4165ce0-b02a-4dd8-b0b1-f21a2779668c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:15.113145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3266409-1ad5-4245-a2ac-3ad0ab55112c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:15.114814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:15.132108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc9707-1362-4fce-a871-86c9e66e055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:15.140814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc9707-1362-4fce-a871-86c9e66e055f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:15.141158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc9707-1362-4fce-a871-86c9e66e055f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:15.141439 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc9707-1362-4fce-a871-86c9e66e055f None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:15.142272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc9707-1362-4fce-a871-86c9e66e055f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:15.142390 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc9707-1362-4fce-a871-86c9e66e055f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:15.144563 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc9707-1362-4fce-a871-86c9e66e055f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:15.150060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 388/767] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Aug 11 16:13:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:15.156615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc9707-1362-4fce-a871-86c9e66e055f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:15.162002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aefeb7-a8f0-4890-a2ef-d95ba58eafdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:15.162608 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aefeb7-a8f0-4890-a2ef-d95ba58eafdb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:15.162883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aefeb7-a8f0-4890-a2ef-d95ba58eafdb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:15.163148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aefeb7-a8f0-4890-a2ef-d95ba58eafdb None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:15.163783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aefeb7-a8f0-4890-a2ef-d95ba58eafdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:15.164081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aefeb7-a8f0-4890-a2ef-d95ba58eafdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:15.165455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aefeb7-a8f0-4890-a2ef-d95ba58eafdb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:15.191005 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 380/768] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:15.201541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aefeb7-a8f0-4890-a2ef-d95ba58eafdb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:15.309248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc9707-1362-4fce-a871-86c9e66e055f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:15.374795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299f667-75a4-434d-b2f3-860a9768072b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:15.375412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299f667-75a4-434d-b2f3-860a9768072b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:15.375689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299f667-75a4-434d-b2f3-860a9768072b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:15.375960 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299f667-75a4-434d-b2f3-860a9768072b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:15.376701 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299f667-75a4-434d-b2f3-860a9768072b None admin] RBAC: Adding query filter params (interface=public, service_id=5cd7bf4e9ce74bf1aa012aac1822d2a4, region_id=RegionOne) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:15.377010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299f667-75a4-434d-b2f3-860a9768072b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:15.378411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299f667-75a4-434d-b2f3-860a9768072b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:15.391737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:15.395706 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 389/769] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Aug 11 16:13:15 2022] GET /identity/v3/endpoints?service_id=5cd7bf4e9ce74bf1aa012aac1822d2a4&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:15.399780 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299f667-75a4-434d-b2f3-860a9768072b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:15.411339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aefeb7-a8f0-4890-a2ef-d95ba58eafdb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:15.464374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:15.508509 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299f667-75a4-434d-b2f3-860a9768072b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:15.508905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916a5f2-5dc1-4c6f-bbef-94c03b9a0c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:15.509537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916a5f2-5dc1-4c6f-bbef-94c03b9a0c9b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:15.509811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916a5f2-5dc1-4c6f-bbef-94c03b9a0c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:15.510077 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916a5f2-5dc1-4c6f-bbef-94c03b9a0c9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:15.525462 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916a5f2-5dc1-4c6f-bbef-94c03b9a0c9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:15.526941 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916a5f2-5dc1-4c6f-bbef-94c03b9a0c9b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:15.552622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-9916a5f2-5dc1-4c6f-bbef-94c03b9a0c9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:15.552622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:15.552622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:15.552622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:15.552622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:15.552622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:15.552622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:15.552622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:15.552622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:15.552622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:15.552622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:15.552622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:15.552622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:15.552622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:15.552622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:15.553626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:15.554628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:15.554628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:15.554628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:15.554628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:15.554628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:15.554628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:15.554628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:15.554628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:15.560706 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110f005-0414-44b5-991b-b26c19daa8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:15.560706 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110f005-0414-44b5-991b-b26c19daa8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:15.560706 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110f005-0414-44b5-991b-b26c19daa8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:15.560706 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110f005-0414-44b5-991b-b26c19daa8c2 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:15.561036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110f005-0414-44b5-991b-b26c19daa8c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:15.561036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110f005-0414-44b5-991b-b26c19daa8c2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:15.562422 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 381/770] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:15.572679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 390/771] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Aug 11 16:13:15 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:15.573967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916a5f2-5dc1-4c6f-bbef-94c03b9a0c9b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:15.730470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916a5f2-5dc1-4c6f-bbef-94c03b9a0c9b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:15.775501 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14808618-4278-4fc8-a0b0-378fb1d58be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:15.776115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14808618-4278-4fc8-a0b0-378fb1d58be1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:15.776393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14808618-4278-4fc8-a0b0-378fb1d58be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:15.776690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14808618-4278-4fc8-a0b0-378fb1d58be1 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:15.777389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14808618-4278-4fc8-a0b0-378fb1d58be1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:15.777690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14808618-4278-4fc8-a0b0-378fb1d58be1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:15.779106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14808618-4278-4fc8-a0b0-378fb1d58be1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:15.796696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 382/772] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:15.798760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110f005-0414-44b5-991b-b26c19daa8c2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:15.901815 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110f005-0414-44b5-991b-b26c19daa8c2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:15.910615 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d602dd-584c-4c73-b86a-1f8ea872f49b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:15.910929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d602dd-584c-4c73-b86a-1f8ea872f49b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:15.911165 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d602dd-584c-4c73-b86a-1f8ea872f49b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:15.912706 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 383/773] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:15.920266 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286402a-755f-4695-9275-8893dbdfad80 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:15.922594 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286402a-755f-4695-9275-8893dbdfad80 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:15.922594 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286402a-755f-4695-9275-8893dbdfad80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:15.929230 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:15.948837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d286402a-755f-4695-9275-8893dbdfad80 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:15.950476 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d286402a-755f-4695-9275-8893dbdfad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:15.955059 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a9ef9-98fa-48b0-876c-611b3b0dd775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:15.955909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a9ef9-98fa-48b0-876c-611b3b0dd775 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:15.956760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:15.957073 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a9ef9-98fa-48b0-876c-611b3b0dd775 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:15.957642 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a9ef9-98fa-48b0-876c-611b3b0dd775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:15.958339 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a9ef9-98fa-48b0-876c-611b3b0dd775 None admin] RBAC: Adding query filter params (role.id=b4c209d1895841af9203c4e432176eb9, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=732213990cf84fc198db9c47866fb687) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:15.958753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a9ef9-98fa-48b0-876c-611b3b0dd775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:15.960430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a9ef9-98fa-48b0-876c-611b3b0dd775 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:15.972613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 391/774] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:15 2022] GET /identity/v3/role_assignments?user.id=732213990cf84fc198db9c47866fb687&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=b4c209d1895841af9203c4e432176eb9 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:16.050900 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 384/775] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:16.084634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a9ef9-98fa-48b0-876c-611b3b0dd775 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:16.231354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a9ef9-98fa-48b0-876c-611b3b0dd775 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:16.235352 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fd011-5aab-420b-8308-ae75365422c5 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:16.235640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fd011-5aab-420b-8308-ae75365422c5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:16.235914 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fd011-5aab-420b-8308-ae75365422c5 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:16.238042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 385/776] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:16.242934 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587e44a-2277-4e54-a160-4ca8c8e87d87 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:16.243213 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587e44a-2277-4e54-a160-4ca8c8e87d87 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:16.243488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587e44a-2277-4e54-a160-4ca8c8e87d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:16.265702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a587e44a-2277-4e54-a160-4ca8c8e87d87 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:16.266882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a587e44a-2277-4e54-a160-4ca8c8e87d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:16.287433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f530ac-9604-4004-8aac-c1745f5b6a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:16.287433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f530ac-9604-4004-8aac-c1745f5b6a9e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:16.287433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f530ac-9604-4004-8aac-c1745f5b6a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:16.287433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f530ac-9604-4004-8aac-c1745f5b6a9e None admin] PATH_INFO: `/v3/services/network` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:16.287878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f530ac-9604-4004-8aac-c1745f5b6a9e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:16.287878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f530ac-9604-4004-8aac-c1745f5b6a9e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-73f530ac-9604-4004-8aac-c1745f5b6a9e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:16.300369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:16.301411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:16.302243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:16.302243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:16.302243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:16.302243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:16.302243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:16.302243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:16.302243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:16.302243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:16.302243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:16.302243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:16.302243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:16.302243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:16.302243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 16:13:16.302243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:16.312964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 392/777] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:16 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:16.317951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f530ac-9604-4004-8aac-c1745f5b6a9e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:16.380547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 386/778] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:13:16.402772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587e44a-2277-4e54-a160-4ca8c8e87d87 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:16.423355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:16.477288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:16.507006 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f530ac-9604-4004-8aac-c1745f5b6a9e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:16.510267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587e44a-2277-4e54-a160-4ca8c8e87d87 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:16.543401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef312cd8-8a92-4b1f-8ed6-7f8715a60a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:16.544453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef312cd8-8a92-4b1f-8ed6-7f8715a60a98 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:16.545048 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef312cd8-8a92-4b1f-8ed6-7f8715a60a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:16.545525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef312cd8-8a92-4b1f-8ed6-7f8715a60a98 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:16.546141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31718c-c6d6-467b-99c6-9a7fc1484d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:16.546630 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef312cd8-8a92-4b1f-8ed6-7f8715a60a98 None admin] RBAC: Adding query filter params (name=network) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:16.546814 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31718c-c6d6-467b-99c6-9a7fc1484d22 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:16.547065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31718c-c6d6-467b-99c6-9a7fc1484d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:16.547338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31718c-c6d6-467b-99c6-9a7fc1484d22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:16.547719 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef312cd8-8a92-4b1f-8ed6-7f8715a60a98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:16.549407 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef312cd8-8a92-4b1f-8ed6-7f8715a60a98 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:16.556534 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 393/779] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Aug 11 16:13:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:16.558699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31718c-c6d6-467b-99c6-9a7fc1484d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ab31718c-c6d6-467b-99c6-9a7fc1484d22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:16.564815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:16.567288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:16.568220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:16.568220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:16.568220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:16.568220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:16.568220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:16.568220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:16.568220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:16.568220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:16.568220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:16.568220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:16.568220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:16.568220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:16.568220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 387/780] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:13:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:16.571485 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31718c-c6d6-467b-99c6-9a7fc1484d22 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:16.571709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef312cd8-8a92-4b1f-8ed6-7f8715a60a98 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:16.690443 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef312cd8-8a92-4b1f-8ed6-7f8715a60a98 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:16.699257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:16.733854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5dac5-8818-450a-89af-c91c85836054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:16.734870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5dac5-8818-450a-89af-c91c85836054 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:16.735614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5dac5-8818-450a-89af-c91c85836054 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:16.736061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5dac5-8818-450a-89af-c91c85836054 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:16.736886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5dac5-8818-450a-89af-c91c85836054 None admin] RBAC: Adding query filter params (type=network) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:16.737872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5dac5-8818-450a-89af-c91c85836054 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:16.739372 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5dac5-8818-450a-89af-c91c85836054 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:16.745498 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 394/781] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Aug 11 16:13:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:16.754091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5dac5-8818-450a-89af-c91c85836054 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:16.769827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31718c-c6d6-467b-99c6-9a7fc1484d22 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:16.817894 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:16.831110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f202d3e-05ca-4985-bf3a-82c7767c87a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:16.831710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f202d3e-05ca-4985-bf3a-82c7767c87a6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:16.831986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f202d3e-05ca-4985-bf3a-82c7767c87a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:16.832253 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f202d3e-05ca-4985-bf3a-82c7767c87a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:16.832938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f202d3e-05ca-4985-bf3a-82c7767c87a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:16.833237 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f202d3e-05ca-4985-bf3a-82c7767c87a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:16.834638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f202d3e-05ca-4985-bf3a-82c7767c87a6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:16.843444 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 388/782] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:13:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:16.849640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f202d3e-05ca-4985-bf3a-82c7767c87a6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:16.936061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5dac5-8818-450a-89af-c91c85836054 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:16.973485 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659a577-c3b8-4575-a3e9-d6e95d22548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:16.974087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659a577-c3b8-4575-a3e9-d6e95d22548e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:16.974358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659a577-c3b8-4575-a3e9-d6e95d22548e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:16.974615 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f202d3e-05ca-4985-bf3a-82c7767c87a6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:16.974723 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659a577-c3b8-4575-a3e9-d6e95d22548e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:16.975314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659a577-c3b8-4575-a3e9-d6e95d22548e None admin] RBAC: Adding query filter params (interface=public, service_id=20ae8f7e079641cd8eae2974ab4a4849, region_id=RegionOne) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:16.975619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659a577-c3b8-4575-a3e9-d6e95d22548e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:16.977991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659a577-c3b8-4575-a3e9-d6e95d22548e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:16.984187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 395/783] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Aug 11 16:13:16 2022] GET /identity/v3/endpoints?service_id=20ae8f7e079641cd8eae2974ab4a4849&interface=public®ion_id=RegionOne => generated 194 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:16.989552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dc33d-f944-4fc8-a6c2-24ab30ba8a34 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:16.991124 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dc33d-f944-4fc8-a6c2-24ab30ba8a34 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:16.991402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dc33d-f944-4fc8-a6c2-24ab30ba8a34 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:16.992946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 396/784] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:16.993670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dc33d-f944-4fc8-a6c2-24ab30ba8a34 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:17.019603 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decd500-556d-4d46-af9a-2b2af04c9fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:17.020814 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decd500-556d-4d46-af9a-2b2af04c9fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:17.021299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decd500-556d-4d46-af9a-2b2af04c9fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:17.021794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decd500-556d-4d46-af9a-2b2af04c9fe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:17.033192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:17.035634 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decd500-556d-4d46-af9a-2b2af04c9fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:17.037483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decd500-556d-4d46-af9a-2b2af04c9fe2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-1decd500-556d-4d46-af9a-2b2af04c9fe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:17.055003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:17.056362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:17.058113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:17.058113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:17.058113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:17.064652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 389/785] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:17.066325 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627aa3-6453-4733-8651-de1651a6268b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:17.066860 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627aa3-6453-4733-8651-de1651a6268b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:17.067340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627aa3-6453-4733-8651-de1651a6268b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:17.086724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3e627aa3-6453-4733-8651-de1651a6268b None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:17.088318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3e627aa3-6453-4733-8651-de1651a6268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:17.101042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dc33d-f944-4fc8-a6c2-24ab30ba8a34 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:17.143747 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:17.144088 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a940c7-e92b-44d4-8eff-c460e4664a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:17.145173 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a940c7-e92b-44d4-8eff-c460e4664a7f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:17.145646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a940c7-e92b-44d4-8eff-c460e4664a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:17.146076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a940c7-e92b-44d4-8eff-c460e4664a7f None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:17.147045 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a940c7-e92b-44d4-8eff-c460e4664a7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:17.148657 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a940c7-e92b-44d4-8eff-c460e4664a7f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:17.161010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 397/786] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Aug 11 16:13:16 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:17.162323 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a940c7-e92b-44d4-8eff-c460e4664a7f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:17.180635 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 390/787] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:17.207400 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627aa3-6453-4733-8651-de1651a6268b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:17.333334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627aa3-6453-4733-8651-de1651a6268b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:17.374456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:17.380542 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a940c7-e92b-44d4-8eff-c460e4664a7f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:17.386359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d300b75-5faa-41dd-afc4-a6aa470b8a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:17.387270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d300b75-5faa-41dd-afc4-a6aa470b8a2a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:17.387694 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d300b75-5faa-41dd-afc4-a6aa470b8a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:17.388112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d300b75-5faa-41dd-afc4-a6aa470b8a2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:17.403562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d300b75-5faa-41dd-afc4-a6aa470b8a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-1d300b75-5faa-41dd-afc4-a6aa470b8a2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:17.410532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:17.411622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:17.412624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:17.412624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:17.412624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:17.412624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:17.412624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:17.412624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:17.412624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:17.412624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:17.412624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:17.412624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:17.412624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:17.412624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:17.415176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 391/788] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:13:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:17.420855 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d300b75-5faa-41dd-afc4-a6aa470b8a2a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:17.426516 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80222b54-b0b9-4836-a9d2-76e398ab9026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:17.427103 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80222b54-b0b9-4836-a9d2-76e398ab9026 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:17.427502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80222b54-b0b9-4836-a9d2-76e398ab9026 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:17.427918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80222b54-b0b9-4836-a9d2-76e398ab9026 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:17.428697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80222b54-b0b9-4836-a9d2-76e398ab9026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:17.429177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80222b54-b0b9-4836-a9d2-76e398ab9026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:17.430689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80222b54-b0b9-4836-a9d2-76e398ab9026 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:17.445588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 398/789] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:17.451725 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80222b54-b0b9-4836-a9d2-76e398ab9026 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:17.463019 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:17.558854 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d300b75-5faa-41dd-afc4-a6aa470b8a2a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:17.565438 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80222b54-b0b9-4836-a9d2-76e398ab9026 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:17.602145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcb16e-949f-42b2-9c7b-534a1ad320a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:17.602841 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcb16e-949f-42b2-9c7b-534a1ad320a7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:17.603226 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcb16e-949f-42b2-9c7b-534a1ad320a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:17.603594 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcb16e-949f-42b2-9c7b-534a1ad320a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:17.605960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0739e31-c63d-454e-9395-0b35ac5bd95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:17.607331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0739e31-c63d-454e-9395-0b35ac5bd95e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:17.607775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0739e31-c63d-454e-9395-0b35ac5bd95e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:17.608206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0739e31-c63d-454e-9395-0b35ac5bd95e None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:17.609047 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0739e31-c63d-454e-9395-0b35ac5bd95e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:17.609491 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0739e31-c63d-454e-9395-0b35ac5bd95e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:17.610987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0739e31-c63d-454e-9395-0b35ac5bd95e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:17.612252 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcb16e-949f-42b2-9c7b-534a1ad320a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:17.614166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcb16e-949f-42b2-9c7b-534a1ad320a7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:17.621991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 392/790] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:13:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-dbfcb16e-949f-42b2-9c7b-534a1ad320a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:17.628942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:17.629870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:17.630794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:17.630794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:17.630794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:17.630794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:17.630794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:17.630794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:17.630794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:17.630794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:17.630794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 16:13:17.630794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:17.631313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0739e31-c63d-454e-9395-0b35ac5bd95e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:17.631391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 399/791] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:13:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:17.636792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcb16e-949f-42b2-9c7b-534a1ad320a7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:17.667195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:17.783403 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:17.793724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0739e31-c63d-454e-9395-0b35ac5bd95e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:17.811434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcb16e-949f-42b2-9c7b-534a1ad320a7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:17.853135 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4cfef-421d-4815-b7e2-e169b2b1bb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:17.853689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4cfef-421d-4815-b7e2-e169b2b1bb05 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:17.853962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4cfef-421d-4815-b7e2-e169b2b1bb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:17.854233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4cfef-421d-4815-b7e2-e169b2b1bb05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:17.867293 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4cfef-421d-4815-b7e2-e169b2b1bb05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:17.869006 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4cfef-421d-4815-b7e2-e169b2b1bb05 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:17.880053 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa84fb-d7e6-4f9c-99ba-bc1a03311b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:17.880683 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa84fb-d7e6-4f9c-99ba-bc1a03311b73 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:17.880961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa84fb-d7e6-4f9c-99ba-bc1a03311b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:17.881229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa84fb-d7e6-4f9c-99ba-bc1a03311b73 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:17.881981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa84fb-d7e6-4f9c-99ba-bc1a03311b73 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:17.882280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa84fb-d7e6-4f9c-99ba-bc1a03311b73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:17.883700 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa84fb-d7e6-4f9c-99ba-bc1a03311b73 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-40c4cfef-421d-4815-b7e2-e169b2b1bb05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:17.894319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:17.895273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:17.897313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:17.897313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:17.897313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:17.897313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 393/792] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:17.905172 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4cfef-421d-4815-b7e2-e169b2b1bb05 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:17.924465 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 400/793] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Aug 11 16:13:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:17.929574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa84fb-d7e6-4f9c-99ba-bc1a03311b73 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:18.061934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:18.093169 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4cfef-421d-4815-b7e2-e169b2b1bb05 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:18.105828 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa84fb-d7e6-4f9c-99ba-bc1a03311b73 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:18.147642 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4915ac-f49d-4cbe-b44c-c95b00560457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:18.148463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4915ac-f49d-4cbe-b44c-c95b00560457 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:18.148778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4915ac-f49d-4cbe-b44c-c95b00560457 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:18.149050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4915ac-f49d-4cbe-b44c-c95b00560457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:18.152494 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15aa9b-c741-4b85-8249-5eb86cd9a024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:18.153132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15aa9b-c741-4b85-8249-5eb86cd9a024 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:18.153409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15aa9b-c741-4b85-8249-5eb86cd9a024 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:18.153677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15aa9b-c741-4b85-8249-5eb86cd9a024 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:18.154379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15aa9b-c741-4b85-8249-5eb86cd9a024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:18.154686 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15aa9b-c741-4b85-8249-5eb86cd9a024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:18.156067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15aa9b-c741-4b85-8249-5eb86cd9a024 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:18.160110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4915ac-f49d-4cbe-b44c-c95b00560457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:18.161713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4915ac-f49d-4cbe-b44c-c95b00560457 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:18.172471 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 394/794] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:18.178722 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17d3bb-bc48-4b34-afb2-223562aa6475 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-7f4915ac-f49d-4cbe-b44c-c95b00560457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:18.178855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:18.179902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:18.180989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:18.180989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:18.180989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:18.181160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17d3bb-bc48-4b34-afb2-223562aa6475 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:18.181160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17d3bb-bc48-4b34-afb2-223562aa6475 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:18.181160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 395/795] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:18.181740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17d3bb-bc48-4b34-afb2-223562aa6475 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:18.186388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 401/796] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:18.187770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba54a39-5dff-45e2-86ec-ad3597d465a6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:18.188154 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba54a39-5dff-45e2-86ec-ad3597d465a6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:18.188525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba54a39-5dff-45e2-86ec-ad3597d465a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:18.197735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:18.207724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-dba54a39-5dff-45e2-86ec-ad3597d465a6 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:18.208954 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dba54a39-5dff-45e2-86ec-ad3597d465a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:18.284885 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 402/797] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:18.285862 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba54a39-5dff-45e2-86ec-ad3597d465a6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:18.318753 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17d3bb-bc48-4b34-afb2-223562aa6475 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:18.361377 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:18.369384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8471f8f-d0ae-4515-baec-d6c798809062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:18.370548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8471f8f-d0ae-4515-baec-d6c798809062 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:18.371045 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8471f8f-d0ae-4515-baec-d6c798809062 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:18.372093 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8471f8f-d0ae-4515-baec-d6c798809062 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:18.381664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8471f8f-d0ae-4515-baec-d6c798809062 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:18.383099 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8471f8f-d0ae-4515-baec-d6c798809062 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-c8471f8f-d0ae-4515-baec-d6c798809062 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:18.399666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:18.400640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:18.401597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:18.401597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:18.401597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:18.401597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:18.401597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:18.401597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:18.401597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:18.401597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:18.401597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:13:18.401597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:18.410062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 396/798] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Aug 11 16:13:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:18.411179 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba54a39-5dff-45e2-86ec-ad3597d465a6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:18.411385 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8471f8f-d0ae-4515-baec-d6c798809062 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:18.448490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370eac4-bd8a-4a97-b40e-25457d9f53a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:18.449121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370eac4-bd8a-4a97-b40e-25457d9f53a7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:18.449396 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370eac4-bd8a-4a97-b40e-25457d9f53a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:18.449664 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370eac4-bd8a-4a97-b40e-25457d9f53a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:18.450717 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370eac4-bd8a-4a97-b40e-25457d9f53a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:18.450717 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370eac4-bd8a-4a97-b40e-25457d9f53a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:18.451988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370eac4-bd8a-4a97-b40e-25457d9f53a7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:18.464174 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 403/799] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:18.465176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370eac4-bd8a-4a97-b40e-25457d9f53a7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:18.495826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:18.532976 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8471f8f-d0ae-4515-baec-d6c798809062 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:18.572405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370eac4-bd8a-4a97-b40e-25457d9f53a7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:18.572625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6a532-4a73-4890-81a2-3958a60d38e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:18.573061 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6a532-4a73-4890-81a2-3958a60d38e6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:18.573337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6a532-4a73-4890-81a2-3958a60d38e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:18.573604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6a532-4a73-4890-81a2-3958a60d38e6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:18.574297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6a532-4a73-4890-81a2-3958a60d38e6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:18.575776 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6a532-4a73-4890-81a2-3958a60d38e6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-88f6a532-4a73-4890-81a2-3958a60d38e6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:18.585354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:18.586349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:18.587196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:18.587196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:18.587196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:18.587196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:18.587196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:18.587196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:18.587196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:18.587196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:18.587196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:18.587196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:18.587196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:18.587196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:18.587196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 16:13:18.587196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:18.587196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 397/800] 10.222.0.40 () {56 vars in 1129 bytes} [Thu Aug 11 16:13:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:18.587986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6a532-4a73-4890-81a2-3958a60d38e6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:18.594794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:18.621324 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859300c-96be-4a06-9bfc-4b4a2b5358d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:18.621939 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859300c-96be-4a06-9bfc-4b4a2b5358d1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:18.622220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859300c-96be-4a06-9bfc-4b4a2b5358d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:18.622490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859300c-96be-4a06-9bfc-4b4a2b5358d1 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:18.623231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859300c-96be-4a06-9bfc-4b4a2b5358d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:18.623539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859300c-96be-4a06-9bfc-4b4a2b5358d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:18.624997 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859300c-96be-4a06-9bfc-4b4a2b5358d1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:18.646031 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 404/801] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Aug 11 16:13:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:18.647317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7a7dc-9d85-49a1-8baf-1e12ebd507b7 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:18.647603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7a7dc-9d85-49a1-8baf-1e12ebd507b7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:18.647869 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7a7dc-9d85-49a1-8baf-1e12ebd507b7 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:18.649248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 405/802] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:18.654058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7a7dc-9d85-49a1-8baf-1e12ebd507b7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:18.709109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6a532-4a73-4890-81a2-3958a60d38e6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:18.742315 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:18.749585 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52311777-6002-480f-808e-7fba30b1cd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:18.750201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52311777-6002-480f-808e-7fba30b1cd20 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:18.750477 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52311777-6002-480f-808e-7fba30b1cd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:18.750746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52311777-6002-480f-808e-7fba30b1cd20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:18.758174 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52311777-6002-480f-808e-7fba30b1cd20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:18.759106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7a7dc-9d85-49a1-8baf-1e12ebd507b7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:18.759639 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52311777-6002-480f-808e-7fba30b1cd20 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:18.771713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-52311777-6002-480f-808e-7fba30b1cd20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:18.771713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:18.771713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:18.771713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:18.771713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:18.771713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:18.771713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:18.771713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:18.771713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:18.771713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:18.771713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:18.771713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:18.771713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:18.771713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:18.771713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:18.772641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:18.773515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:18.773515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:18.773515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:18.773515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:18.773515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:18.773515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:18.773515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:18.773515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:18.773515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 398/803] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:18.773990 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52311777-6002-480f-808e-7fba30b1cd20 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:18.798200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fe01f-af8b-43fb-aa64-8630dfbc6ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:18.798814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fe01f-af8b-43fb-aa64-8630dfbc6ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:18.799081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fe01f-af8b-43fb-aa64-8630dfbc6ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:18.799360 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fe01f-af8b-43fb-aa64-8630dfbc6ec7 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:18.800624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fe01f-af8b-43fb-aa64-8630dfbc6ec7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:18.800818 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fe01f-af8b-43fb-aa64-8630dfbc6ec7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:18.802170 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fe01f-af8b-43fb-aa64-8630dfbc6ec7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:18.807278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 406/804] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Aug 11 16:13:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:18.808459 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65588c1-0ee9-4ce6-8356-8d00e96a37f4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:18.808775 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65588c1-0ee9-4ce6-8356-8d00e96a37f4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:18.809048 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65588c1-0ee9-4ce6-8356-8d00e96a37f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:18.826710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f65588c1-0ee9-4ce6-8356-8d00e96a37f4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:18.827888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f65588c1-0ee9-4ce6-8356-8d00e96a37f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:18.865083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:18.884032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52311777-6002-480f-808e-7fba30b1cd20 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:18.904705 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 407/805] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:18.904705 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65588c1-0ee9-4ce6-8356-8d00e96a37f4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:18.923884 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b19999-fc64-4544-adc5-bf786ccd2b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:18.925308 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b19999-fc64-4544-adc5-bf786ccd2b99 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:18.925808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b19999-fc64-4544-adc5-bf786ccd2b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:18.926233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b19999-fc64-4544-adc5-bf786ccd2b99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:18.988861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:18.999379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b19999-fc64-4544-adc5-bf786ccd2b99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:19.000844 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b19999-fc64-4544-adc5-bf786ccd2b99 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:19.021168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65588c1-0ee9-4ce6-8356-8d00e96a37f4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:19.058629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e25706-4cf5-4f3a-9331-c9f82164bf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:19.059228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e25706-4cf5-4f3a-9331-c9f82164bf7f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:19.059502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e25706-4cf5-4f3a-9331-c9f82164bf7f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:19.059769 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e25706-4cf5-4f3a-9331-c9f82164bf7f None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:19.060456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e25706-4cf5-4f3a-9331-c9f82164bf7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:19.060780 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e25706-4cf5-4f3a-9331-c9f82164bf7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:19.062351 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e25706-4cf5-4f3a-9331-c9f82164bf7f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:19.079857 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 408/806] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:19.081111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e25706-4cf5-4f3a-9331-c9f82164bf7f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:19.107281 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 399/807] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 16:13:19.108126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b19999-fc64-4544-adc5-bf786ccd2b99 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:19.117737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:19.192043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e25706-4cf5-4f3a-9331-c9f82164bf7f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:19.210041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:19.219480 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b19999-fc64-4544-adc5-bf786ccd2b99 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:19.227679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40c9eb-67e1-440c-b06f-08640e81df00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:19.228290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40c9eb-67e1-440c-b06f-08640e81df00 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:19.228571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40c9eb-67e1-440c-b06f-08640e81df00 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:19.228869 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40c9eb-67e1-440c-b06f-08640e81df00 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:19.229499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40c9eb-67e1-440c-b06f-08640e81df00 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:19.229799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40c9eb-67e1-440c-b06f-08640e81df00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:19.231158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40c9eb-67e1-440c-b06f-08640e81df00 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:19.236095 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 409/808] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Aug 11 16:13:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:19.236793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40c9eb-67e1-440c-b06f-08640e81df00 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:19.266029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0322df1-251a-4959-9d1d-697793ad3e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:19.267052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322df1-251a-4959-9d1d-697793ad3e63 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:19.267604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322df1-251a-4959-9d1d-697793ad3e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:19.268043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322df1-251a-4959-9d1d-697793ad3e63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:19.279888 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0322df1-251a-4959-9d1d-697793ad3e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b0322df1-251a-4959-9d1d-697793ad3e63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:19.285631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:19.286726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:19.287735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:19.287735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:19.287735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:19.287735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:19.287735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:19.287735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:19.287735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:19.287735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:19.287735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:19.287735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:19.287735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:13:19.287735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:19.294779 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 400/809] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:13:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:19.295790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0322df1-251a-4959-9d1d-697793ad3e63 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:19.337974 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:19.346198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40c9eb-67e1-440c-b06f-08640e81df00 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:19.382256 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38238e-10b0-4762-b1fb-11b01bafc39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:19.383132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38238e-10b0-4762-b1fb-11b01bafc39f None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:19.383548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38238e-10b0-4762-b1fb-11b01bafc39f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:19.383987 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38238e-10b0-4762-b1fb-11b01bafc39f None admin] PATH_INFO: `/v3/projects/3b0514f7236d42d1955e895adaf41389/users/2b629970ca1a4d7fa4c4f2365e671a80/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:19.386035 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38238e-10b0-4762-b1fb-11b01bafc39f None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0514f7236d42d1955e895adaf41389, user_id=2b629970ca1a4d7fa4c4f2365e671a80, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:19.387593 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38238e-10b0-4762-b1fb-11b01bafc39f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:19.397612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0322df1-251a-4959-9d1d-697793ad3e63 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:19.401463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 410/810] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:13:19 2022] PUT /identity/v3/projects/3b0514f7236d42d1955e895adaf41389/users/2b629970ca1a4d7fa4c4f2365e671a80/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:13:19.402402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38238e-10b0-4762-b1fb-11b01bafc39f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:19.440741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880ee1-ef1f-4933-a3ad-6bc25f16387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:19.441376 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880ee1-ef1f-4933-a3ad-6bc25f16387d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:19.441658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880ee1-ef1f-4933-a3ad-6bc25f16387d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:19.441929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880ee1-ef1f-4933-a3ad-6bc25f16387d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:19.454055 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15880ee1-ef1f-4933-a3ad-6bc25f16387d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:19.455432 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15880ee1-ef1f-4933-a3ad-6bc25f16387d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-15880ee1-ef1f-4933-a3ad-6bc25f16387d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:19.472734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:19.473745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:19.474638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:19.474638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:19.474638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:19.474638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 401/811] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:19.475323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880ee1-ef1f-4933-a3ad-6bc25f16387d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:19.480508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:19.539661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38238e-10b0-4762-b1fb-11b01bafc39f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:19.579893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755f2ad-c066-4edf-9143-88e40018ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:19.580503 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755f2ad-c066-4edf-9143-88e40018ae31 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:19.580807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755f2ad-c066-4edf-9143-88e40018ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:19.581623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755f2ad-c066-4edf-9143-88e40018ae31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:19.582282 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755f2ad-c066-4edf-9143-88e40018ae31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:19.583759 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755f2ad-c066-4edf-9143-88e40018ae31 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:19.593789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880ee1-ef1f-4933-a3ad-6bc25f16387d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:19.606754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 411/812] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:13:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:13:19.608541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6845433-726e-49a1-ac71-776dadc0be05 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:19.609294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6845433-726e-49a1-ac71-776dadc0be05 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:19.609799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6845433-726e-49a1-ac71-776dadc0be05 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:19.612331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 412/813] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:19.613565 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6845433-726e-49a1-ac71-776dadc0be05 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:19.632672 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:19.641131 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b718794-26b2-456b-9ab7-9dba7ec044ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:19.641744 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b718794-26b2-456b-9ab7-9dba7ec044ff None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:19.642022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b718794-26b2-456b-9ab7-9dba7ec044ff None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:19.642294 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b718794-26b2-456b-9ab7-9dba7ec044ff None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:19.642966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b718794-26b2-456b-9ab7-9dba7ec044ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:19.643267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b718794-26b2-456b-9ab7-9dba7ec044ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:19.646152 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b718794-26b2-456b-9ab7-9dba7ec044ff None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:19.658133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 402/814] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:13:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:19.660144 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9a017-250c-41aa-a1d4-06dd11eb2781 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:19.660427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9a017-250c-41aa-a1d4-06dd11eb2781 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:19.660723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9a017-250c-41aa-a1d4-06dd11eb2781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:19.680613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-70b9a017-250c-41aa-a1d4-06dd11eb2781 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:19.682068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-70b9a017-250c-41aa-a1d4-06dd11eb2781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:19.740297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6845433-726e-49a1-ac71-776dadc0be05 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:19.750676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:19.760464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 403/815] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:19.761393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9a017-250c-41aa-a1d4-06dd11eb2781 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:19.779163 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749c648-346f-4d35-a798-707d974fad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:19.780026 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749c648-346f-4d35-a798-707d974fad47 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:19.780311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749c648-346f-4d35-a798-707d974fad47 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:19.781014 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749c648-346f-4d35-a798-707d974fad47 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:19.781688 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749c648-346f-4d35-a798-707d974fad47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:19.781994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749c648-346f-4d35-a798-707d974fad47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:19.783401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749c648-346f-4d35-a798-707d974fad47 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:19.801055 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 413/816] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:19.804762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749c648-346f-4d35-a798-707d974fad47 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:19.885577 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9a017-250c-41aa-a1d4-06dd11eb2781 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:19.896995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:19.921999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505ffb7-8cd7-48d7-9a6c-fd170e7465d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:19.922627 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505ffb7-8cd7-48d7-9a6c-fd170e7465d8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:19.922906 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505ffb7-8cd7-48d7-9a6c-fd170e7465d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:19.923173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505ffb7-8cd7-48d7-9a6c-fd170e7465d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:19.934431 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749c648-346f-4d35-a798-707d974fad47 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:19.938215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505ffb7-8cd7-48d7-9a6c-fd170e7465d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:19.939661 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505ffb7-8cd7-48d7-9a6c-fd170e7465d8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-9505ffb7-8cd7-48d7-9a6c-fd170e7465d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:19.956397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:19.957405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:19.958261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:19.958261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:19.958261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:19.958261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 404/817] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:19.959143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505ffb7-8cd7-48d7-9a6c-fd170e7465d8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:19.976964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92da16-1ecb-4b02-b248-a5810139f10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:19.977618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92da16-1ecb-4b02-b248-a5810139f10c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:19.977899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92da16-1ecb-4b02-b248-a5810139f10c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:19.978173 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92da16-1ecb-4b02-b248-a5810139f10c None admin] PATH_INFO: `/v3/services/network` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:19.978761 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92da16-1ecb-4b02-b248-a5810139f10c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:19.980131 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92da16-1ecb-4b02-b248-a5810139f10c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-ee92da16-1ecb-4b02-b248-a5810139f10c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:19.990008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:19.991025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:19.991881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:19.991881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:19.991881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:19.991881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:19.991881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:19.991881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:19.991881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:19.991881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:19.991881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:19.991881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:19.991881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:19.991881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:19.991881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 16:13:19.991881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:19.991881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 414/818] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:19 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:19.992903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92da16-1ecb-4b02-b248-a5810139f10c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:20.009146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:20.068569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505ffb7-8cd7-48d7-9a6c-fd170e7465d8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:20.104903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e53cc-f814-405a-ad4f-f7e7d423ef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:20.105527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e53cc-f814-405a-ad4f-f7e7d423ef39 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:20.105802 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e53cc-f814-405a-ad4f-f7e7d423ef39 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:20.106072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e53cc-f814-405a-ad4f-f7e7d423ef39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:20.106413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92da16-1ecb-4b02-b248-a5810139f10c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:20.114206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e53cc-f814-405a-ad4f-f7e7d423ef39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:20.115852 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e53cc-f814-405a-ad4f-f7e7d423ef39 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:20.128353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-359e53cc-f814-405a-ad4f-f7e7d423ef39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:20.128353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:20.128353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:20.128353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:20.128353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:20.128353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:20.128353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:20.128353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:20.128353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:20.128353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:20.128353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:20.128353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:20.128353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:20.128353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:20.128353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:20.129559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:20.130632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:20.130632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:20.130632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:20.130632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:20.130632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:20.130632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:20.130632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:20.130632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:20.132406 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 405/819] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:20.133892 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e53cc-f814-405a-ad4f-f7e7d423ef39 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:20.148219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51774706-cee1-442a-b780-771b5be87455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:20.149099 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51774706-cee1-442a-b780-771b5be87455 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:20.149554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51774706-cee1-442a-b780-771b5be87455 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:20.149961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51774706-cee1-442a-b780-771b5be87455 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:20.150936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51774706-cee1-442a-b780-771b5be87455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:20.151484 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51774706-cee1-442a-b780-771b5be87455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:20.153081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51774706-cee1-442a-b780-771b5be87455 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:20.154995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:20.168925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 415/820] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:20.170061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51774706-cee1-442a-b780-771b5be87455 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:20.247301 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e53cc-f814-405a-ad4f-f7e7d423ef39 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:20.249787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:20.280001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51774706-cee1-442a-b780-771b5be87455 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:20.285342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad821c1f-371c-4c6e-baab-254db46378b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:20.286051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad821c1f-371c-4c6e-baab-254db46378b3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:20.286425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad821c1f-371c-4c6e-baab-254db46378b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:20.286794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad821c1f-371c-4c6e-baab-254db46378b3 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:20.287610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad821c1f-371c-4c6e-baab-254db46378b3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:20.288003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad821c1f-371c-4c6e-baab-254db46378b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:20.289481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad821c1f-371c-4c6e-baab-254db46378b3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:20.300442 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 406/821] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Aug 11 16:13:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:20.300442 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad821c1f-371c-4c6e-baab-254db46378b3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:20.325317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bface37f-8300-4571-8ffa-acb387bcf01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:20.326202 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bface37f-8300-4571-8ffa-acb387bcf01c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:20.326717 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bface37f-8300-4571-8ffa-acb387bcf01c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:20.327197 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bface37f-8300-4571-8ffa-acb387bcf01c None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:20.328198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bface37f-8300-4571-8ffa-acb387bcf01c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:20.328661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bface37f-8300-4571-8ffa-acb387bcf01c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:20.330300 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bface37f-8300-4571-8ffa-acb387bcf01c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:20.343386 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 416/822] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:20.344556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bface37f-8300-4571-8ffa-acb387bcf01c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:20.403809 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:20.412035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad821c1f-371c-4c6e-baab-254db46378b3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:20.449548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8b1ff-87fa-481d-9c4a-f3ea419fc2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:20.450453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8b1ff-87fa-481d-9c4a-f3ea419fc2dc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:20.450851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8b1ff-87fa-481d-9c4a-f3ea419fc2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:20.451287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8b1ff-87fa-481d-9c4a-f3ea419fc2dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:20.454442 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bface37f-8300-4571-8ffa-acb387bcf01c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:20.459578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8b1ff-87fa-481d-9c4a-f3ea419fc2dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:20.461229 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8b1ff-87fa-481d-9c4a-f3ea419fc2dc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-84e8b1ff-87fa-481d-9c4a-f3ea419fc2dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:20.473994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:20.475195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:20.476347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:20.476347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:20.476347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:20.476347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:20.476347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:20.476347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:20.476347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:20.476347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:20.476347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 16:13:20.476347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:20.478202 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 407/823] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Aug 11 16:13:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:20.479331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8b1ff-87fa-481d-9c4a-f3ea419fc2dc None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:20.494535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133d9d3-e9f8-47a5-91e4-c67eab1a64cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:20.495404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133d9d3-e9f8-47a5-91e4-c67eab1a64cf None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:20.495869 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133d9d3-e9f8-47a5-91e4-c67eab1a64cf None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:20.496277 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133d9d3-e9f8-47a5-91e4-c67eab1a64cf None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:20.497163 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133d9d3-e9f8-47a5-91e4-c67eab1a64cf None admin] RBAC: Adding query filter params (type=network) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:20.497719 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133d9d3-e9f8-47a5-91e4-c67eab1a64cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:20.499493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133d9d3-e9f8-47a5-91e4-c67eab1a64cf None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:20.510479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 417/824] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Aug 11 16:13:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:20.511166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:20.512485 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133d9d3-e9f8-47a5-91e4-c67eab1a64cf None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:20.590166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8b1ff-87fa-481d-9c4a-f3ea419fc2dc None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:20.622920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133d9d3-e9f8-47a5-91e4-c67eab1a64cf None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:20.629537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd18b0-1e90-44d7-86e8-ff4b7b62696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:20.630282 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd18b0-1e90-44d7-86e8-ff4b7b62696f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:20.630645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd18b0-1e90-44d7-86e8-ff4b7b62696f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:20.630983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd18b0-1e90-44d7-86e8-ff4b7b62696f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:20.631816 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd18b0-1e90-44d7-86e8-ff4b7b62696f None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=4e91f3fbe098459dba0acf8ec1fb7098) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:20.632189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd18b0-1e90-44d7-86e8-ff4b7b62696f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:20.634213 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd18b0-1e90-44d7-86e8-ff4b7b62696f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:20.640879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 408/825] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:20 2022] GET /identity/v3/role_assignments?user.id=4e91f3fbe098459dba0acf8ec1fb7098&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:20.641969 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd18b0-1e90-44d7-86e8-ff4b7b62696f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:20.646052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:20.666175 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24458f4-6384-4610-8454-6c85224d0b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:20.667013 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24458f4-6384-4610-8454-6c85224d0b8d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:20.667380 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24458f4-6384-4610-8454-6c85224d0b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:20.667756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24458f4-6384-4610-8454-6c85224d0b8d None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:20.668925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24458f4-6384-4610-8454-6c85224d0b8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:20.669327 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24458f4-6384-4610-8454-6c85224d0b8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:20.671135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24458f4-6384-4610-8454-6c85224d0b8d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:20.695011 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 418/826] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Aug 11 16:13:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:20.697848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24458f4-6384-4610-8454-6c85224d0b8d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:20.825822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:20.847667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd18b0-1e90-44d7-86e8-ff4b7b62696f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:20.891615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24458f4-6384-4610-8454-6c85224d0b8d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:20.898675 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c544ec6-327c-44b3-9e98-a8582c2355e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:20.899284 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c544ec6-327c-44b3-9e98-a8582c2355e5 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:20.899558 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c544ec6-327c-44b3-9e98-a8582c2355e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:20.899821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c544ec6-327c-44b3-9e98-a8582c2355e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:20.900473 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c544ec6-327c-44b3-9e98-a8582c2355e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:20.901851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c544ec6-327c-44b3-9e98-a8582c2355e5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:20.927176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 409/827] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:13:20 2022] POST /identity/v3/endpoints => generated 337 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:13:20.944469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5351f5f-9387-4871-8b24-b76a82743fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:20.945611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5351f5f-9387-4871-8b24-b76a82743fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:20.946094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5351f5f-9387-4871-8b24-b76a82743fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:20.946587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5351f5f-9387-4871-8b24-b76a82743fa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:20.960086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5351f5f-9387-4871-8b24-b76a82743fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:20.961955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5351f5f-9387-4871-8b24-b76a82743fa2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-d5351f5f-9387-4871-8b24-b76a82743fa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:20.979845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:20.980875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:20.981785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:20.981785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:20.981785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:20.984178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 419/828] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:20.990614 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c544ec6-327c-44b3-9e98-a8582c2355e5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:21.107502 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c544ec6-327c-44b3-9e98-a8582c2355e5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:21.145242 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f6e8b-4de2-4ad4-bcae-b1f435c5043a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:21.146613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f6e8b-4de2-4ad4-bcae-b1f435c5043a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:21.147129 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f6e8b-4de2-4ad4-bcae-b1f435c5043a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:21.147616 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f6e8b-4de2-4ad4-bcae-b1f435c5043a None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:21.148457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f6e8b-4de2-4ad4-bcae-b1f435c5043a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:21.148984 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f6e8b-4de2-4ad4-bcae-b1f435c5043a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:21.150543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f6e8b-4de2-4ad4-bcae-b1f435c5043a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:21.163940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 410/829] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:21.170255 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5351f5f-9387-4871-8b24-b76a82743fa2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:21.205819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:21.285962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5351f5f-9387-4871-8b24-b76a82743fa2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:21.325856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d763708-7120-426c-8ccf-ffc3a4e2527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:21.326853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d763708-7120-426c-8ccf-ffc3a4e2527b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:21.327334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d763708-7120-426c-8ccf-ffc3a4e2527b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:21.327895 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d763708-7120-426c-8ccf-ffc3a4e2527b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:21.336483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d763708-7120-426c-8ccf-ffc3a4e2527b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:21.338237 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d763708-7120-426c-8ccf-ffc3a4e2527b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:21.350622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-1d763708-7120-426c-8ccf-ffc3a4e2527b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:21.350622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:21.350622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:21.350622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:21.350622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:21.350622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:21.350622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:21.350622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:21.350622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:21.350622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:21.350622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:21.350622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:21.350622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:21.350622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:21.350622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:21.351529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:21.352392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:21.352392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:21.352392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:21.352392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:21.352392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:21.352392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:21.352392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:21.352392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:21.354853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 420/830] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:21.360398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f6e8b-4de2-4ad4-bcae-b1f435c5043a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:21.372935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:21.478159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f6e8b-4de2-4ad4-bcae-b1f435c5043a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:21.519860 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d70d78-b7f8-4b37-9a87-627b600f63bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:21.520476 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d70d78-b7f8-4b37-9a87-627b600f63bc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:21.520962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d70d78-b7f8-4b37-9a87-627b600f63bc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:21.521067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d70d78-b7f8-4b37-9a87-627b600f63bc None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:21.521740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d70d78-b7f8-4b37-9a87-627b600f63bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:21.522047 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d70d78-b7f8-4b37-9a87-627b600f63bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:21.523473 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d70d78-b7f8-4b37-9a87-627b600f63bc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:21.542971 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 411/831] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:21.549665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d763708-7120-426c-8ccf-ffc3a4e2527b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:21.588337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10432e-c07f-44c2-9188-470c3bad0d1b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:21.588652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10432e-c07f-44c2-9188-470c3bad0d1b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:21.588930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10432e-c07f-44c2-9188-470c3bad0d1b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:21.590396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 412/832] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:21.595150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9613a-fc39-4e9e-bc2d-53f63e22791b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:21.595438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9613a-fc39-4e9e-bc2d-53f63e22791b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:21.595717 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9613a-fc39-4e9e-bc2d-53f63e22791b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:21.614894 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e8c9613a-fc39-4e9e-bc2d-53f63e22791b None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:21.615996 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e8c9613a-fc39-4e9e-bc2d-53f63e22791b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:21.646407 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:21.663771 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d763708-7120-426c-8ccf-ffc3a4e2527b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:21.699509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:21.701669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70705d-c5f7-4ccb-8714-a99bc0e21c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:21.702715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70705d-c5f7-4ccb-8714-a99bc0e21c50 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:21.703496 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70705d-c5f7-4ccb-8714-a99bc0e21c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:21.703974 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70705d-c5f7-4ccb-8714-a99bc0e21c50 None admin] PATH_INFO: `/v3/projects/3b0514f7236d42d1955e895adaf41389/users/732213990cf84fc198db9c47866fb687/roles/b4c209d1895841af9203c4e432176eb9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:21.712608 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 413/833] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:21.723458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70705d-c5f7-4ccb-8714-a99bc0e21c50 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0514f7236d42d1955e895adaf41389, user_id=732213990cf84fc198db9c47866fb687, role_id=b4c209d1895841af9203c4e432176eb9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:21.725027 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70705d-c5f7-4ccb-8714-a99bc0e21c50 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:21.730719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9613a-fc39-4e9e-bc2d-53f63e22791b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:21.745472 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 421/834] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:13:21 2022] PUT /identity/v3/projects/3b0514f7236d42d1955e895adaf41389/users/732213990cf84fc198db9c47866fb687/roles/b4c209d1895841af9203c4e432176eb9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:13:21.868030 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9613a-fc39-4e9e-bc2d-53f63e22791b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:21.884349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ef29a-e4d2-4c8d-8077-1e59bf3a65b1 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:21.884711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ef29a-e4d2-4c8d-8077-1e59bf3a65b1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:21.885123 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ef29a-e4d2-4c8d-8077-1e59bf3a65b1 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:21.886958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 422/835] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:21.892460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc56f4-e7bc-4728-83c4-8a22b9942cb1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:21.893131 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc56f4-e7bc-4728-83c4-8a22b9942cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:21.893543 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc56f4-e7bc-4728-83c4-8a22b9942cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:21.915452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3775d19-fcc4-4ec4-8a2d-15e64f8af974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:21.916348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3775d19-fcc4-4ec4-8a2d-15e64f8af974 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:21.916806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3fcc56f4-e7bc-4728-83c4-8a22b9942cb1 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:21.917063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3775d19-fcc4-4ec4-8a2d-15e64f8af974 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:21.917477 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3775d19-fcc4-4ec4-8a2d-15e64f8af974 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:21.918261 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3fcc56f4-e7bc-4728-83c4-8a22b9942cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:21.931041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3775d19-fcc4-4ec4-8a2d-15e64f8af974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f3775d19-fcc4-4ec4-8a2d-15e64f8af974 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:21.936771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:21.937729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:21.938546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:21.938546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:21.938546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:21.938546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:21.938546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:21.938546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:21.938546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:21.938546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:21.938546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:21.938546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:21.938546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:21.938546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:21.942531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 414/836] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:13:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:21.943731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3775d19-fcc4-4ec4-8a2d-15e64f8af974 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:22.008948 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:22.012033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 423/837] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:22.033853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc56f4-e7bc-4728-83c4-8a22b9942cb1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:22.071630 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3775d19-fcc4-4ec4-8a2d-15e64f8af974 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:22.110591 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:22.123569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bceeba-caf2-4662-afbc-c772c7769130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:22.124531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bceeba-caf2-4662-afbc-c772c7769130 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:22.125377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bceeba-caf2-4662-afbc-c772c7769130 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:22.125888 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bceeba-caf2-4662-afbc-c772c7769130 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:22.127371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bceeba-caf2-4662-afbc-c772c7769130 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:22.127919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bceeba-caf2-4662-afbc-c772c7769130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:22.130109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bceeba-caf2-4662-afbc-c772c7769130 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:22.142070 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 415/838] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:13:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:22.147196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bceeba-caf2-4662-afbc-c772c7769130 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:22.155993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc56f4-e7bc-4728-83c4-8a22b9942cb1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:22.200379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77375ef9-fe55-4ec7-a947-3126f6ad8cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:22.201900 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77375ef9-fe55-4ec7-a947-3126f6ad8cee None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:22.202354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77375ef9-fe55-4ec7-a947-3126f6ad8cee None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:22.202793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77375ef9-fe55-4ec7-a947-3126f6ad8cee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:22.204025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77375ef9-fe55-4ec7-a947-3126f6ad8cee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:22.206625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77375ef9-fe55-4ec7-a947-3126f6ad8cee None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-77375ef9-fe55-4ec7-a947-3126f6ad8cee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:22.218137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:22.219127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:22.219947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:22.219947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:22.219947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:22.219947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:22.219947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:22.219947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:22.219947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:22.219947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:22.219947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:22.219947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:22.219947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:22.219947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:22.219947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 16:13:22.219947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:22.227311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 424/839] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:13:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:22.229028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77375ef9-fe55-4ec7-a947-3126f6ad8cee None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:22.285967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bceeba-caf2-4662-afbc-c772c7769130 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:22.313676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:22.336197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a8282-ab73-4922-8452-1fdb879f0598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:22.337916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a8282-ab73-4922-8452-1fdb879f0598 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:22.338424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a8282-ab73-4922-8452-1fdb879f0598 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:22.338913 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a8282-ab73-4922-8452-1fdb879f0598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:22.363877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a8282-ab73-4922-8452-1fdb879f0598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:22.366191 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a8282-ab73-4922-8452-1fdb879f0598 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:22.375912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77375ef9-fe55-4ec7-a947-3126f6ad8cee None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-5c4a8282-ab73-4922-8452-1fdb879f0598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:22.384012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:22.385071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:22.386022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:22.386022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:22.386022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:22.386022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 416/840] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:22.390866 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a8282-ab73-4922-8452-1fdb879f0598 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:22.415225 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:22.427753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52804932-dd0f-4c4b-966b-cd175e9da692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:22.428681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52804932-dd0f-4c4b-966b-cd175e9da692 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:22.429157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52804932-dd0f-4c4b-966b-cd175e9da692 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:22.429747 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52804932-dd0f-4c4b-966b-cd175e9da692 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:22.431355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52804932-dd0f-4c4b-966b-cd175e9da692 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:22.431838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52804932-dd0f-4c4b-966b-cd175e9da692 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:22.433401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52804932-dd0f-4c4b-966b-cd175e9da692 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:22.439527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 425/841] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:13:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:22.444703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52804932-dd0f-4c4b-966b-cd175e9da692 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:22.513170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a8282-ab73-4922-8452-1fdb879f0598 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:22.549761 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40d616-6d3d-4c5f-9b5d-28a59ed01db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:22.550666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d616-6d3d-4c5f-9b5d-28a59ed01db0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:22.551130 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d616-6d3d-4c5f-9b5d-28a59ed01db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:22.551573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d616-6d3d-4c5f-9b5d-28a59ed01db0 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:22.552390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40d616-6d3d-4c5f-9b5d-28a59ed01db0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:22.552892 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40d616-6d3d-4c5f-9b5d-28a59ed01db0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:22.554408 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40d616-6d3d-4c5f-9b5d-28a59ed01db0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:22.563344 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52804932-dd0f-4c4b-966b-cd175e9da692 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:22.567227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 417/842] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:22.573614 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40d616-6d3d-4c5f-9b5d-28a59ed01db0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:22.608851 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd74976-b940-4cc3-99d8-0602011f20ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:22.609711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd74976-b940-4cc3-99d8-0602011f20ea None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:22.609990 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd74976-b940-4cc3-99d8-0602011f20ea None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:22.610261 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd74976-b940-4cc3-99d8-0602011f20ea None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:22.611287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd74976-b940-4cc3-99d8-0602011f20ea None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:22.611608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd74976-b940-4cc3-99d8-0602011f20ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:22.613858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd74976-b940-4cc3-99d8-0602011f20ea None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:22.615978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:22.628716 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 426/843] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:13:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:22.701294 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40d616-6d3d-4c5f-9b5d-28a59ed01db0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:22.740493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f83e4-9e60-4e51-88e8-ac46b60d1309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:22.741260 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f83e4-9e60-4e51-88e8-ac46b60d1309 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:22.741539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f83e4-9e60-4e51-88e8-ac46b60d1309 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:22.741808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f83e4-9e60-4e51-88e8-ac46b60d1309 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:22.750272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f83e4-9e60-4e51-88e8-ac46b60d1309 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:22.751735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f83e4-9e60-4e51-88e8-ac46b60d1309 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-9a6f83e4-9e60-4e51-88e8-ac46b60d1309 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:22.765337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:22.766343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:22.767664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:22.767664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:22.767664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:22.767664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:22.767664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:22.767664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:22.767664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:22.767664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:22.767664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 16:13:22.767664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:22.767664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 418/844] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:13:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:22.774530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd74976-b940-4cc3-99d8-0602011f20ea None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:22.841420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:22.891012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd74976-b940-4cc3-99d8-0602011f20ea None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:22.927314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211718a-6218-4121-8bb7-ae4289e050f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:22.927923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211718a-6218-4121-8bb7-ae4289e050f2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:22.928201 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211718a-6218-4121-8bb7-ae4289e050f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:22.928474 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211718a-6218-4121-8bb7-ae4289e050f2 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:22.929243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211718a-6218-4121-8bb7-ae4289e050f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:22.929549 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211718a-6218-4121-8bb7-ae4289e050f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:22.930984 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211718a-6218-4121-8bb7-ae4289e050f2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:22.949223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 427/845] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Aug 11 16:13:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:22.957674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f83e4-9e60-4e51-88e8-ac46b60d1309 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:23.067118 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd91da-1b90-4114-b863-a83534ee41b6 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:23.067448 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd91da-1b90-4114-b863-a83534ee41b6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:23.067665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd91da-1b90-4114-b863-a83534ee41b6 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:23.069265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 428/846] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:23.074166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77debbd1-089d-4657-8413-7cdf2dfe4bbc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:23.074492 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77debbd1-089d-4657-8413-7cdf2dfe4bbc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:23.074695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77debbd1-089d-4657-8413-7cdf2dfe4bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:23.075796 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:23.085574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f83e4-9e60-4e51-88e8-ac46b60d1309 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:23.094662 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-77debbd1-089d-4657-8413-7cdf2dfe4bbc None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:23.095936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-77debbd1-089d-4657-8413-7cdf2dfe4bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:23.122298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a8e1c-4709-46cc-9c3c-af7ad0a260e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:23.123232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a8e1c-4709-46cc-9c3c-af7ad0a260e8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:23.123713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a8e1c-4709-46cc-9c3c-af7ad0a260e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:23.124208 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a8e1c-4709-46cc-9c3c-af7ad0a260e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:23.177091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 429/847] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:23.193465 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77debbd1-089d-4657-8413-7cdf2dfe4bbc None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:23.199202 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a8e1c-4709-46cc-9c3c-af7ad0a260e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:23.201269 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a8e1c-4709-46cc-9c3c-af7ad0a260e8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:23.242514 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:23.300853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77debbd1-089d-4657-8413-7cdf2dfe4bbc None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:23.302107 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:23.313021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 419/848] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:22 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 16:13:23.319003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a8e1c-4709-46cc-9c3c-af7ad0a260e8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:23.340105 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fd629-21a4-4ea5-8da0-ccb1cb8ca8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:23.341050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fd629-21a4-4ea5-8da0-ccb1cb8ca8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:23.341549 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fd629-21a4-4ea5-8da0-ccb1cb8ca8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:23.341956 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fd629-21a4-4ea5-8da0-ccb1cb8ca8f2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:23.342676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fd629-21a4-4ea5-8da0-ccb1cb8ca8f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:23.344307 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fd629-21a4-4ea5-8da0-ccb1cb8ca8f2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-158fd629-21a4-4ea5-8da0-ccb1cb8ca8f2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:23.353884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:23.354793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:23.355661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:23.355661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:23.355661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:23.355661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:23.355661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:23.355661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:23.355661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:23.355661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:23.355661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:23.355661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:23.355661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:23.355661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:23.355661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 16:13:23.355661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:23.363796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 430/849] 10.222.0.40 () {56 vars in 1132 bytes} [Thu Aug 11 16:13:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:23.365089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fd629-21a4-4ea5-8da0-ccb1cb8ca8f2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:23.428197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a8e1c-4709-46cc-9c3c-af7ad0a260e8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:23.465686 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f162d-df79-4850-b83e-81da118dcbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:23.466597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f162d-df79-4850-b83e-81da118dcbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:23.466905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f162d-df79-4850-b83e-81da118dcbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:23.467278 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f162d-df79-4850-b83e-81da118dcbe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:23.478381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f162d-df79-4850-b83e-81da118dcbe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:23.479916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f162d-df79-4850-b83e-81da118dcbe2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:23.484109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fd629-21a4-4ea5-8da0-ccb1cb8ca8f2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:23.494362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b35f162d-df79-4850-b83e-81da118dcbe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:23.497193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:23.498091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:23.499040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:23.499040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:23.499040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:23.501218 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 420/850] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:23.506967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f162d-df79-4850-b83e-81da118dcbe2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:23.521754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd330e0-1254-46f1-8f55-4cbbc1fa8b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:23.522359 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd330e0-1254-46f1-8f55-4cbbc1fa8b2a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:23.522888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd330e0-1254-46f1-8f55-4cbbc1fa8b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:23.523165 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd330e0-1254-46f1-8f55-4cbbc1fa8b2a None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:23.523799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd330e0-1254-46f1-8f55-4cbbc1fa8b2a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:23.524102 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd330e0-1254-46f1-8f55-4cbbc1fa8b2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:23.525754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd330e0-1254-46f1-8f55-4cbbc1fa8b2a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:23.535429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 431/851] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Aug 11 16:13:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:23.536576 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd330e0-1254-46f1-8f55-4cbbc1fa8b2a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:23.559465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:23.619935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f162d-df79-4850-b83e-81da118dcbe2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:23.645518 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd330e0-1254-46f1-8f55-4cbbc1fa8b2a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:23.657830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22e547-86cf-4c97-bde0-34c27dc78d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:23.659409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22e547-86cf-4c97-bde0-34c27dc78d6d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:23.659890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22e547-86cf-4c97-bde0-34c27dc78d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:23.660450 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22e547-86cf-4c97-bde0-34c27dc78d6d None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:23.661310 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22e547-86cf-4c97-bde0-34c27dc78d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:23.661806 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22e547-86cf-4c97-bde0-34c27dc78d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:23.663855 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22e547-86cf-4c97-bde0-34c27dc78d6d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:23.678281 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 421/852] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:23.681763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436761a-e14f-4bbb-83a4-1b35c0319a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:23.682620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436761a-e14f-4bbb-83a4-1b35c0319a9d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:23.682908 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436761a-e14f-4bbb-83a4-1b35c0319a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:23.683177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436761a-e14f-4bbb-83a4-1b35c0319a9d None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:23.683816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436761a-e14f-4bbb-83a4-1b35c0319a9d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:23.684115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436761a-e14f-4bbb-83a4-1b35c0319a9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:23.684473 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22e547-86cf-4c97-bde0-34c27dc78d6d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:23.685493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436761a-e14f-4bbb-83a4-1b35c0319a9d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:23.696775 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 432/853] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Aug 11 16:13:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:23.788219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1a231-21fd-4f34-b0fd-7910db1d0796 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:23.788570 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1a231-21fd-4f34-b0fd-7910db1d0796 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:23.788825 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1a231-21fd-4f34-b0fd-7910db1d0796 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:23.790455 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 433/854] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:23.796108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359bc28-a428-4dbc-9b3a-3d457df6c3c4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:23.796397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359bc28-a428-4dbc-9b3a-3d457df6c3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:23.796719 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359bc28-a428-4dbc-9b3a-3d457df6c3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:23.808440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22e547-86cf-4c97-bde0-34c27dc78d6d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:23.812194 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:23.816818 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1359bc28-a428-4dbc-9b3a-3d457df6c3c4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:23.818142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1359bc28-a428-4dbc-9b3a-3d457df6c3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:23.859232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:23.861973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cc803-fb9d-443f-a6a0-96e7dca614db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:23.863549 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cc803-fb9d-443f-a6a0-96e7dca614db None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:23.863834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cc803-fb9d-443f-a6a0-96e7dca614db None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:23.864166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cc803-fb9d-443f-a6a0-96e7dca614db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:23.874246 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cc803-fb9d-443f-a6a0-96e7dca614db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:23.876382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cc803-fb9d-443f-a6a0-96e7dca614db None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:23.891713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a70cc803-fb9d-443f-a6a0-96e7dca614db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:23.891713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:23.891713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:23.891713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:23.891713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:23.891713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:23.891713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:23.891713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:23.891713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:23.891713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:23.891713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:23.891713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:23.891713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:23.891713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:23.891713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:23.892663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:23.893552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:23.893552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:23.893552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:23.893552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:23.893552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:23.893552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:23.893552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:23.893552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:23.893552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 422/855] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:23.900121 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cc803-fb9d-443f-a6a0-96e7dca614db None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:23.915486 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 434/856] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:13:23.948798 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359bc28-a428-4dbc-9b3a-3d457df6c3c4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:24.019131 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cc803-fb9d-443f-a6a0-96e7dca614db None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:24.060922 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4cd75-3170-46e4-b11e-a13b9751b611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:24.061527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4cd75-3170-46e4-b11e-a13b9751b611 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:24.061804 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4cd75-3170-46e4-b11e-a13b9751b611 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:24.062076 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4cd75-3170-46e4-b11e-a13b9751b611 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:24.062764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4cd75-3170-46e4-b11e-a13b9751b611 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:24.063066 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4cd75-3170-46e4-b11e-a13b9751b611 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:24.065051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4cd75-3170-46e4-b11e-a13b9751b611 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:24.076562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359bc28-a428-4dbc-9b3a-3d457df6c3c4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:24.082855 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 423/857] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:24.091110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4cd75-3170-46e4-b11e-a13b9751b611 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:24.118666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c9db0-1ef0-4b61-b7cd-c2196197813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:24.119387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c9db0-1ef0-4b61-b7cd-c2196197813b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:24.119500 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:24.119774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c9db0-1ef0-4b61-b7cd-c2196197813b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:24.120109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c9db0-1ef0-4b61-b7cd-c2196197813b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:24.131700 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c9db0-1ef0-4b61-b7cd-c2196197813b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-823c9db0-1ef0-4b61-b7cd-c2196197813b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:24.136460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:24.137433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:24.138264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:24.138264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:24.138264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:24.138264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:24.138264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:24.138264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:24.138264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:24.138264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:24.138264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:24.138264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:24.138264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:13:24.138264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:24.142733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 435/858] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:13:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:24.144556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c9db0-1ef0-4b61-b7cd-c2196197813b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:24.175175 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:24.201233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4cd75-3170-46e4-b11e-a13b9751b611 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:24.249345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35909be9-6732-4172-bff1-e3d97ffe6525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:24.250732 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35909be9-6732-4172-bff1-e3d97ffe6525 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:24.251163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35909be9-6732-4172-bff1-e3d97ffe6525 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:24.251663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35909be9-6732-4172-bff1-e3d97ffe6525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:24.253140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35909be9-6732-4172-bff1-e3d97ffe6525 None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=2b629970ca1a4d7fa4c4f2365e671a80) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:24.253430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c9db0-1ef0-4b61-b7cd-c2196197813b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:24.254101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35909be9-6732-4172-bff1-e3d97ffe6525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:24.256614 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35909be9-6732-4172-bff1-e3d97ffe6525 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:24.264133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 424/859] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:24 2022] GET /identity/v3/role_assignments?user.id=2b629970ca1a4d7fa4c4f2365e671a80&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:24.296317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2de00a-6dba-46c1-98cc-a2bda02fdb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:24.297283 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2de00a-6dba-46c1-98cc-a2bda02fdb48 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:24.297767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2de00a-6dba-46c1-98cc-a2bda02fdb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:24.298275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2de00a-6dba-46c1-98cc-a2bda02fdb48 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:24.299175 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2de00a-6dba-46c1-98cc-a2bda02fdb48 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:24.300232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2de00a-6dba-46c1-98cc-a2bda02fdb48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:24.301867 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2de00a-6dba-46c1-98cc-a2bda02fdb48 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:24.311960 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 436/860] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:13:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:24.318177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35909be9-6732-4172-bff1-e3d97ffe6525 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:24.424012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:24.437375 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35909be9-6732-4172-bff1-e3d97ffe6525 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:24.476038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc693a3-a89b-4a1c-ac65-7502170d7734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:24.477972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc693a3-a89b-4a1c-ac65-7502170d7734 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:24.477972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc693a3-a89b-4a1c-ac65-7502170d7734 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:24.477972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc693a3-a89b-4a1c-ac65-7502170d7734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:24.490960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc693a3-a89b-4a1c-ac65-7502170d7734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:24.492739 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc693a3-a89b-4a1c-ac65-7502170d7734 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6fc693a3-a89b-4a1c-ac65-7502170d7734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:24.508298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:24.509331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:24.510295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:24.510295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:24.510295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:24.516608 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 425/861] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:24.518095 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2de00a-6dba-46c1-98cc-a2bda02fdb48 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:24.610065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:24.624302 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2de00a-6dba-46c1-98cc-a2bda02fdb48 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:24.660130 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c785b7-7880-4e41-add9-2b881bb24419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:24.660995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c785b7-7880-4e41-add9-2b881bb24419 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:24.661413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c785b7-7880-4e41-add9-2b881bb24419 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:24.661821 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c785b7-7880-4e41-add9-2b881bb24419 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:24.662599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c785b7-7880-4e41-add9-2b881bb24419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:24.663063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c785b7-7880-4e41-add9-2b881bb24419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:24.664634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c785b7-7880-4e41-add9-2b881bb24419 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:24.681550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 437/862] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:24.684146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc693a3-a89b-4a1c-ac65-7502170d7734 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:24.773926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ccbcc-c0fc-4ccd-93df-c0219c117def None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:24.774129 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ccbcc-c0fc-4ccd-93df-c0219c117def None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:24.774392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ccbcc-c0fc-4ccd-93df-c0219c117def None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:24.775980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 438/863] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:24.780952 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eafe8-a585-4f16-96bc-1616c661c94b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:24.781234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eafe8-a585-4f16-96bc-1616c661c94b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:24.781744 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eafe8-a585-4f16-96bc-1616c661c94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:24.790764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc693a3-a89b-4a1c-ac65-7502170d7734 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:24.800794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-008eafe8-a585-4f16-96bc-1616c661c94b None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:24.802150 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-008eafe8-a585-4f16-96bc-1616c661c94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:24.830017 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8f0c1-97e5-4353-8000-9dfa7726726d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:24.831020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8f0c1-97e5-4353-8000-9dfa7726726d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:24.831547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8f0c1-97e5-4353-8000-9dfa7726726d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:24.832052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8f0c1-97e5-4353-8000-9dfa7726726d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:24.840427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8f0c1-97e5-4353-8000-9dfa7726726d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:24.842204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8f0c1-97e5-4353-8000-9dfa7726726d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:24.844980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f6e8f0c1-97e5-4353-8000-9dfa7726726d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:24.855390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:24.856546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:24.857741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:24.857741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:24.857741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:24.857741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:24.857741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:24.857741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:24.857741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:24.857741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:24.857741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 16:13:24.857741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:24.865455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 426/864] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Aug 11 16:13:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:24.867140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8f0c1-97e5-4353-8000-9dfa7726726d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:24.884695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 439/865] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:13:24.904014 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eafe8-a585-4f16-96bc-1616c661c94b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:24.995032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:25.002266 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8f0c1-97e5-4353-8000-9dfa7726726d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:25.025581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eafe8-a585-4f16-96bc-1616c661c94b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:25.051262 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f14e6-8052-420e-a975-09acf34847cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:25.051941 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f14e6-8052-420e-a975-09acf34847cb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:25.052142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f14e6-8052-420e-a975-09acf34847cb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:25.052414 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f14e6-8052-420e-a975-09acf34847cb None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:25.053175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f14e6-8052-420e-a975-09acf34847cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:25.053477 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f14e6-8052-420e-a975-09acf34847cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:25.054884 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f14e6-8052-420e-a975-09acf34847cb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:25.066677 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204ea6d-8c68-416b-b530-175251f3c385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:25.067521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204ea6d-8c68-416b-b530-175251f3c385 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:25.067989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204ea6d-8c68-416b-b530-175251f3c385 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:25.068430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204ea6d-8c68-416b-b530-175251f3c385 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:25.069365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204ea6d-8c68-416b-b530-175251f3c385 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:25.071681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204ea6d-8c68-416b-b530-175251f3c385 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:25.078320 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 427/866] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Aug 11 16:13:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:25.080115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f14e6-8052-420e-a975-09acf34847cb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:25.104371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 440/867] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Aug 11 16:13:24 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:13:25.160218 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:25.215139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f14e6-8052-420e-a975-09acf34847cb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:25.267064 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ca5a0-4cfa-4aff-b7b7-5ad0dc1b733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:25.267670 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ca5a0-4cfa-4aff-b7b7-5ad0dc1b733b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:25.267946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ca5a0-4cfa-4aff-b7b7-5ad0dc1b733b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:25.268790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ca5a0-4cfa-4aff-b7b7-5ad0dc1b733b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:25.343185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ca5a0-4cfa-4aff-b7b7-5ad0dc1b733b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:25.346336 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ca5a0-4cfa-4aff-b7b7-5ad0dc1b733b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:25.414925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:25.474571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 428/868] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:25 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 16:13:25.485229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204ea6d-8c68-416b-b530-175251f3c385 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:25.590703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204ea6d-8c68-416b-b530-175251f3c385 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:25.629978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15702a-af8c-436c-aebf-90b202b89e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:25.630524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15702a-af8c-436c-aebf-90b202b89e93 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:25.630798 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15702a-af8c-436c-aebf-90b202b89e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:25.631067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15702a-af8c-436c-aebf-90b202b89e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:25.638839 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:25.642908 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15702a-af8c-436c-aebf-90b202b89e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:25.645271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15702a-af8c-436c-aebf-90b202b89e93 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-7f15702a-af8c-436c-aebf-90b202b89e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:25.661603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:25.662581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:25.663853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:25.663853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:25.663853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:25.663853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 441/869] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:25.670102 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ca5a0-4cfa-4aff-b7b7-5ad0dc1b733b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:25.778759 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ca5a0-4cfa-4aff-b7b7-5ad0dc1b733b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:25.817510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6998fae-2e20-4b93-b863-6b265c6c1b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:25.818223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6998fae-2e20-4b93-b863-6b265c6c1b0d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:25.818549 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6998fae-2e20-4b93-b863-6b265c6c1b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:25.818865 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6998fae-2e20-4b93-b863-6b265c6c1b0d None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:25.819643 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6998fae-2e20-4b93-b863-6b265c6c1b0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:25.819936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6998fae-2e20-4b93-b863-6b265c6c1b0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:25.821453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6998fae-2e20-4b93-b863-6b265c6c1b0d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:25.835281 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 429/870] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:25.839836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93807bab-4942-4e97-a231-c1bd2e350535 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:25.840303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93807bab-4942-4e97-a231-c1bd2e350535 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:25.840514 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93807bab-4942-4e97-a231-c1bd2e350535 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:25.841743 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6998fae-2e20-4b93-b863-6b265c6c1b0d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:25.841964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 442/871] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:25.848506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4b770-14b3-4460-9304-63e6195cc204 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:25.848808 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4b770-14b3-4460-9304-63e6195cc204 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:25.849079 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4b770-14b3-4460-9304-63e6195cc204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:25.861743 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:25.871647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ddc4b770-14b3-4460-9304-63e6195cc204 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:25.873284 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ddc4b770-14b3-4460-9304-63e6195cc204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:25.957928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6998fae-2e20-4b93-b863-6b265c6c1b0d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:25.961384 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 443/872] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:25 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:25.978377 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4b770-14b3-4460-9304-63e6195cc204 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:25.995172 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b624d-6e14-47fa-a011-ea13ce720b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:25.996131 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b624d-6e14-47fa-a011-ea13ce720b1c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:25.996625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b624d-6e14-47fa-a011-ea13ce720b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:25.997094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b624d-6e14-47fa-a011-ea13ce720b1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:26.004525 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b624d-6e14-47fa-a011-ea13ce720b1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:26.006212 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b624d-6e14-47fa-a011-ea13ce720b1c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:26.018930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-1d5b624d-6e14-47fa-a011-ea13ce720b1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:26.018930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:26.018930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:26.018930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:26.018930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:26.018930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:26.018930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:26.018930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:26.018930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:26.018930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:26.018930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:26.018930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:26.018930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:26.018930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:26.018930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:26.019936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:26.020889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:26.020889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:26.020889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:26.020889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:26.020889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:26.020889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:26.020889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:26.020889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:26.028010 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 430/873] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:26.029553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b624d-6e14-47fa-a011-ea13ce720b1c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:26.084949 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4b770-14b3-4460-9304-63e6195cc204 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:26.106872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:26.115292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:26.123289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b2f31-1e9c-47df-82cb-9e7154dea9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:26.124297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b2f31-1e9c-47df-82cb-9e7154dea9a2 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:26.124569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b2f31-1e9c-47df-82cb-9e7154dea9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:26.124874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b2f31-1e9c-47df-82cb-9e7154dea9a2 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:26.125754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b2f31-1e9c-47df-82cb-9e7154dea9a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:26.127040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b2f31-1e9c-47df-82cb-9e7154dea9a2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:26.147246 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b624d-6e14-47fa-a011-ea13ce720b1c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:26.153139 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 444/874] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Aug 11 16:13:25 2022] POST /identity/v3/services => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:13:26.195584 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664672e-6773-4411-9b31-60d3151df8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:26.196631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664672e-6773-4411-9b31-60d3151df8dc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:26.197122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664672e-6773-4411-9b31-60d3151df8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:26.197641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664672e-6773-4411-9b31-60d3151df8dc None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:26.198549 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664672e-6773-4411-9b31-60d3151df8dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:26.199058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664672e-6773-4411-9b31-60d3151df8dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:26.200795 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664672e-6773-4411-9b31-60d3151df8dc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:26.220991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 431/875] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:26.224747 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b2f31-1e9c-47df-82cb-9e7154dea9a2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:26.352904 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b2f31-1e9c-47df-82cb-9e7154dea9a2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:26.374413 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ea41f-76a6-4cae-8a4b-ad30295246cc None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:26.374751 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ea41f-76a6-4cae-8a4b-ad30295246cc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:26.374960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ea41f-76a6-4cae-8a4b-ad30295246cc None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:26.376446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 432/876] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:26.383774 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bbe2a-3e7a-4875-82f9-65e20410c630 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:26.384224 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bbe2a-3e7a-4875-82f9-65e20410c630 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:26.384434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bbe2a-3e7a-4875-82f9-65e20410c630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:26.393888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd3718-0fe2-4fef-a760-c87bc8649701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:26.394493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd3718-0fe2-4fef-a760-c87bc8649701 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:26.394768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd3718-0fe2-4fef-a760-c87bc8649701 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:26.395038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd3718-0fe2-4fef-a760-c87bc8649701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:26.395761 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd3718-0fe2-4fef-a760-c87bc8649701 None admin] RBAC: Adding query filter params (role.id=b4c209d1895841af9203c4e432176eb9, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=732213990cf84fc198db9c47866fb687) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:26.396064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd3718-0fe2-4fef-a760-c87bc8649701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:26.397659 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd3718-0fe2-4fef-a760-c87bc8649701 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:26.404489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 445/877] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:26 2022] GET /identity/v3/role_assignments?user.id=732213990cf84fc198db9c47866fb687&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=b4c209d1895841af9203c4e432176eb9 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:26.420905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-335bbe2a-3e7a-4875-82f9-65e20410c630 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:26.422115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-335bbe2a-3e7a-4875-82f9-65e20410c630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:26.503522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 433/878] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:26.526036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd3718-0fe2-4fef-a760-c87bc8649701 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:26.579535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:26.637174 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd3718-0fe2-4fef-a760-c87bc8649701 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:26.680641 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bdda9-b7b8-48c1-8a10-2a366b4abaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:26.681265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bdda9-b7b8-48c1-8a10-2a366b4abaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:26.681532 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bdda9-b7b8-48c1-8a10-2a366b4abaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:26.681813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bdda9-b7b8-48c1-8a10-2a366b4abaa6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:26.682401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bdda9-b7b8-48c1-8a10-2a366b4abaa6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:26.683828 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bdda9-b7b8-48c1-8a10-2a366b4abaa6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-7c6bdda9-b7b8-48c1-8a10-2a366b4abaa6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:26.693651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:26.694646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:26.695852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:26.695852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:26.695852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:26.695852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:26.695852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:26.695852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:26.695852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:26.695852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:26.695852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:26.695852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:26.695852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:26.695852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:26.695852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 16:13:26.695852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:26.695852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 446/879] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Aug 11 16:13:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:26.701191 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bbe2a-3e7a-4875-82f9-65e20410c630 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:26.762618 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:26.804810 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bbe2a-3e7a-4875-82f9-65e20410c630 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:26.840260 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0396c5c-779a-4c51-bc96-e266b864fd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:26.840891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396c5c-779a-4c51-bc96-e266b864fd71 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:26.841168 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396c5c-779a-4c51-bc96-e266b864fd71 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:26.841439 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396c5c-779a-4c51-bc96-e266b864fd71 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:26.842068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0396c5c-779a-4c51-bc96-e266b864fd71 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:26.842366 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0396c5c-779a-4c51-bc96-e266b864fd71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:26.843719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0396c5c-779a-4c51-bc96-e266b864fd71 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:26.849028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 434/880] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Aug 11 16:13:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:26.855393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bdda9-b7b8-48c1-8a10-2a366b4abaa6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:26.967898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bdda9-b7b8-48c1-8a10-2a366b4abaa6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:26.977659 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:27.006856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c36b0-8000-49e6-a68d-a8e46ac425fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:27.007858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c36b0-8000-49e6-a68d-a8e46ac425fc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:27.008337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c36b0-8000-49e6-a68d-a8e46ac425fc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:27.008830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c36b0-8000-49e6-a68d-a8e46ac425fc None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:27.009703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c36b0-8000-49e6-a68d-a8e46ac425fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:27.010195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c36b0-8000-49e6-a68d-a8e46ac425fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:27.011760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c36b0-8000-49e6-a68d-a8e46ac425fc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:27.024295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 447/881] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Aug 11 16:13:26 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:27.253493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defa957-b26e-427c-8f9d-ba7380da158b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:27.254025 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defa957-b26e-427c-8f9d-ba7380da158b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:27.254025 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defa957-b26e-427c-8f9d-ba7380da158b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:27.255700 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 435/882] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:27.260964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b66921-c908-40fa-ac9a-7cc7945a5ae0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:27.261249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b66921-c908-40fa-ac9a-7cc7945a5ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:27.261522 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b66921-c908-40fa-ac9a-7cc7945a5ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:27.279995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f2b66921-c908-40fa-ac9a-7cc7945a5ae0 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:27.281132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f2b66921-c908-40fa-ac9a-7cc7945a5ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:27.351328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 448/883] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:27.373441 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defa957-b26e-427c-8f9d-ba7380da158b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:27.492083 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defa957-b26e-427c-8f9d-ba7380da158b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:27.525063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:27.527748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541ab5b-5185-4e12-973d-9bad5bc812ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:27.528376 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541ab5b-5185-4e12-973d-9bad5bc812ee None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:27.528684 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541ab5b-5185-4e12-973d-9bad5bc812ee None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:27.528957 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541ab5b-5185-4e12-973d-9bad5bc812ee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:27.529536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541ab5b-5185-4e12-973d-9bad5bc812ee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:27.530950 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541ab5b-5185-4e12-973d-9bad5bc812ee None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-8541ab5b-5185-4e12-973d-9bad5bc812ee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:27.540891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:27.541851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:27.542857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:27.542857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:27.542857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:27.542857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:27.542857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:27.542857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:27.542857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:27.542857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:27.542857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:27.542857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:27.542857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:27.542857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:27.542857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 16:13:27.542857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:27.542857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 436/884] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:13:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:27.548408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b66921-c908-40fa-ac9a-7cc7945a5ae0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:27.649448 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b66921-c908-40fa-ac9a-7cc7945a5ae0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:27.651348 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:27.687626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdab7c-b596-40eb-9e7d-8dc305fcc7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:27.688237 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdab7c-b596-40eb-9e7d-8dc305fcc7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:27.688512 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdab7c-b596-40eb-9e7d-8dc305fcc7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:27.688812 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdab7c-b596-40eb-9e7d-8dc305fcc7b1 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:27.689449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdab7c-b596-40eb-9e7d-8dc305fcc7b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:27.689748 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdab7c-b596-40eb-9e7d-8dc305fcc7b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:27.691333 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdab7c-b596-40eb-9e7d-8dc305fcc7b1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:27.696371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 449/885] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:13:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:27.701699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541ab5b-5185-4e12-973d-9bad5bc812ee None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:27.811760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541ab5b-5185-4e12-973d-9bad5bc812ee None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:27.847342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb3661-1661-495f-baa7-682587ad610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:27.848278 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb3661-1661-495f-baa7-682587ad610a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:27.848818 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb3661-1661-495f-baa7-682587ad610a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:27.849308 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb3661-1661-495f-baa7-682587ad610a None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:27.850127 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb3661-1661-495f-baa7-682587ad610a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:27.850675 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb3661-1661-495f-baa7-682587ad610a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:27.852235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb3661-1661-495f-baa7-682587ad610a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:27.857821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 437/886] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:13:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:27.864362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdab7c-b596-40eb-9e7d-8dc305fcc7b1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:27.969084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdab7c-b596-40eb-9e7d-8dc305fcc7b1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:28.004275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116453a3-8f5d-4931-9570-80f05ce20e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:28.004907 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116453a3-8f5d-4931-9570-80f05ce20e2e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:28.005183 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116453a3-8f5d-4931-9570-80f05ce20e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:28.005467 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116453a3-8f5d-4931-9570-80f05ce20e2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:28.006258 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116453a3-8f5d-4931-9570-80f05ce20e2e None admin] RBAC: Adding query filter params (interface=public, service_id=8ebae8097754470e8823364eebf35f2b, region_id=RegionOne) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:28.006613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116453a3-8f5d-4931-9570-80f05ce20e2e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:28.008020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116453a3-8f5d-4931-9570-80f05ce20e2e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:28.013576 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 450/887] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Aug 11 16:13:27 2022] GET /identity/v3/endpoints?service_id=8ebae8097754470e8823364eebf35f2b&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:28.021962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb3661-1661-495f-baa7-682587ad610a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:28.077252 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:28.127673 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb3661-1661-495f-baa7-682587ad610a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:28.162993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07be5e-fb3f-40f7-9269-5b3c34bd8699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:28.163600 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07be5e-fb3f-40f7-9269-5b3c34bd8699 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:28.163875 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07be5e-fb3f-40f7-9269-5b3c34bd8699 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:28.164142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07be5e-fb3f-40f7-9269-5b3c34bd8699 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:28.164772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07be5e-fb3f-40f7-9269-5b3c34bd8699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:28.166132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07be5e-fb3f-40f7-9269-5b3c34bd8699 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:28.172594 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 438/888] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Aug 11 16:13:28 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:13:28.356930 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae25e4-7162-46e5-9117-3371ad0ea8c9 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:28.357605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae25e4-7162-46e5-9117-3371ad0ea8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:28.358116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae25e4-7162-46e5-9117-3371ad0ea8c9 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:28.359899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 451/889] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:28.366464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf00837-46cf-44f7-8d89-76dbf5e70120 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:28.367459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf00837-46cf-44f7-8d89-76dbf5e70120 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:28.367934 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf00837-46cf-44f7-8d89-76dbf5e70120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:28.387112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-baf00837-46cf-44f7-8d89-76dbf5e70120 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:28.388613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-baf00837-46cf-44f7-8d89-76dbf5e70120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:28.460424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 439/890] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:28.486074 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae25e4-7162-46e5-9117-3371ad0ea8c9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:28.517905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:28.589297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed68cb-5ac4-40a2-a79e-7d28156e29a9 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:28.589297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed68cb-5ac4-40a2-a79e-7d28156e29a9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:28.589599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed68cb-5ac4-40a2-a79e-7d28156e29a9 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:28.591165 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 440/891] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:28.595923 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61656d-615b-4b93-9f1e-4f41dd9b2672 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:28.596233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61656d-615b-4b93-9f1e-4f41dd9b2672 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:28.596508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61656d-615b-4b93-9f1e-4f41dd9b2672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:28.597623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae25e4-7162-46e5-9117-3371ad0ea8c9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:28.615325 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0b61656d-615b-4b93-9f1e-4f41dd9b2672 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:28.616411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0b61656d-615b-4b93-9f1e-4f41dd9b2672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:28.635779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ea9ac-b543-4407-b17a-98435ef09a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:28.636835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ea9ac-b543-4407-b17a-98435ef09a1e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:28.637326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ea9ac-b543-4407-b17a-98435ef09a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:28.637868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ea9ac-b543-4407-b17a-98435ef09a1e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:28.638599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ea9ac-b543-4407-b17a-98435ef09a1e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:28.640055 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ea9ac-b543-4407-b17a-98435ef09a1e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-183ea9ac-b543-4407-b17a-98435ef09a1e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:28.650288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:28.651294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:28.652171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:28.652171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:28.652171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:28.652171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:28.652171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:28.652171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:28.652171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:28.652171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:28.652171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:28.652171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:28.652171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:28.652171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:28.652171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 16:13:28.652171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:28.652171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 452/892] 10.222.0.40 () {56 vars in 1132 bytes} [Thu Aug 11 16:13:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:28.662728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ea9ac-b543-4407-b17a-98435ef09a1e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:28.664858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:28.700622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 441/893] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:28.722979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61656d-615b-4b93-9f1e-4f41dd9b2672 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:28.773547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:28.781340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ea9ac-b543-4407-b17a-98435ef09a1e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:28.817719 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a216a-7bbd-4ca4-9a35-854c52daf1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:28.818679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a216a-7bbd-4ca4-9a35-854c52daf1ac None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:28.819243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a216a-7bbd-4ca4-9a35-854c52daf1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:28.819734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a216a-7bbd-4ca4-9a35-854c52daf1ac None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:28.820696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a216a-7bbd-4ca4-9a35-854c52daf1ac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:28.821194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a216a-7bbd-4ca4-9a35-854c52daf1ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:28.822905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a216a-7bbd-4ca4-9a35-854c52daf1ac None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:28.828568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 453/894] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Aug 11 16:13:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:28.831129 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61656d-615b-4b93-9f1e-4f41dd9b2672 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:28.833674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a216a-7bbd-4ca4-9a35-854c52daf1ac None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:28.869774 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd861935-fdda-4727-9516-67a6ce4d2be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:28.870347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd861935-fdda-4727-9516-67a6ce4d2be6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:28.870625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd861935-fdda-4727-9516-67a6ce4d2be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:28.870899 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd861935-fdda-4727-9516-67a6ce4d2be6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:28.882134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd861935-fdda-4727-9516-67a6ce4d2be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-fd861935-fdda-4727-9516-67a6ce4d2be6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:28.887058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:28.887985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:28.888869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:28.888869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:28.888869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:28.888869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:28.888869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:28.888869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:28.888869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:28.888869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:28.888869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:28.888869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:28.888869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 16:13:28.888869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:28.892851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 442/895] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Aug 11 16:13:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:28.894257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd861935-fdda-4727-9516-67a6ce4d2be6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:28.934596 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:28.948429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a216a-7bbd-4ca4-9a35-854c52daf1ac None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:28.983810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca83395-a4f9-414d-b8e5-59e8d270edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:28.984830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca83395-a4f9-414d-b8e5-59e8d270edde None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:28.985548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca83395-a4f9-414d-b8e5-59e8d270edde None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:28.986057 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca83395-a4f9-414d-b8e5-59e8d270edde None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:28.987505 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca83395-a4f9-414d-b8e5-59e8d270edde None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:28.988008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca83395-a4f9-414d-b8e5-59e8d270edde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:28.989660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca83395-a4f9-414d-b8e5-59e8d270edde None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:28.995263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 454/896] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Aug 11 16:13:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:29.000403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca83395-a4f9-414d-b8e5-59e8d270edde None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:29.006536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd861935-fdda-4727-9516-67a6ce4d2be6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:29.026107 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:29.046510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12999429-b67f-4aba-b4ce-e4921707c284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:29.047466 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12999429-b67f-4aba-b4ce-e4921707c284 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:29.047889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12999429-b67f-4aba-b4ce-e4921707c284 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:29.048305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12999429-b67f-4aba-b4ce-e4921707c284 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:29.049140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12999429-b67f-4aba-b4ce-e4921707c284 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:29.050157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12999429-b67f-4aba-b4ce-e4921707c284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:29.051862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12999429-b67f-4aba-b4ce-e4921707c284 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:29.065419 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 443/897] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Aug 11 16:13:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:29.066513 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12999429-b67f-4aba-b4ce-e4921707c284 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:29.107744 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca83395-a4f9-414d-b8e5-59e8d270edde None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:29.143265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674870e9-d6f4-4bbf-b155-35192963a0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:29.143985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674870e9-d6f4-4bbf-b155-35192963a0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:29.144375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674870e9-d6f4-4bbf-b155-35192963a0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:29.144811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674870e9-d6f4-4bbf-b155-35192963a0e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:29.145999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674870e9-d6f4-4bbf-b155-35192963a0e8 None admin] RBAC: Adding query filter params (interface=public, service_id=508c6e17183b4cfdb8f27d62f8039f39, region_id=RegionOne) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:29.145999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674870e9-d6f4-4bbf-b155-35192963a0e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:29.147576 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674870e9-d6f4-4bbf-b155-35192963a0e8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:29.153571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 455/898] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Aug 11 16:13:28 2022] GET /identity/v3/endpoints?service_id=508c6e17183b4cfdb8f27d62f8039f39&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:29.158296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674870e9-d6f4-4bbf-b155-35192963a0e8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:29.169696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:29.174192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12999429-b67f-4aba-b4ce-e4921707c284 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:29.210751 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5f545-5786-4d4a-b0e1-c74d83193dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:29.211428 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5f545-5786-4d4a-b0e1-c74d83193dea None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:29.211638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5f545-5786-4d4a-b0e1-c74d83193dea None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:29.211903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5f545-5786-4d4a-b0e1-c74d83193dea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:29.225776 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5f545-5786-4d4a-b0e1-c74d83193dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:29.228375 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5f545-5786-4d4a-b0e1-c74d83193dea None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-3ae5f545-5786-4d4a-b0e1-c74d83193dea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:29.244115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:29.245384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:29.246292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:29.246292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:29.246292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:29.246292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 444/899] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:29.247119 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80c7c4-0fda-4335-910b-69dfc4e19cfe None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:29.247385 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80c7c4-0fda-4335-910b-69dfc4e19cfe None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:29.247660 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80c7c4-0fda-4335-910b-69dfc4e19cfe None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:29.249100 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 445/900] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:29.254464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80c7c4-0fda-4335-910b-69dfc4e19cfe None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:29.259695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:29.276717 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674870e9-d6f4-4bbf-b155-35192963a0e8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:29.313536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6381d6-45e1-4bf4-a2e8-17f6a91a45a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:29.314209 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6381d6-45e1-4bf4-a2e8-17f6a91a45a9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:29.314481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6381d6-45e1-4bf4-a2e8-17f6a91a45a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:29.314755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6381d6-45e1-4bf4-a2e8-17f6a91a45a9 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:29.315963 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6381d6-45e1-4bf4-a2e8-17f6a91a45a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:29.317403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6381d6-45e1-4bf4-a2e8-17f6a91a45a9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:29.323818 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 456/901] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Aug 11 16:13:29 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:13:29.325144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861bf67-88b4-4c7e-8ade-cdb8476479f9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:29.325423 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861bf67-88b4-4c7e-8ade-cdb8476479f9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:29.325689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861bf67-88b4-4c7e-8ade-cdb8476479f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:29.347187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0861bf67-88b4-4c7e-8ade-cdb8476479f9 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:29.348823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0861bf67-88b4-4c7e-8ade-cdb8476479f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:29.390935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80c7c4-0fda-4335-910b-69dfc4e19cfe None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:29.430187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 457/902] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:29.440243 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e436b80-3c52-4dfe-9d67-e58ab27a7c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:29.441005 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e436b80-3c52-4dfe-9d67-e58ab27a7c0c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:29.441347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e436b80-3c52-4dfe-9d67-e58ab27a7c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:29.441686 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e436b80-3c52-4dfe-9d67-e58ab27a7c0c None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:29.442409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e436b80-3c52-4dfe-9d67-e58ab27a7c0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:29.442768 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e436b80-3c52-4dfe-9d67-e58ab27a7c0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:29.444281 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e436b80-3c52-4dfe-9d67-e58ab27a7c0c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:29.457067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861bf67-88b4-4c7e-8ade-cdb8476479f9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:29.458964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 446/903] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:29.464635 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e436b80-3c52-4dfe-9d67-e58ab27a7c0c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:29.482450 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:29.554993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:29.575221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861bf67-88b4-4c7e-8ade-cdb8476479f9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:29.589841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e436b80-3c52-4dfe-9d67-e58ab27a7c0c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:29.616060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923d83c-fcd3-4ba3-9dcb-92023ec1cebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:29.616650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923d83c-fcd3-4ba3-9dcb-92023ec1cebe None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:29.616650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923d83c-fcd3-4ba3-9dcb-92023ec1cebe None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:29.616905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923d83c-fcd3-4ba3-9dcb-92023ec1cebe None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:29.617560 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923d83c-fcd3-4ba3-9dcb-92023ec1cebe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:29.619013 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923d83c-fcd3-4ba3-9dcb-92023ec1cebe None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:29.632404 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd5598-7bd9-41fc-aea1-378d0c56db74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:29.633414 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd5598-7bd9-41fc-aea1-378d0c56db74 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:29.633892 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd5598-7bd9-41fc-aea1-378d0c56db74 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:29.634340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd5598-7bd9-41fc-aea1-378d0c56db74 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:29.644614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 458/904] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Aug 11 16:13:29 2022] POST /identity/v3/services => generated 241 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:13:29.648405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd5598-7bd9-41fc-aea1-378d0c56db74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:29.649961 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd5598-7bd9-41fc-aea1-378d0c56db74 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-40fd5598-7bd9-41fc-aea1-378d0c56db74 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:29.665685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:29.666692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:29.667625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:29.667625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:29.667625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:29.667625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:29.667625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:29.667625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:29.667625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:29.667625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:29.667625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 16:13:29.667625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:29.667625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 447/905] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Aug 11 16:13:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:29.673486 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923d83c-fcd3-4ba3-9dcb-92023ec1cebe None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:29.798369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923d83c-fcd3-4ba3-9dcb-92023ec1cebe None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:29.839409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9470e6-0342-499e-bc34-56bdff4dc2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:29.840370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9470e6-0342-499e-bc34-56bdff4dc2ae None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:29.840860 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9470e6-0342-499e-bc34-56bdff4dc2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:29.841286 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9470e6-0342-499e-bc34-56bdff4dc2ae None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:29.842034 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9470e6-0342-499e-bc34-56bdff4dc2ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:29.842341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9470e6-0342-499e-bc34-56bdff4dc2ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:29.843773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9470e6-0342-499e-bc34-56bdff4dc2ae None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:29.846803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:29.868190 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 459/906] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Aug 11 16:13:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:29.869637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd5598-7bd9-41fc-aea1-378d0c56db74 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:29.954564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:29.987736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd5598-7bd9-41fc-aea1-378d0c56db74 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:30.022753 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b08d6-0b99-4cb6-a35d-33241e6f37cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:30.023361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b08d6-0b99-4cb6-a35d-33241e6f37cf None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:30.023638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b08d6-0b99-4cb6-a35d-33241e6f37cf None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:30.023910 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b08d6-0b99-4cb6-a35d-33241e6f37cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:30.096562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b08d6-0b99-4cb6-a35d-33241e6f37cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:30.098472 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b08d6-0b99-4cb6-a35d-33241e6f37cf None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:30.171827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:30.210263 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 448/907] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:29 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 16:13:30.216148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9470e6-0342-499e-bc34-56bdff4dc2ae None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:30.286581 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c94e2-406e-4781-8e91-c185f5e73fc8 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:30.286927 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c94e2-406e-4781-8e91-c185f5e73fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:30.287132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c94e2-406e-4781-8e91-c185f5e73fc8 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:30.288578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 449/908] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:30.294133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc4c1-28f2-4e82-8908-23f8b47561a6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:30.294629 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc4c1-28f2-4e82-8908-23f8b47561a6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:30.295094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc4c1-28f2-4e82-8908-23f8b47561a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:30.318882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-cc6cc4c1-28f2-4e82-8908-23f8b47561a6 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:30.319902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9470e6-0342-499e-bc34-56bdff4dc2ae None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:30.320624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cc6cc4c1-28f2-4e82-8908-23f8b47561a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:30.359998 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f74083-d14b-4d4f-834e-88c0e2112af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:30.360529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f74083-d14b-4d4f-834e-88c0e2112af2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:30.360835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f74083-d14b-4d4f-834e-88c0e2112af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:30.361103 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f74083-d14b-4d4f-834e-88c0e2112af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:30.372020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f74083-d14b-4d4f-834e-88c0e2112af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:30.373633 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f74083-d14b-4d4f-834e-88c0e2112af2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f7f74083-d14b-4d4f-834e-88c0e2112af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:30.388306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:30.389287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:30.390456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:30.390456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:30.390456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:30.390456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 460/909] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:30.394833 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f74083-d14b-4d4f-834e-88c0e2112af2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:30.416048 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 450/910] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:13:30.439346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cc4c1-28f2-4e82-8908-23f8b47561a6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:30.454566 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:30.524750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f74083-d14b-4d4f-834e-88c0e2112af2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:30.562139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:30.566041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cc4c1-28f2-4e82-8908-23f8b47561a6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:30.572096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454adf8-82ec-4af1-9347-e6efdfe83b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:30.572728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454adf8-82ec-4af1-9347-e6efdfe83b0e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:30.573004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454adf8-82ec-4af1-9347-e6efdfe83b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:30.573270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454adf8-82ec-4af1-9347-e6efdfe83b0e None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:30.573909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454adf8-82ec-4af1-9347-e6efdfe83b0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:30.574205 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454adf8-82ec-4af1-9347-e6efdfe83b0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:30.575705 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454adf8-82ec-4af1-9347-e6efdfe83b0e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:30.592725 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 461/911] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:30.604427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454adf8-82ec-4af1-9347-e6efdfe83b0e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:30.609525 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccaddc-65dd-4587-a8cf-cb4a84df4a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:30.610207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccaddc-65dd-4587-a8cf-cb4a84df4a6c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:30.610469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccaddc-65dd-4587-a8cf-cb4a84df4a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:30.610692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccaddc-65dd-4587-a8cf-cb4a84df4a6c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:30.611280 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccaddc-65dd-4587-a8cf-cb4a84df4a6c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:30.613235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccaddc-65dd-4587-a8cf-cb4a84df4a6c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-20ccaddc-65dd-4587-a8cf-cb4a84df4a6c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:30.621928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:30.623051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:30.624154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:30.624154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:30.624154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:30.624154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:30.624154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:30.624154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:30.624154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:30.624154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:30.624154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:30.624154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:30.624154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:30.624154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:30.624154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 16:13:30.624154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:30.624154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 451/912] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:13:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:30.630583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccaddc-65dd-4587-a8cf-cb4a84df4a6c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:30.730364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454adf8-82ec-4af1-9347-e6efdfe83b0e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:30.741340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:30.767304 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccaddc-65dd-4587-a8cf-cb4a84df4a6c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:30.775564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061d07f-5ec7-458b-aa67-1fbcff55995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:30.776376 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061d07f-5ec7-458b-aa67-1fbcff55995b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:30.776825 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061d07f-5ec7-458b-aa67-1fbcff55995b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:30.777262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061d07f-5ec7-458b-aa67-1fbcff55995b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:30.784574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061d07f-5ec7-458b-aa67-1fbcff55995b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:30.786888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061d07f-5ec7-458b-aa67-1fbcff55995b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:30.802271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e061d07f-5ec7-458b-aa67-1fbcff55995b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:30.802271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:30.802271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:30.802271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:30.802271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:30.802271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:30.802271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:30.802271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:30.802271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:30.802271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:30.802271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:30.802271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:30.802271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:30.802271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:30.802271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:30.803368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:30.804454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:30.804454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:30.804454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:30.804454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:30.804454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:30.804454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:30.804454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:30.804454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:30.806581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 462/913] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:30.812336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061d07f-5ec7-458b-aa67-1fbcff55995b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:30.816162 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903aeb3-cd84-4a68-bc6b-f7500a3240d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:30.817877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903aeb3-cd84-4a68-bc6b-f7500a3240d9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:30.818376 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903aeb3-cd84-4a68-bc6b-f7500a3240d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:30.818843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903aeb3-cd84-4a68-bc6b-f7500a3240d9 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:30.819668 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903aeb3-cd84-4a68-bc6b-f7500a3240d9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:30.820175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903aeb3-cd84-4a68-bc6b-f7500a3240d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:30.822174 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903aeb3-cd84-4a68-bc6b-f7500a3240d9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:30.833194 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 452/914] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:13:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:30.834997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903aeb3-cd84-4a68-bc6b-f7500a3240d9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:30.872965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:30.928984 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061d07f-5ec7-458b-aa67-1fbcff55995b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:30.965099 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a94f6-cd0b-4f46-a077-aa60ac36d495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:30.965704 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a94f6-cd0b-4f46-a077-aa60ac36d495 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:30.965980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a94f6-cd0b-4f46-a077-aa60ac36d495 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:30.966250 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a94f6-cd0b-4f46-a077-aa60ac36d495 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:30.966945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a94f6-cd0b-4f46-a077-aa60ac36d495 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:30.967248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a94f6-cd0b-4f46-a077-aa60ac36d495 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:30.968706 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a94f6-cd0b-4f46-a077-aa60ac36d495 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:30.973829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903aeb3-cd84-4a68-bc6b-f7500a3240d9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:30.985306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 463/915] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:30.987873 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a94f6-cd0b-4f46-a077-aa60ac36d495 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:31.014946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fcdaf-3de2-450c-8155-82c9a1d749e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:31.015561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fcdaf-3de2-450c-8155-82c9a1d749e8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:31.015884 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fcdaf-3de2-450c-8155-82c9a1d749e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:31.016102 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fcdaf-3de2-450c-8155-82c9a1d749e8 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:31.016779 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fcdaf-3de2-450c-8155-82c9a1d749e8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:31.017081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fcdaf-3de2-450c-8155-82c9a1d749e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:31.018519 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fcdaf-3de2-450c-8155-82c9a1d749e8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:31.020571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:31.028399 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 453/916] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Aug 11 16:13:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:31.029302 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fcdaf-3de2-450c-8155-82c9a1d749e8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:31.106435 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a94f6-cd0b-4f46-a077-aa60ac36d495 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:31.140009 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:31.146856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d501cc-2677-494d-9cbd-e7a8255f556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:31.147736 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d501cc-2677-494d-9cbd-e7a8255f556d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:31.148247 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d501cc-2677-494d-9cbd-e7a8255f556d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:31.148750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d501cc-2677-494d-9cbd-e7a8255f556d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:31.149525 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fcdaf-3de2-450c-8155-82c9a1d749e8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:31.149901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d501cc-2677-494d-9cbd-e7a8255f556d None admin] RBAC: Adding query filter params (role.id=a785c8ffc53845be9d11e2cafc895ffe, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=732213990cf84fc198db9c47866fb687) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:31.150394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d501cc-2677-494d-9cbd-e7a8255f556d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:31.152275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d501cc-2677-494d-9cbd-e7a8255f556d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:31.165155 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 464/917] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:30 2022] GET /identity/v3/role_assignments?user.id=732213990cf84fc198db9c47866fb687&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=a785c8ffc53845be9d11e2cafc895ffe => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:31.188381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfb788-8f98-4eb7-9152-cd6d23280d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:31.189051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfb788-8f98-4eb7-9152-cd6d23280d6e None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:31.189332 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfb788-8f98-4eb7-9152-cd6d23280d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:31.189602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfb788-8f98-4eb7-9152-cd6d23280d6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:31.190458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfb788-8f98-4eb7-9152-cd6d23280d6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:31.191861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfb788-8f98-4eb7-9152-cd6d23280d6e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:31.220368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 454/918] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:13:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:13:31.428933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e377439-f4f6-4b5d-a0ac-d8e262d0481b None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:31.429124 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e377439-f4f6-4b5d-a0ac-d8e262d0481b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:31.429388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e377439-f4f6-4b5d-a0ac-d8e262d0481b None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:31.430716 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 465/919] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:31.436440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aac64-1bfc-4dbf-a521-ef3bb50cba92 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:31.436927 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aac64-1bfc-4dbf-a521-ef3bb50cba92 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:31.437121 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aac64-1bfc-4dbf-a521-ef3bb50cba92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:31.456038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9d8aac64-1bfc-4dbf-a521-ef3bb50cba92 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:31.457249 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9d8aac64-1bfc-4dbf-a521-ef3bb50cba92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:31.541750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 455/920] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:31.564175 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e377439-f4f6-4b5d-a0ac-d8e262d0481b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:31.659972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:31.670810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e377439-f4f6-4b5d-a0ac-d8e262d0481b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:31.706822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82639f-2d61-40bc-a496-c0cb93a90f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:31.707374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82639f-2d61-40bc-a496-c0cb93a90f7a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:31.707652 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82639f-2d61-40bc-a496-c0cb93a90f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:31.707924 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82639f-2d61-40bc-a496-c0cb93a90f7a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:31.708514 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82639f-2d61-40bc-a496-c0cb93a90f7a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:31.709907 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82639f-2d61-40bc-a496-c0cb93a90f7a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-dc82639f-2d61-40bc-a496-c0cb93a90f7a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:31.718962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:31.719893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:31.720785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:31.720785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:31.720785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:31.720785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:31.720785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:31.720785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:31.720785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:31.720785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:31.720785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:31.720785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:31.720785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:31.720785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:31.720785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 16:13:31.720785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:31.724924 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 466/921] 10.222.0.40 () {56 vars in 1132 bytes} [Thu Aug 11 16:13:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:31.726919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aac64-1bfc-4dbf-a521-ef3bb50cba92 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:31.787956 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ac3db-7d4b-488e-8f87-4e347a467b4d None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:31.788492 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ac3db-7d4b-488e-8f87-4e347a467b4d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:31.788776 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ac3db-7d4b-488e-8f87-4e347a467b4d None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:31.790218 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 467/922] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:31.795727 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0062c14-befd-4727-98e7-b51e7b552916 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:31.796003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0062c14-befd-4727-98e7-b51e7b552916 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:31.796269 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0062c14-befd-4727-98e7-b51e7b552916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:31.807424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:31.820183 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b0062c14-befd-4727-98e7-b51e7b552916 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:31.821549 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b0062c14-befd-4727-98e7-b51e7b552916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:31.852077 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aac64-1bfc-4dbf-a521-ef3bb50cba92 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:31.896181 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03623ce4-f1e4-4894-9401-1808d1b76448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:31.896819 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03623ce4-f1e4-4894-9401-1808d1b76448 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:31.897101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03623ce4-f1e4-4894-9401-1808d1b76448 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:31.897374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03623ce4-f1e4-4894-9401-1808d1b76448 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:31.898011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03623ce4-f1e4-4894-9401-1808d1b76448 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:31.898312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03623ce4-f1e4-4894-9401-1808d1b76448 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:31.899665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 468/923] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:13:31.899801 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03623ce4-f1e4-4894-9401-1808d1b76448 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:31.904680 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 456/924] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Aug 11 16:13:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:31.910892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0062c14-befd-4727-98e7-b51e7b552916 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:31.923104 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03623ce4-f1e4-4894-9401-1808d1b76448 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:32.019346 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:32.043623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0062c14-befd-4727-98e7-b51e7b552916 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:32.044287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03623ce4-f1e4-4894-9401-1808d1b76448 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:32.079940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec2180-c197-4050-b409-0bca5128cb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:32.080918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec2180-c197-4050-b409-0bca5128cb51 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:32.081401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec2180-c197-4050-b409-0bca5128cb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:32.081895 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec2180-c197-4050-b409-0bca5128cb51 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:32.082680 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec2180-c197-4050-b409-0bca5128cb51 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:32.084417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec2180-c197-4050-b409-0bca5128cb51 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:32.086995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f560e1-66f0-445c-aed2-4be951793f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:32.087955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f560e1-66f0-445c-aed2-4be951793f3a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:32.088236 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f560e1-66f0-445c-aed2-4be951793f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:32.088506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f560e1-66f0-445c-aed2-4be951793f3a None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:32.089175 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f560e1-66f0-445c-aed2-4be951793f3a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:32.089700 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f560e1-66f0-445c-aed2-4be951793f3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:32.091147 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f560e1-66f0-445c-aed2-4be951793f3a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-3aec2180-c197-4050-b409-0bca5128cb51 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:32.095087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:32.096570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:32.097434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:32.097434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:32.097434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:32.097434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:32.097434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:32.097434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:32.097434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:32.097434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:32.097434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:32.097434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:32.097434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:32.097434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:32.097434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 16:13:32.097434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:32.104509 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 469/925] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Aug 11 16:13:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:32.104926 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 457/926] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Aug 11 16:13:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:32.105673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f560e1-66f0-445c-aed2-4be951793f3a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:32.106040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec2180-c197-4050-b409-0bca5128cb51 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:32.109149 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:32.213148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec2180-c197-4050-b409-0bca5128cb51 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:32.236491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f560e1-66f0-445c-aed2-4be951793f3a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:32.249919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3d694-c04f-4c6c-81ad-133200e52084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:32.250865 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3d694-c04f-4c6c-81ad-133200e52084 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:32.251354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3d694-c04f-4c6c-81ad-133200e52084 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:32.251844 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3d694-c04f-4c6c-81ad-133200e52084 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:32.253271 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3d694-c04f-4c6c-81ad-133200e52084 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:32.253793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3d694-c04f-4c6c-81ad-133200e52084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:32.255339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3d694-c04f-4c6c-81ad-133200e52084 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:32.264914 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 458/927] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Aug 11 16:13:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:32.266649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3d694-c04f-4c6c-81ad-133200e52084 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:32.280646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213a871-dc2a-401e-9f93-110fdd3b9dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:32.281435 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213a871-dc2a-401e-9f93-110fdd3b9dcd None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:32.281713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213a871-dc2a-401e-9f93-110fdd3b9dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:32.281979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213a871-dc2a-401e-9f93-110fdd3b9dcd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:32.282629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213a871-dc2a-401e-9f93-110fdd3b9dcd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:32.284771 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213a871-dc2a-401e-9f93-110fdd3b9dcd None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:32.312623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 470/928] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:13:32 2022] POST /identity/v3/endpoints => generated 347 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:13:32.368329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:32.414785 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3d694-c04f-4c6c-81ad-133200e52084 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:32.465231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bedf7-de04-4685-a36c-d8d39fe9a06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:32.465864 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bedf7-de04-4685-a36c-d8d39fe9a06c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:32.466113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bedf7-de04-4685-a36c-d8d39fe9a06c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:32.466360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bedf7-de04-4685-a36c-d8d39fe9a06c None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:32.467434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bedf7-de04-4685-a36c-d8d39fe9a06c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:32.467741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bedf7-de04-4685-a36c-d8d39fe9a06c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:32.469169 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bedf7-de04-4685-a36c-d8d39fe9a06c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:32.475233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 459/929] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Aug 11 16:13:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:32.482056 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213a871-dc2a-401e-9f93-110fdd3b9dcd None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:32.487224 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:32.589903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213a871-dc2a-401e-9f93-110fdd3b9dcd None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:32.625251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb17168-3ee8-4432-b91d-56a0ed44b633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:32.626165 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb17168-3ee8-4432-b91d-56a0ed44b633 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:32.626667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb17168-3ee8-4432-b91d-56a0ed44b633 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:32.627142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb17168-3ee8-4432-b91d-56a0ed44b633 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:32.628055 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb17168-3ee8-4432-b91d-56a0ed44b633 None admin] RBAC: Adding query filter params (interface=public, service_id=169654d260cd48cf8924bf393789091a, region_id=RegionOne) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:32.628554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb17168-3ee8-4432-b91d-56a0ed44b633 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:32.630195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb17168-3ee8-4432-b91d-56a0ed44b633 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:32.635950 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 471/930] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Aug 11 16:13:32 2022] GET /identity/v3/endpoints?service_id=169654d260cd48cf8924bf393789091a&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:32.644716 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bedf7-de04-4685-a36c-d8d39fe9a06c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:32.750627 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bedf7-de04-4685-a36c-d8d39fe9a06c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:32.776688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:32.786030 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94e43c-f425-460d-808c-d950d539d070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:32.786629 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94e43c-f425-460d-808c-d950d539d070 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:32.786904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94e43c-f425-460d-808c-d950d539d070 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:32.787175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94e43c-f425-460d-808c-d950d539d070 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:32.787824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94e43c-f425-460d-808c-d950d539d070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:32.789211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94e43c-f425-460d-808c-d950d539d070 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:32.795918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 460/931] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Aug 11 16:13:32 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:13:33.270345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615e2d-03f4-4498-aa7d-0ee4d95eca20 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:33.270890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615e2d-03f4-4498-aa7d-0ee4d95eca20 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:33.270890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615e2d-03f4-4498-aa7d-0ee4d95eca20 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:33.272375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 472/932] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:33.277713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4805bb7-aacf-4e3c-bd84-59992cdb0b1e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:33.278242 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4805bb7-aacf-4e3c-bd84-59992cdb0b1e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:33.278736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4805bb7-aacf-4e3c-bd84-59992cdb0b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:33.297838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e4805bb7-aacf-4e3c-bd84-59992cdb0b1e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:33.299390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e4805bb7-aacf-4e3c-bd84-59992cdb0b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:33.351002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea8e70-4b88-4a8c-b9d1-6d81f81968f0 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:33.351379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea8e70-4b88-4a8c-b9d1-6d81f81968f0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:33.351560 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea8e70-4b88-4a8c-b9d1-6d81f81968f0 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:33.353209 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 473/933] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:33.357892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7e16b-8688-4d1d-a131-7bd1d58a4455 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:33.358175 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7e16b-8688-4d1d-a131-7bd1d58a4455 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:33.358459 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7e16b-8688-4d1d-a131-7bd1d58a4455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:33.371876 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 461/934] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:33.377819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0bc7e16b-8688-4d1d-a131-7bd1d58a4455 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:33.379198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0bc7e16b-8688-4d1d-a131-7bd1d58a4455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:33.395274 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4805bb7-aacf-4e3c-bd84-59992cdb0b1e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:33.455148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:33.468837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 474/935] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:13:33.494644 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7e16b-8688-4d1d-a131-7bd1d58a4455 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:33.508186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4805bb7-aacf-4e3c-bd84-59992cdb0b1e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:33.535818 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:33.554304 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334272e-6fca-4163-acd6-1d24086ab828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:33.555334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334272e-6fca-4163-acd6-1d24086ab828 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:33.555614 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334272e-6fca-4163-acd6-1d24086ab828 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:33.555887 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334272e-6fca-4163-acd6-1d24086ab828 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:33.570791 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334272e-6fca-4163-acd6-1d24086ab828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-7334272e-6fca-4163-acd6-1d24086ab828 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:33.577822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:33.578830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:33.580354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:33.580354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:33.580354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:33.580354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:33.580354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:33.580354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:33.580354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:33.580354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:33.580354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:33.580354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:33.580354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 16:13:33.580354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:33.580354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 462/936] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Aug 11 16:13:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:33.585521 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334272e-6fca-4163-acd6-1d24086ab828 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:33.622289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7e16b-8688-4d1d-a131-7bd1d58a4455 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:33.669969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3e085-bf58-49f0-bffd-c67b694fc640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:33.671509 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3e085-bf58-49f0-bffd-c67b694fc640 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:33.672330 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3e085-bf58-49f0-bffd-c67b694fc640 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:33.672854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3e085-bf58-49f0-bffd-c67b694fc640 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:33.673932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3e085-bf58-49f0-bffd-c67b694fc640 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:33.676447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3e085-bf58-49f0-bffd-c67b694fc640 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:33.679765 dv-cinder-852208-4-smb devstack@keystone.service[81408]: WARNING keystone.server.flask.common [None req-9be3e085-bf58-49f0-bffd-c67b694fc640 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 11 16:13:33.704838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.sql.core [None req-9be3e085-bf58-49f0-bffd-c67b694fc640 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 11 16:13:33.704838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 11 16:13:33.704838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [parameters: {'id': 'ee859a725490437aa81723ba41caefd8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 11 16:13:33.704838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81408) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 11 16:13:33.706694 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334272e-6fca-4163-acd6-1d24086ab828 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:33.715356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-9be3e085-bf58-49f0-bffd-c67b694fc640 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ee859a725490437aa81723ba41caefd8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ee859a725490437aa81723ba41caefd8. Aug 11 16:13:33.715356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:33.715356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 16:13:33.715356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 16:13:33.715356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 16:13:33.715356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 16:13:33.715356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 16:13:33.715356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 16:13:33.715356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 16:13:33.715356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application conn.query(q) Aug 11 16:13:33.715356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 16:13:33.715356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 16:13:33.715356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result.read() Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 11 16:13:33.716137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application next(self.gen) Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application yield resource Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application next(self.gen) Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.session.rollback() Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.force_reraise() Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise self.value Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application session.commit() Aug 11 16:13:33.717122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._prepare_impl() Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.session.flush() Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._flush(objects) Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application compat.raise_( Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application flush_context.execute() Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 11 16:13:33.718004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rec.execute(self) Aug 11 16:13:33.724743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 11 16:13:33.724743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 11 16:13:33.724743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 11 16:13:33.724743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 11 16:13:33.724743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 11 16:13:33.724743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 11 16:13:33.724743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 11 16:13:33.724743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 11 16:13:33.724743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 11 16:13:33.724743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 11 16:13:33.724743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 11 16:13:33.724743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 11 16:13:33.724743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 11 16:13:33.724743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 11 16:13:33.724743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application conn.query(q) Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result.read() Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 16:13:33.725846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 16:13:33.726994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 16:13:33.726994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 16:13:33.726994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 16:13:33.726994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 16:13:33.726994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 16:13:33.726994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 16:13:33.726994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 11 16:13:33.726994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 11 16:13:33.726994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [parameters: {'id': 'ee859a725490437aa81723ba41caefd8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 11 16:13:33.726994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 11 16:13:33.726994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:33.726994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:33.726994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:33.726994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:33.726994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:33.728479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:33.730445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:33.730445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 11 16:13:33.730445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 11 16:13:33.730445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:33.730445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:33.730445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 11 16:13:33.730445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 11 16:13:33.730445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ee859a725490437aa81723ba41caefd8. Aug 11 16:13:33.730445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:33.730445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 475/937] 10.222.0.40 () {60 vars in 1140 bytes} [Thu Aug 11 16:13:33 2022] POST /identity/v3/projects => generated 262 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:33.730445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3e085-bf58-49f0-bffd-c67b694fc640 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:33.759873 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa40bd-09d5-4a94-80c7-a3c1e3868ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:33.760830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa40bd-09d5-4a94-80c7-a3c1e3868ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:33.761313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa40bd-09d5-4a94-80c7-a3c1e3868ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:33.761764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa40bd-09d5-4a94-80c7-a3c1e3868ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:33.762632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa40bd-09d5-4a94-80c7-a3c1e3868ca5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:33.763132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa40bd-09d5-4a94-80c7-a3c1e3868ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:33.764771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa40bd-09d5-4a94-80c7-a3c1e3868ca5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:33.774001 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 463/938] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Aug 11 16:13:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:33.780719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa40bd-09d5-4a94-80c7-a3c1e3868ca5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:33.789439 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:33.830456 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:33.838286 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3e085-bf58-49f0-bffd-c67b694fc640 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:33.875337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6862f5f-9c26-463d-9b09-19fa42b283e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:33.876155 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6862f5f-9c26-463d-9b09-19fa42b283e6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:33.876494 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6862f5f-9c26-463d-9b09-19fa42b283e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:33.876879 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6862f5f-9c26-463d-9b09-19fa42b283e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:33.886091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6862f5f-9c26-463d-9b09-19fa42b283e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:33.887850 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6862f5f-9c26-463d-9b09-19fa42b283e6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:33.895962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa40bd-09d5-4a94-80c7-a3c1e3868ca5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:33.898999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-b6862f5f-9c26-463d-9b09-19fa42b283e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:33.898999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:33.898999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:33.898999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:33.898999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:33.898999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:33.898999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:33.898999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:33.898999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:33.898999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:33.898999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:33.898999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:33.898999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:33.898999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:33.898999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:33.899852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:33.900778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:33.900778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:33.900778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:33.900778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:33.900778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:33.900778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:33.900778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:33.900778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:33.905361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 476/939] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:33.906620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6862f5f-9c26-463d-9b09-19fa42b283e6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:33.943788 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d6678-fe25-4017-b549-cf97aa23c642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:33.944837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d6678-fe25-4017-b549-cf97aa23c642 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:33.945209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d6678-fe25-4017-b549-cf97aa23c642 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:33.946015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d6678-fe25-4017-b549-cf97aa23c642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:33.962772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d6678-fe25-4017-b549-cf97aa23c642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:33.964314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d6678-fe25-4017-b549-cf97aa23c642 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a57d6678-fe25-4017-b549-cf97aa23c642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:33.980719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:33.981746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:33.982626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:33.982626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:33.982626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:33.982626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 464/940] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:33.988459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d6678-fe25-4017-b549-cf97aa23c642 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:34.021656 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6862f5f-9c26-463d-9b09-19fa42b283e6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:34.036655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:34.058290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed6991-e0be-4884-9a2b-39a25784f2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:34.058898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed6991-e0be-4884-9a2b-39a25784f2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:34.059177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed6991-e0be-4884-9a2b-39a25784f2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:34.059450 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed6991-e0be-4884-9a2b-39a25784f2e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:34.060111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed6991-e0be-4884-9a2b-39a25784f2e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:34.060413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed6991-e0be-4884-9a2b-39a25784f2e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:34.061927 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed6991-e0be-4884-9a2b-39a25784f2e2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:34.083114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 477/941] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Aug 11 16:13:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:34.093320 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:34.102032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d6678-fe25-4017-b549-cf97aa23c642 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:34.141268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6704ebd-4028-405c-9c2c-4e0f41cfb9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:34.142298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6704ebd-4028-405c-9c2c-4e0f41cfb9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:34.143343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6704ebd-4028-405c-9c2c-4e0f41cfb9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:34.143837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6704ebd-4028-405c-9c2c-4e0f41cfb9c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:34.144736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6704ebd-4028-405c-9c2c-4e0f41cfb9c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:34.145269 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6704ebd-4028-405c-9c2c-4e0f41cfb9c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:34.146871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6704ebd-4028-405c-9c2c-4e0f41cfb9c0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:34.160987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 465/942] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:34.167056 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed6991-e0be-4884-9a2b-39a25784f2e2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:34.278599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed6991-e0be-4884-9a2b-39a25784f2e2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:34.313752 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb8223-991a-4753-ab6f-3e822547d578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:34.315263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb8223-991a-4753-ab6f-3e822547d578 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:34.315760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb8223-991a-4753-ab6f-3e822547d578 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:34.316239 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb8223-991a-4753-ab6f-3e822547d578 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:34.324524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb8223-991a-4753-ab6f-3e822547d578 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:34.326269 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb8223-991a-4753-ab6f-3e822547d578 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-74eb8223-991a-4753-ab6f-3e822547d578 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:34.338338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:34.339280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:34.340215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:34.340215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:34.340215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:34.340215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:34.340215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:34.340215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:34.340215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:34.340215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:34.340215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 16:13:34.340215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:34.340775 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 478/943] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Aug 11 16:13:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:34.346457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6704ebd-4028-405c-9c2c-4e0f41cfb9c0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:34.467170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6704ebd-4028-405c-9c2c-4e0f41cfb9c0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:34.504493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01070b9a-0698-4e6a-bb94-854acc48c6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:34.505130 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01070b9a-0698-4e6a-bb94-854acc48c6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:34.505403 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01070b9a-0698-4e6a-bb94-854acc48c6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:34.505669 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01070b9a-0698-4e6a-bb94-854acc48c6b7 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:34.506401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01070b9a-0698-4e6a-bb94-854acc48c6b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:34.506702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01070b9a-0698-4e6a-bb94-854acc48c6b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:34.508109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01070b9a-0698-4e6a-bb94-854acc48c6b7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:34.528195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 466/944] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Aug 11 16:13:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:34.533543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01070b9a-0698-4e6a-bb94-854acc48c6b7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:34.536728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb786eb4-860f-4a36-8edd-525925604c27 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:34.537276 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb786eb4-860f-4a36-8edd-525925604c27 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:34.537806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb786eb4-860f-4a36-8edd-525925604c27 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:34.543933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 479/945] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:34.545534 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c4686-e992-44b7-9938-705b6a986bfb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:34.546047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c4686-e992-44b7-9938-705b6a986bfb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:34.546530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c4686-e992-44b7-9938-705b6a986bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:34.567350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-139c4686-e992-44b7-9938-705b6a986bfb None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:34.569360 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-139c4686-e992-44b7-9938-705b6a986bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:34.598585 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:34.612983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:34.652821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01070b9a-0698-4e6a-bb94-854acc48c6b7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:34.653198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 480/946] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:34.668249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c4686-e992-44b7-9938-705b6a986bfb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:34.683819 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68095935-f2c5-4c62-af6b-981a84ff510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:34.684401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68095935-f2c5-4c62-af6b-981a84ff510e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:34.684718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68095935-f2c5-4c62-af6b-981a84ff510e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:34.684991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68095935-f2c5-4c62-af6b-981a84ff510e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:34.696224 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68095935-f2c5-4c62-af6b-981a84ff510e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:34.697807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68095935-f2c5-4c62-af6b-981a84ff510e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-68095935-f2c5-4c62-af6b-981a84ff510e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:34.713420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:34.714486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:34.715464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:34.715464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:34.715464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:34.715464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 467/947] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:34.720097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68095935-f2c5-4c62-af6b-981a84ff510e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:34.783883 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c4686-e992-44b7-9938-705b6a986bfb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:34.801367 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:34.827329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38e327-0fca-4f65-b657-a980fab0f0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:34.827995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38e327-0fca-4f65-b657-a980fab0f0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:34.828738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38e327-0fca-4f65-b657-a980fab0f0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:34.829083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38e327-0fca-4f65-b657-a980fab0f0e3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:34.829955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38e327-0fca-4f65-b657-a980fab0f0e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:34.831353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38e327-0fca-4f65-b657-a980fab0f0e3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-3d38e327-0fca-4f65-b657-a980fab0f0e3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:34.844297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:34.845436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:34.846863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:34.846863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:34.846863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:34.846863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:34.846863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:34.846863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:34.846863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:34.846863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:34.846863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:34.846863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:34.846863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:34.846863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:34.846863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 16:13:34.846863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:34.846863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 481/948] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:34.854251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38e327-0fca-4f65-b657-a980fab0f0e3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:34.862225 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68095935-f2c5-4c62-af6b-981a84ff510e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:34.887161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:34.905883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922f30f-ea05-45b3-98a2-ba8a48142913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:34.906485 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922f30f-ea05-45b3-98a2-ba8a48142913 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:34.906763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922f30f-ea05-45b3-98a2-ba8a48142913 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:34.907051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922f30f-ea05-45b3-98a2-ba8a48142913 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:34.907671 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922f30f-ea05-45b3-98a2-ba8a48142913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:34.907969 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922f30f-ea05-45b3-98a2-ba8a48142913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:34.909895 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922f30f-ea05-45b3-98a2-ba8a48142913 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:34.923682 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 468/949] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:34.926652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd3dee-1a9b-4cf9-a49d-72c368ffbfec None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:34.926941 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd3dee-1a9b-4cf9-a49d-72c368ffbfec None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:34.927215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd3dee-1a9b-4cf9-a49d-72c368ffbfec None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:34.929873 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 469/950] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:34.930747 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd3dee-1a9b-4cf9-a49d-72c368ffbfec None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:34.987746 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38e327-0fca-4f65-b657-a980fab0f0e3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:35.027349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbe240-e471-4447-a2e0-dbb5cb352150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:35.028011 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbe240-e471-4447-a2e0-dbb5cb352150 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:35.028295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbe240-e471-4447-a2e0-dbb5cb352150 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:35.028650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbe240-e471-4447-a2e0-dbb5cb352150 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:35.029289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbe240-e471-4447-a2e0-dbb5cb352150 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:35.029590 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbe240-e471-4447-a2e0-dbb5cb352150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:35.031004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbe240-e471-4447-a2e0-dbb5cb352150 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:35.042404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 482/951] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Aug 11 16:13:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:35.042404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2ff5c-1e60-4976-a0db-ce496cba8947 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:35.042404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2ff5c-1e60-4976-a0db-ce496cba8947 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:35.042404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2ff5c-1e60-4976-a0db-ce496cba8947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:35.062068 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e5b2ff5c-1e60-4976-a0db-ce496cba8947 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:35.063257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e5b2ff5c-1e60-4976-a0db-ce496cba8947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:35.066696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd3dee-1a9b-4cf9-a49d-72c368ffbfec None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:35.096617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:35.114843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aab1ec-cb28-4014-a42a-5b823a9e3127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:35.115811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aab1ec-cb28-4014-a42a-5b823a9e3127 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:35.116153 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aab1ec-cb28-4014-a42a-5b823a9e3127 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:35.116521 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aab1ec-cb28-4014-a42a-5b823a9e3127 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:35.123292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aab1ec-cb28-4014-a42a-5b823a9e3127 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:35.124759 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aab1ec-cb28-4014-a42a-5b823a9e3127 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:35.135921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-d5aab1ec-cb28-4014-a42a-5b823a9e3127 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:35.135921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:35.135921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:35.135921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:35.135921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:35.135921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:35.135921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:35.135921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:35.135921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:35.135921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:35.135921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:35.135921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:35.135921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:35.135921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:35.135921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:35.136909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:35.138223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:35.138223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:35.138223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:35.138223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:35.138223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:35.138223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:35.138223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:35.138223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:35.138223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 470/952] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:35.139185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aab1ec-cb28-4014-a42a-5b823a9e3127 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:35.158219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 483/953] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:35.161735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2ff5c-1e60-4976-a0db-ce496cba8947 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:35.196211 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:35.267264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aab1ec-cb28-4014-a42a-5b823a9e3127 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:35.303517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2ff5c-1e60-4976-a0db-ce496cba8947 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:35.306289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13311c-0329-4171-9df3-081455281703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:35.306965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13311c-0329-4171-9df3-081455281703 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:35.307312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13311c-0329-4171-9df3-081455281703 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:35.308167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13311c-0329-4171-9df3-081455281703 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:35.309714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13311c-0329-4171-9df3-081455281703 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:35.310230 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13311c-0329-4171-9df3-081455281703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:35.311658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13311c-0329-4171-9df3-081455281703 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:35.328628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 471/954] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Aug 11 16:13:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:35.328628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13311c-0329-4171-9df3-081455281703 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:35.359863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd9b03-5131-4e8e-8f32-0a0ae1c8ba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:35.360416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd9b03-5131-4e8e-8f32-0a0ae1c8ba3d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:35.360747 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd9b03-5131-4e8e-8f32-0a0ae1c8ba3d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:35.361019 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd9b03-5131-4e8e-8f32-0a0ae1c8ba3d None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:35.362774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd9b03-5131-4e8e-8f32-0a0ae1c8ba3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:35.363089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd9b03-5131-4e8e-8f32-0a0ae1c8ba3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:35.365349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd9b03-5131-4e8e-8f32-0a0ae1c8ba3d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:35.387314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 484/955] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:35.400303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd9b03-5131-4e8e-8f32-0a0ae1c8ba3d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:35.409870 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:35.527648 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13311c-0329-4171-9df3-081455281703 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:35.550980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:35.571240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd9b03-5131-4e8e-8f32-0a0ae1c8ba3d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:35.574889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98762f-68f6-426f-a71e-1d1750026d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:35.576164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98762f-68f6-426f-a71e-1d1750026d5e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:35.576707 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98762f-68f6-426f-a71e-1d1750026d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:35.577195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98762f-68f6-426f-a71e-1d1750026d5e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:35.577979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98762f-68f6-426f-a71e-1d1750026d5e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:35.579643 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98762f-68f6-426f-a71e-1d1750026d5e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-be98762f-68f6-426f-a71e-1d1750026d5e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:35.589623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:35.590736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:35.591698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:35.591698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:35.591698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:35.591698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:35.591698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:35.591698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:35.591698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:35.591698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:35.591698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:35.591698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:35.591698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:35.591698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:35.591698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 16:13:35.591698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:35.594541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 472/956] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Aug 11 16:13:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:35.602962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98762f-68f6-426f-a71e-1d1750026d5e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:35.607750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebcd7e-9c8e-4b22-910d-b0abad334e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:35.608692 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebcd7e-9c8e-4b22-910d-b0abad334e78 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:35.609148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebcd7e-9c8e-4b22-910d-b0abad334e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:35.609579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebcd7e-9c8e-4b22-910d-b0abad334e78 None admin] PATH_INFO: `/v3/projects/3b0514f7236d42d1955e895adaf41389/users/732213990cf84fc198db9c47866fb687/roles/a785c8ffc53845be9d11e2cafc895ffe` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:35.612659 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebcd7e-9c8e-4b22-910d-b0abad334e78 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0514f7236d42d1955e895adaf41389, user_id=732213990cf84fc198db9c47866fb687, role_id=a785c8ffc53845be9d11e2cafc895ffe)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:35.614372 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebcd7e-9c8e-4b22-910d-b0abad334e78 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:35.632638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 485/957] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:13:35 2022] PUT /identity/v3/projects/3b0514f7236d42d1955e895adaf41389/users/732213990cf84fc198db9c47866fb687/roles/a785c8ffc53845be9d11e2cafc895ffe => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:13:35.730983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98762f-68f6-426f-a71e-1d1750026d5e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:35.747141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:35.771638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a7a64-253b-4c65-8e0a-d06c1ac95632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:35.772644 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a7a64-253b-4c65-8e0a-d06c1ac95632 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:35.773092 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a7a64-253b-4c65-8e0a-d06c1ac95632 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:35.773578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a7a64-253b-4c65-8e0a-d06c1ac95632 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:35.774446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a7a64-253b-4c65-8e0a-d06c1ac95632 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:35.774897 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a7a64-253b-4c65-8e0a-d06c1ac95632 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:35.776547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a7a64-253b-4c65-8e0a-d06c1ac95632 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:35.782861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 473/958] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Aug 11 16:13:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:35.789142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebcd7e-9c8e-4b22-910d-b0abad334e78 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:35.901590 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebcd7e-9c8e-4b22-910d-b0abad334e78 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:35.936883 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89835568-9447-4d62-b9bd-74c31882d379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:35.937495 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89835568-9447-4d62-b9bd-74c31882d379 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:35.937837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89835568-9447-4d62-b9bd-74c31882d379 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:35.938119 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89835568-9447-4d62-b9bd-74c31882d379 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:35.938758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89835568-9447-4d62-b9bd-74c31882d379 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:35.939061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89835568-9447-4d62-b9bd-74c31882d379 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:35.940470 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89835568-9447-4d62-b9bd-74c31882d379 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:35.949021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 486/959] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Aug 11 16:13:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:35.951789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a7a64-253b-4c65-8e0a-d06c1ac95632 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:36.059058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a7a64-253b-4c65-8e0a-d06c1ac95632 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:36.094722 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9424549-ada7-456d-99b0-4a87045f3aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:36.095593 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9424549-ada7-456d-99b0-4a87045f3aae None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:36.096602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9424549-ada7-456d-99b0-4a87045f3aae None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:36.097039 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9424549-ada7-456d-99b0-4a87045f3aae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:36.097866 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9424549-ada7-456d-99b0-4a87045f3aae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:36.099382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9424549-ada7-456d-99b0-4a87045f3aae None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:36.127332 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 474/960] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:13:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:13:36.284870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81962e-bea3-4bac-92c8-91a1f454226b None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:36.285063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81962e-bea3-4bac-92c8-91a1f454226b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:36.285329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81962e-bea3-4bac-92c8-91a1f454226b None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:36.286678 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 487/961] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:36.292164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a374897-fa59-4a73-8c04-eeb857306cef None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:36.292454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a374897-fa59-4a73-8c04-eeb857306cef None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:36.292760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a374897-fa59-4a73-8c04-eeb857306cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:36.312896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9a374897-fa59-4a73-8c04-eeb857306cef None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:36.314094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9a374897-fa59-4a73-8c04-eeb857306cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:36.341714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:36.394490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 475/962] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:36.416264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81962e-bea3-4bac-92c8-91a1f454226b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:36.426759 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:36.528383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81962e-bea3-4bac-92c8-91a1f454226b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:36.563617 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4c855-fa59-482a-8035-622604bad9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:36.564232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4c855-fa59-482a-8035-622604bad9fa None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:36.564619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4c855-fa59-482a-8035-622604bad9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:36.564898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4c855-fa59-482a-8035-622604bad9fa None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:36.565599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4c855-fa59-482a-8035-622604bad9fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:36.567032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4c855-fa59-482a-8035-622604bad9fa None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:36.581590 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.sql.core [None req-bbc4c855-fa59-482a-8035-622604bad9fa None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 11 16:13:36.581590 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 11 16:13:36.581590 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [parameters: {'user_id': 'e41d29789a5540a7b0ae59198426c7fa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 11 16:13:36.581590 dv-cinder-852208-4-smb devstack@keystone.service[81408]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81408) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 11 16:13:36.589397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-bbc4c855-fa59-482a-8035-622604bad9fa None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 11 16:13:36.589397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:36.589397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 16:13:36.589397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 16:13:36.589397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 16:13:36.589397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 16:13:36.589397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 16:13:36.589397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 16:13:36.589397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 16:13:36.589397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application conn.query(q) Aug 11 16:13:36.589397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 16:13:36.589397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 16:13:36.589397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 16:13:36.589397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result.read() Aug 11 16:13:36.589397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 16:13:36.590363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application next(self.gen) Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application yield resource Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application next(self.gen) Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.session.rollback() Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.force_reraise() Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise self.value Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application session.commit() Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 11 16:13:36.591326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._prepare_impl() Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.session.flush() Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._flush(objects) Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application compat.raise_( Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application flush_context.execute() Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rec.execute(self) Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 11 16:13:36.592223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 16:13:36.593185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application conn.query(q) Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result.read() Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 16:13:36.594049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 16:13:36.594872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 16:13:36.594872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 16:13:36.594872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 16:13:36.594872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 16:13:36.594872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 11 16:13:36.594872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 11 16:13:36.594872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e41d29789a5540a7b0ae59198426c7fa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 11 16:13:36.594872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 11 16:13:36.594872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:36.594872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:36.594872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:36.594872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:36.594872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:36.594872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:36.594872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 11 16:13:36.595670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 11 16:13:36.601389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 11 16:13:36.601389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 11 16:13:36.601389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 11 16:13:36.601389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 11 16:13:36.601389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 11 16:13:36.601389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:36.601389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 488/963] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Aug 11 16:13:36 2022] POST /identity/v3/users => generated 160 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:36.601837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a374897-fa59-4a73-8c04-eeb857306cef None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:36.710603 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a374897-fa59-4a73-8c04-eeb857306cef None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:36.746538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7e5f2-bc94-4da5-9e0d-447f4f68dfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:36.747338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7e5f2-bc94-4da5-9e0d-447f4f68dfcc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:36.747676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7e5f2-bc94-4da5-9e0d-447f4f68dfcc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:36.748005 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7e5f2-bc94-4da5-9e0d-447f4f68dfcc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:36.755955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7e5f2-bc94-4da5-9e0d-447f4f68dfcc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:36.757484 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7e5f2-bc94-4da5-9e0d-447f4f68dfcc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-d2f7e5f2-bc94-4da5-9e0d-447f4f68dfcc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:36.769231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:36.771361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:36.773606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:36.773606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:36.773606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:36.773606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:36.773606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:36.773606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:36.773606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:36.773606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:36.773606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 16:13:36.773606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:36.776629 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 476/964] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:13:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:36.778248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4c855-fa59-482a-8035-622604bad9fa None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:36.854025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:36.889954 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4c855-fa59-482a-8035-622604bad9fa None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:36.933845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124db8f-4762-4dc2-97c6-74b6ea30ff70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:36.934459 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124db8f-4762-4dc2-97c6-74b6ea30ff70 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:36.934740 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124db8f-4762-4dc2-97c6-74b6ea30ff70 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:36.935012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124db8f-4762-4dc2-97c6-74b6ea30ff70 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:36.935771 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124db8f-4762-4dc2-97c6-74b6ea30ff70 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:36.936076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124db8f-4762-4dc2-97c6-74b6ea30ff70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:36.937828 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124db8f-4762-4dc2-97c6-74b6ea30ff70 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:36.980740 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 489/965] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Aug 11 16:13:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:37.530522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9134c7f-6210-4adf-a84e-b41a4e07a6eb None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:37.530855 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9134c7f-6210-4adf-a84e-b41a4e07a6eb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:37.531103 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9134c7f-6210-4adf-a84e-b41a4e07a6eb None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:37.532550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 477/966] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:37.538134 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478eb0c-20f5-4a32-a424-9ce6d58c52cc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:37.538596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478eb0c-20f5-4a32-a424-9ce6d58c52cc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:37.538680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478eb0c-20f5-4a32-a424-9ce6d58c52cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:37.557069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7478eb0c-20f5-4a32-a424-9ce6d58c52cc None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:37.558564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7478eb0c-20f5-4a32-a424-9ce6d58c52cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:37.628007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 490/967] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:37.650293 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9134c7f-6210-4adf-a84e-b41a4e07a6eb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:37.671943 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:37.749188 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13341-4d52-49bd-bf90-ae929046f6d4 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:37.749482 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13341-4d52-49bd-bf90-ae929046f6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:37.749667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13341-4d52-49bd-bf90-ae929046f6d4 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:37.751178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 491/968] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:37.755817 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963889cf-f8eb-4589-a0c5-eec1ca429bd1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:37.756096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963889cf-f8eb-4589-a0c5-eec1ca429bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:37.756360 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963889cf-f8eb-4589-a0c5-eec1ca429bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:37.756977 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9134c7f-6210-4adf-a84e-b41a4e07a6eb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:37.774639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-963889cf-f8eb-4589-a0c5-eec1ca429bd1 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:37.775819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-963889cf-f8eb-4589-a0c5-eec1ca429bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:37.795275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b446e-8045-4fea-b735-fbb54054fe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:37.795928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b446e-8045-4fea-b735-fbb54054fe34 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:37.796204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b446e-8045-4fea-b735-fbb54054fe34 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:37.796630 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b446e-8045-4fea-b735-fbb54054fe34 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:37.797285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b446e-8045-4fea-b735-fbb54054fe34 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:37.798634 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b446e-8045-4fea-b735-fbb54054fe34 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:37.824877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 478/969] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Aug 11 16:13:37 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:13:37.838836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:37.868768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 492/970] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:13:37.890890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b446e-8045-4fea-b735-fbb54054fe34 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:37.985164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:38.017519 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b446e-8045-4fea-b735-fbb54054fe34 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:38.055945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be37294-144e-4e92-83c8-71514840bfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:38.056960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be37294-144e-4e92-83c8-71514840bfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:38.057409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be37294-144e-4e92-83c8-71514840bfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:38.057817 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be37294-144e-4e92-83c8-71514840bfa9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:38.072820 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be37294-144e-4e92-83c8-71514840bfa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-1be37294-144e-4e92-83c8-71514840bfa9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:38.077486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:38.078449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:38.079318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:38.079318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:38.079318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:38.079318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:38.079318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:38.079318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:38.079318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:38.079318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:38.079318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:38.079318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:38.079318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 16:13:38.079318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:38.079318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 479/971] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Aug 11 16:13:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:38.086906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963889cf-f8eb-4589-a0c5-eec1ca429bd1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:38.178862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8821219-cdb3-4fbd-ba97-746ce58ae268 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:38.179147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8821219-cdb3-4fbd-ba97-746ce58ae268 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:38.179416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8821219-cdb3-4fbd-ba97-746ce58ae268 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:38.180904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 480/972] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:38.185446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000bf1d-f191-4ddd-951b-74be1cbbedd3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:38.185726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000bf1d-f191-4ddd-951b-74be1cbbedd3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:38.185995 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000bf1d-f191-4ddd-951b-74be1cbbedd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:38.186754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963889cf-f8eb-4589-a0c5-eec1ca429bd1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:38.204557 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c000bf1d-f191-4ddd-951b-74be1cbbedd3 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:38.206318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c000bf1d-f191-4ddd-951b-74be1cbbedd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:38.222457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47630e46-8b14-4238-81b8-0474d6c65178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:38.223031 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47630e46-8b14-4238-81b8-0474d6c65178 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:38.223309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47630e46-8b14-4238-81b8-0474d6c65178 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:38.223579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47630e46-8b14-4238-81b8-0474d6c65178 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:38.224251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47630e46-8b14-4238-81b8-0474d6c65178 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:38.224552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47630e46-8b14-4238-81b8-0474d6c65178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:38.225924 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47630e46-8b14-4238-81b8-0474d6c65178 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:38.238729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 493/973] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Aug 11 16:13:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:38.240145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47630e46-8b14-4238-81b8-0474d6c65178 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:38.284930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 481/974] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:13:38.294238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:38.309522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000bf1d-f191-4ddd-951b-74be1cbbedd3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:38.355132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47630e46-8b14-4238-81b8-0474d6c65178 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:38.376729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:38.392067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f02568-143a-4013-b685-cf5e7b1821e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:38.392782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f02568-143a-4013-b685-cf5e7b1821e6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:38.393063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f02568-143a-4013-b685-cf5e7b1821e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:38.393338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f02568-143a-4013-b685-cf5e7b1821e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:38.404098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f02568-143a-4013-b685-cf5e7b1821e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:38.405574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f02568-143a-4013-b685-cf5e7b1821e6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:38.414096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000bf1d-f191-4ddd-951b-74be1cbbedd3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-74f02568-143a-4013-b685-cf5e7b1821e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:38.421451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:38.422397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:38.423257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:38.423257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:38.423257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:38.423257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 494/975] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:38.428609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f02568-143a-4013-b685-cf5e7b1821e6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:38.453692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981111fc-aea7-4dc7-8107-ff572c8025c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:38.454521 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981111fc-aea7-4dc7-8107-ff572c8025c1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:38.454766 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981111fc-aea7-4dc7-8107-ff572c8025c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:38.455979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981111fc-aea7-4dc7-8107-ff572c8025c1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:38.456479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981111fc-aea7-4dc7-8107-ff572c8025c1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:38.457910 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981111fc-aea7-4dc7-8107-ff572c8025c1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-981111fc-aea7-4dc7-8107-ff572c8025c1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:38.467115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:38.468178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:38.469035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:38.469035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:38.469035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:38.469035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:38.469035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:38.469035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:38.469035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:38.469035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:38.469035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:38.469035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:38.469035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:38.469035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:38.469035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 16:13:38.469035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:38.472280 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 482/976] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Aug 11 16:13:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:38.478265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981111fc-aea7-4dc7-8107-ff572c8025c1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:38.543667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:38.550364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f02568-143a-4013-b685-cf5e7b1821e6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:38.586241 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de20f0-1426-42dc-8baf-0e9f50bf34db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:38.586926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de20f0-1426-42dc-8baf-0e9f50bf34db None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:38.587135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de20f0-1426-42dc-8baf-0e9f50bf34db None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:38.587234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981111fc-aea7-4dc7-8107-ff572c8025c1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:38.587409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de20f0-1426-42dc-8baf-0e9f50bf34db None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:38.588496 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de20f0-1426-42dc-8baf-0e9f50bf34db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:38.589141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de20f0-1426-42dc-8baf-0e9f50bf34db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:38.591620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de20f0-1426-42dc-8baf-0e9f50bf34db None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:38.610647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 495/977] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:38.611759 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de20f0-1426-42dc-8baf-0e9f50bf34db None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:38.622173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:38.628425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e471b17-c65f-44eb-90de-5db6cf806382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:38.629057 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471b17-c65f-44eb-90de-5db6cf806382 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:38.629385 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471b17-c65f-44eb-90de-5db6cf806382 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:38.629662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471b17-c65f-44eb-90de-5db6cf806382 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:38.630283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e471b17-c65f-44eb-90de-5db6cf806382 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:38.630584 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e471b17-c65f-44eb-90de-5db6cf806382 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:38.631935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e471b17-c65f-44eb-90de-5db6cf806382 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:38.637008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 483/978] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Aug 11 16:13:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:38.643141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e471b17-c65f-44eb-90de-5db6cf806382 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:38.721994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de20f0-1426-42dc-8baf-0e9f50bf34db None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:38.746982 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e471b17-c65f-44eb-90de-5db6cf806382 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:38.758085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc105f-42cd-47b5-bc40-2d0b2b1e1233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:38.758703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc105f-42cd-47b5-bc40-2d0b2b1e1233 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:38.759000 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc105f-42cd-47b5-bc40-2d0b2b1e1233 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:38.759252 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc105f-42cd-47b5-bc40-2d0b2b1e1233 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:38.766684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc105f-42cd-47b5-bc40-2d0b2b1e1233 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:38.768799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc105f-42cd-47b5-bc40-2d0b2b1e1233 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2ddc105f-42cd-47b5-bc40-2d0b2b1e1233 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:38.780753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:38.781724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:38.782756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:38.782756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:38.782756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:38.782756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:38.782756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:38.782756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:38.782756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:38.782756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:38.782756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 16:13:38.782756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:38.783379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd16b75-02eb-462e-9d81-00da9dda47da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:38.783379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd16b75-02eb-462e-9d81-00da9dda47da None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:38.783379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd16b75-02eb-462e-9d81-00da9dda47da None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:38.783590 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 496/979] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Aug 11 16:13:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:38.784854 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd16b75-02eb-462e-9d81-00da9dda47da None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:38.785507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd16b75-02eb-462e-9d81-00da9dda47da None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:38.785809 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd16b75-02eb-462e-9d81-00da9dda47da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:38.787193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd16b75-02eb-462e-9d81-00da9dda47da None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:38.787394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc105f-42cd-47b5-bc40-2d0b2b1e1233 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:38.792465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 484/980] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Aug 11 16:13:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:38.798261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd16b75-02eb-462e-9d81-00da9dda47da None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:38.810871 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:38.860068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:38.902894 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc105f-42cd-47b5-bc40-2d0b2b1e1233 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:38.908477 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd16b75-02eb-462e-9d81-00da9dda47da None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:38.938132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c1e1a-68e9-4dfa-a705-560a32271841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:38.938750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c1e1a-68e9-4dfa-a705-560a32271841 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:38.939027 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c1e1a-68e9-4dfa-a705-560a32271841 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:38.939300 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c1e1a-68e9-4dfa-a705-560a32271841 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:38.940612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c1e1a-68e9-4dfa-a705-560a32271841 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:38.940946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c1e1a-68e9-4dfa-a705-560a32271841 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:38.942445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c1e1a-68e9-4dfa-a705-560a32271841 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:38.945833 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1cf13-704c-4b3e-8ce9-3ddec5847212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:38.946689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1cf13-704c-4b3e-8ce9-3ddec5847212 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:38.947162 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1cf13-704c-4b3e-8ce9-3ddec5847212 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:38.947628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1cf13-704c-4b3e-8ce9-3ddec5847212 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:38.948517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1cf13-704c-4b3e-8ce9-3ddec5847212 None admin] RBAC: Adding query filter params (interface=admin, service_id=169654d260cd48cf8924bf393789091a, region_id=RegionOne) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:38.948985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1cf13-704c-4b3e-8ce9-3ddec5847212 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:38.950497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1cf13-704c-4b3e-8ce9-3ddec5847212 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:38.960082 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 485/981] 10.222.0.40 () {56 vars in 1249 bytes} [Thu Aug 11 16:13:38 2022] GET /identity/v3/endpoints?service_id=169654d260cd48cf8924bf393789091a&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:38.961956 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 497/982] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Aug 11 16:13:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:38.965636 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1cf13-704c-4b3e-8ce9-3ddec5847212 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:38.967396 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c1e1a-68e9-4dfa-a705-560a32271841 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:39.048568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:39.068226 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1cf13-704c-4b3e-8ce9-3ddec5847212 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:39.077181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c1e1a-68e9-4dfa-a705-560a32271841 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:39.090714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:39.101992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea57a9-a791-4617-b382-eeb94fb018b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:39.102597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea57a9-a791-4617-b382-eeb94fb018b7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:39.102872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea57a9-a791-4617-b382-eeb94fb018b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:39.103149 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea57a9-a791-4617-b382-eeb94fb018b7 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:39.103747 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea57a9-a791-4617-b382-eeb94fb018b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:39.105144 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea57a9-a791-4617-b382-eeb94fb018b7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:39.112197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 486/983] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Aug 11 16:13:38 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:13:39.116036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9d54-23cc-40e5-b7c6-4c0d5a449130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:39.116982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9d54-23cc-40e5-b7c6-4c0d5a449130 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:39.117481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9d54-23cc-40e5-b7c6-4c0d5a449130 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:39.117964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9d54-23cc-40e5-b7c6-4c0d5a449130 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:39.195087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a9d54-23cc-40e5-b7c6-4c0d5a449130 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:39.196976 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a9d54-23cc-40e5-b7c6-4c0d5a449130 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:39.277365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:39.306804 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 498/984] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:38 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 16:13:39.312626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea57a9-a791-4617-b382-eeb94fb018b7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:39.412567 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea57a9-a791-4617-b382-eeb94fb018b7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:39.446485 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45d863-b079-4fe6-868f-dcc627684c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:39.447111 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45d863-b079-4fe6-868f-dcc627684c77 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:39.447387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45d863-b079-4fe6-868f-dcc627684c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:39.447658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45d863-b079-4fe6-868f-dcc627684c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:39.458264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45d863-b079-4fe6-868f-dcc627684c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:39.459709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45d863-b079-4fe6-868f-dcc627684c77 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-1f45d863-b079-4fe6-868f-dcc627684c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:39.479936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:39.481132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:39.482123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:39.482123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:39.482123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:39.482609 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 487/985] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:39.487544 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9d54-23cc-40e5-b7c6-4c0d5a449130 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:39.590144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9d54-23cc-40e5-b7c6-4c0d5a449130 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:39.624120 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caec5f-b89d-4d29-8190-c9f8f5edbdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:39.624750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caec5f-b89d-4d29-8190-c9f8f5edbdd5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:39.625028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caec5f-b89d-4d29-8190-c9f8f5edbdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:39.625297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caec5f-b89d-4d29-8190-c9f8f5edbdd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:39.625935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caec5f-b89d-4d29-8190-c9f8f5edbdd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:39.626235 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caec5f-b89d-4d29-8190-c9f8f5edbdd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:39.627611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caec5f-b89d-4d29-8190-c9f8f5edbdd5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:39.643569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 499/986] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:39.644891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45d863-b079-4fe6-868f-dcc627684c77 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:39.689681 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:39.750538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45d863-b079-4fe6-868f-dcc627684c77 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:39.784160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42db4f5-a403-4b55-8644-b5c7b6f49354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:39.784816 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42db4f5-a403-4b55-8644-b5c7b6f49354 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:39.785096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42db4f5-a403-4b55-8644-b5c7b6f49354 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:39.785370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42db4f5-a403-4b55-8644-b5c7b6f49354 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:39.792079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42db4f5-a403-4b55-8644-b5c7b6f49354 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:39.793839 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42db4f5-a403-4b55-8644-b5c7b6f49354 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:39.805530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e42db4f5-a403-4b55-8644-b5c7b6f49354 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:39.805530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:39.805530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:39.805530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:39.805530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:39.805530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:39.805530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:39.805530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:39.805530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:39.805530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:39.805530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:39.805530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:39.805530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:39.805530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:39.805530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:39.806423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:39.807289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:39.807289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:39.807289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:39.807289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:39.807289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:39.807289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:39.807289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:39.807289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:39.808661 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 488/987] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:39.812489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caec5f-b89d-4d29-8190-c9f8f5edbdd5 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:39.849222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:39.879856 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49932c-864c-40ae-b821-1822ff7a0d7b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:39.880194 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49932c-864c-40ae-b821-1822ff7a0d7b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:39.880395 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49932c-864c-40ae-b821-1822ff7a0d7b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:39.881865 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 489/988] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:39.886425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4908-be30-49dc-8682-c693dc16c10f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:39.886701 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4908-be30-49dc-8682-c693dc16c10f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:39.886970 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4908-be30-49dc-8682-c693dc16c10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:39.905720 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fddc4908-be30-49dc-8682-c693dc16c10f None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:39.907055 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fddc4908-be30-49dc-8682-c693dc16c10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:39.918475 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caec5f-b89d-4d29-8190-c9f8f5edbdd5 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:39.952125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b47966-2c52-4e4c-9b67-61314107a643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:39.952757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b47966-2c52-4e4c-9b67-61314107a643 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:39.953036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b47966-2c52-4e4c-9b67-61314107a643 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:39.953309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b47966-2c52-4e4c-9b67-61314107a643 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:39.954000 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b47966-2c52-4e4c-9b67-61314107a643 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:39.954295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b47966-2c52-4e4c-9b67-61314107a643 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:39.955738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b47966-2c52-4e4c-9b67-61314107a643 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:39.967853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 500/989] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:39.974077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b47966-2c52-4e4c-9b67-61314107a643 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:39.978036 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 490/990] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:13:40.000220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc4908-be30-49dc-8682-c693dc16c10f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:40.031358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:40.080954 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:40.087780 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b47966-2c52-4e4c-9b67-61314107a643 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:40.105503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc4908-be30-49dc-8682-c693dc16c10f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:40.124975 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dd49a-930e-450d-8b17-090e8db235e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:40.125902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dd49a-930e-450d-8b17-090e8db235e3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:40.126183 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dd49a-930e-450d-8b17-090e8db235e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:40.126452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dd49a-930e-450d-8b17-090e8db235e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:40.127208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dd49a-930e-450d-8b17-090e8db235e3 None admin] RBAC: Adding query filter params (role.id=a785c8ffc53845be9d11e2cafc895ffe, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=732213990cf84fc198db9c47866fb687) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:40.127515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dd49a-930e-450d-8b17-090e8db235e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:40.129086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dd49a-930e-450d-8b17-090e8db235e3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:40.136151 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 501/991] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:39 2022] GET /identity/v3/role_assignments?user.id=732213990cf84fc198db9c47866fb687&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=a785c8ffc53845be9d11e2cafc895ffe => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:40.145536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cc88a-2c01-48c9-a7d2-d7129cf76948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:40.146286 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cc88a-2c01-48c9-a7d2-d7129cf76948 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:40.146632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cc88a-2c01-48c9-a7d2-d7129cf76948 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:40.146970 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cc88a-2c01-48c9-a7d2-d7129cf76948 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:40.147662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cc88a-2c01-48c9-a7d2-d7129cf76948 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:40.149257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cc88a-2c01-48c9-a7d2-d7129cf76948 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-bd4cc88a-2c01-48c9-a7d2-d7129cf76948 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:40.162537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:40.163604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:40.164469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:40.164469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:40.164469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:40.164469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:40.164469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:40.164469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:40.164469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:40.164469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:40.164469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:40.164469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:40.164469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:40.164469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:40.164469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 16:13:40.164469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:40.169093 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 491/992] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:40.170339 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dd49a-930e-450d-8b17-090e8db235e3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:40.281515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dd49a-930e-450d-8b17-090e8db235e3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:40.317205 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cca55d-2d15-47f4-a289-865ba400b9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:40.317975 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cca55d-2d15-47f4-a289-865ba400b9cb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:40.318387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cca55d-2d15-47f4-a289-865ba400b9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:40.318758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cca55d-2d15-47f4-a289-865ba400b9cb None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:40.319498 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cca55d-2d15-47f4-a289-865ba400b9cb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:40.319905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cca55d-2d15-47f4-a289-865ba400b9cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:40.321397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cca55d-2d15-47f4-a289-865ba400b9cb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:40.326789 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 502/993] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Aug 11 16:13:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:40.332793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cc88a-2c01-48c9-a7d2-d7129cf76948 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:40.433437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:40.441358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cc88a-2c01-48c9-a7d2-d7129cf76948 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:40.483369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfe660-5c92-408a-bfde-15f4471783d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:40.483983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfe660-5c92-408a-bfde-15f4471783d9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:40.484258 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfe660-5c92-408a-bfde-15f4471783d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:40.484529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfe660-5c92-408a-bfde-15f4471783d9 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:40.485192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfe660-5c92-408a-bfde-15f4471783d9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:40.485588 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfe660-5c92-408a-bfde-15f4471783d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:40.487648 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfe660-5c92-408a-bfde-15f4471783d9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:40.492844 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 492/994] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Aug 11 16:13:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:40.498368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cca55d-2d15-47f4-a289-865ba400b9cb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:40.524814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:40.602457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cca55d-2d15-47f4-a289-865ba400b9cb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:40.636037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dbd83-fcab-442a-bfb3-dfd23c032f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:40.636682 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dbd83-fcab-442a-bfb3-dfd23c032f0d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:40.636965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dbd83-fcab-442a-bfb3-dfd23c032f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:40.637238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dbd83-fcab-442a-bfb3-dfd23c032f0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:40.637937 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94dbd83-fcab-442a-bfb3-dfd23c032f0d None admin] RBAC: Adding query filter params (interface=public, service_id=797023ce24d84bb1ae0a07c9bde00f37, region_id=RegionOne) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:40.638243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94dbd83-fcab-442a-bfb3-dfd23c032f0d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:40.639594 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94dbd83-fcab-442a-bfb3-dfd23c032f0d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:40.649784 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 503/995] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Aug 11 16:13:40 2022] GET /identity/v3/endpoints?service_id=797023ce24d84bb1ae0a07c9bde00f37&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:40.651038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfe660-5c92-408a-bfde-15f4471783d9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:40.753266 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfe660-5c92-408a-bfde-15f4471783d9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:40.788259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3bee0-e3f5-4438-9988-82b0b29c5ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:40.789159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3bee0-e3f5-4438-9988-82b0b29c5ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:40.789619 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3bee0-e3f5-4438-9988-82b0b29c5ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:40.790170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3bee0-e3f5-4438-9988-82b0b29c5ba7 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:40.790953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3bee0-e3f5-4438-9988-82b0b29c5ba7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:40.792485 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3bee0-e3f5-4438-9988-82b0b29c5ba7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:40.804382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 493/996] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Aug 11 16:13:40 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:13:41.139159 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c286563-cf75-4d8f-816b-d9b2c200218b None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:41.139538 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c286563-cf75-4d8f-816b-d9b2c200218b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:41.139746 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c286563-cf75-4d8f-816b-d9b2c200218b None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:41.141289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 504/997] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:41.146302 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3267c-0426-4576-ab66-81f8bdf8a426 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:41.146590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3267c-0426-4576-ab66-81f8bdf8a426 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:41.146862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3267c-0426-4576-ab66-81f8bdf8a426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:41.165508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-70f3267c-0426-4576-ab66-81f8bdf8a426 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:41.166686 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-70f3267c-0426-4576-ab66-81f8bdf8a426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:41.184085 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:41.241232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 494/998] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:41.263811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c286563-cf75-4d8f-816b-d9b2c200218b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:41.352205 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:41.369572 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c286563-cf75-4d8f-816b-d9b2c200218b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:41.402762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ebd9e-2d8e-4428-805d-e8ede622a0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:41.403369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ebd9e-2d8e-4428-805d-e8ede622a0dc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:41.403649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ebd9e-2d8e-4428-805d-e8ede622a0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:41.403915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ebd9e-2d8e-4428-805d-e8ede622a0dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:41.404501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ebd9e-2d8e-4428-805d-e8ede622a0dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:41.405880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ebd9e-2d8e-4428-805d-e8ede622a0dc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-952ebd9e-2d8e-4428-805d-e8ede622a0dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:41.414536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:41.415540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:41.416383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:41.416383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:41.416383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:41.416383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:41.416383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:41.416383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:41.416383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:41.416383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:41.416383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:41.416383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:41.416383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:41.416383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:41.416383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 16:13:41.416383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:41.420700 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 505/999] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Aug 11 16:13:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:41.421981 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3267c-0426-4576-ab66-81f8bdf8a426 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:41.528719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3267c-0426-4576-ab66-81f8bdf8a426 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:41.562749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d39591-4889-4a80-8d30-0d3acf3ff91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:41.563354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d39591-4889-4a80-8d30-0d3acf3ff91d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:41.563631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d39591-4889-4a80-8d30-0d3acf3ff91d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:41.563903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d39591-4889-4a80-8d30-0d3acf3ff91d None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:41.565248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d39591-4889-4a80-8d30-0d3acf3ff91d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:41.565550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d39591-4889-4a80-8d30-0d3acf3ff91d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:41.566900 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d39591-4889-4a80-8d30-0d3acf3ff91d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:41.571773 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 495/1000] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Aug 11 16:13:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:41.577219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ebd9e-2d8e-4428-805d-e8ede622a0dc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:41.681504 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ebd9e-2d8e-4428-805d-e8ede622a0dc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:41.714777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ed92f-5a8d-4995-ade0-5c83e9797872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:41.715391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ed92f-5a8d-4995-ade0-5c83e9797872 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:41.715661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ed92f-5a8d-4995-ade0-5c83e9797872 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:41.715933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ed92f-5a8d-4995-ade0-5c83e9797872 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:41.716559 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ed92f-5a8d-4995-ade0-5c83e9797872 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:41.716891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ed92f-5a8d-4995-ade0-5c83e9797872 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:41.718349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ed92f-5a8d-4995-ade0-5c83e9797872 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:41.728473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 506/1001] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Aug 11 16:13:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:41.729736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d39591-4889-4a80-8d30-0d3acf3ff91d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:41.749050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:41.834139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d39591-4889-4a80-8d30-0d3acf3ff91d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:41.869590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f95c2-2565-4590-9e8b-bea3b97044dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:41.870199 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f95c2-2565-4590-9e8b-bea3b97044dc None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:41.870481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f95c2-2565-4590-9e8b-bea3b97044dc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:41.870750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f95c2-2565-4590-9e8b-bea3b97044dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:41.871406 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f95c2-2565-4590-9e8b-bea3b97044dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:41.872785 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f95c2-2565-4590-9e8b-bea3b97044dc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:41.889597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 496/1002] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:13:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:13:42.186767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843cad6-726e-4ffc-a117-4c568c403849 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:42.187146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843cad6-726e-4ffc-a117-4c568c403849 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:42.187341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843cad6-726e-4ffc-a117-4c568c403849 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:42.188800 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 507/1003] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:42.193821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed32ac2-1bf2-49a0-9833-1afa49c0fd04 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:42.194179 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed32ac2-1bf2-49a0-9833-1afa49c0fd04 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:42.194526 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed32ac2-1bf2-49a0-9833-1afa49c0fd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:42.212983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4ed32ac2-1bf2-49a0-9833-1afa49c0fd04 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:42.214168 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4ed32ac2-1bf2-49a0-9833-1afa49c0fd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:42.288240 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 497/1004] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:42.310173 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843cad6-726e-4ffc-a117-4c568c403849 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:42.326655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:42.417477 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843cad6-726e-4ffc-a117-4c568c403849 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:42.451580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc01ce-1900-43cf-a779-6feb1549df34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:42.452178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc01ce-1900-43cf-a779-6feb1549df34 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:42.452458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc01ce-1900-43cf-a779-6feb1549df34 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:42.452757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc01ce-1900-43cf-a779-6feb1549df34 None admin] PATH_INFO: `/v3/services/image` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:42.453336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc01ce-1900-43cf-a779-6feb1549df34 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:42.454687 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc01ce-1900-43cf-a779-6feb1549df34 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-bccc01ce-1900-43cf-a779-6feb1549df34 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:42.463314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:42.464274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:42.465166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:42.465166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:42.465166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:42.465166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:42.465166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:42.465166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:42.465166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:42.465166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:42.465166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:42.465166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:42.465166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:42.465166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:42.465166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 16:13:42.465166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:42.474427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 508/1005] 10.222.0.40 () {56 vars in 1105 bytes} [Thu Aug 11 16:13:42 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:42.474607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed32ac2-1bf2-49a0-9833-1afa49c0fd04 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:42.474692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:42.581160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed32ac2-1bf2-49a0-9833-1afa49c0fd04 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:42.616499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e1954-c5a5-4e8b-82ae-8ee06c6a2b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:42.617125 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e1954-c5a5-4e8b-82ae-8ee06c6a2b85 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:42.617399 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e1954-c5a5-4e8b-82ae-8ee06c6a2b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:42.617662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e1954-c5a5-4e8b-82ae-8ee06c6a2b85 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:42.618277 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e1954-c5a5-4e8b-82ae-8ee06c6a2b85 None admin] RBAC: Adding query filter params (name=image) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:42.618570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e1954-c5a5-4e8b-82ae-8ee06c6a2b85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:42.619949 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e1954-c5a5-4e8b-82ae-8ee06c6a2b85 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:42.624969 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 498/1006] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:42.630416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc01ce-1900-43cf-a779-6feb1549df34 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:42.709321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:42.733169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc01ce-1900-43cf-a779-6feb1549df34 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:42.766422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e99e3f-301b-4534-b1b6-65285edd035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:42.767021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e99e3f-301b-4534-b1b6-65285edd035b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:42.767322 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e99e3f-301b-4534-b1b6-65285edd035b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:42.767594 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e99e3f-301b-4534-b1b6-65285edd035b None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:42.768215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e99e3f-301b-4534-b1b6-65285edd035b None admin] RBAC: Adding query filter params (type=image) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:42.768511 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e99e3f-301b-4534-b1b6-65285edd035b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:42.769884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e99e3f-301b-4534-b1b6-65285edd035b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:42.774318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 509/1007] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:42.812601 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518535b9-f69b-42a2-bc49-25a5b121e730 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:42.812921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518535b9-f69b-42a2-bc49-25a5b121e730 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:42.813178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518535b9-f69b-42a2-bc49-25a5b121e730 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:42.815250 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 499/1008] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:42.820616 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d29d03-3b54-4700-a8d8-c2a7e7ffe687 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:42.820939 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d29d03-3b54-4700-a8d8-c2a7e7ffe687 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:42.821170 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d29d03-3b54-4700-a8d8-c2a7e7ffe687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:42.840265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-62d29d03-3b54-4700-a8d8-c2a7e7ffe687 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:42.841523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-62d29d03-3b54-4700-a8d8-c2a7e7ffe687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:42.913723 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 510/1009] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:42.936949 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518535b9-f69b-42a2-bc49-25a5b121e730 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:43.006391 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:43.045573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518535b9-f69b-42a2-bc49-25a5b121e730 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:43.080274 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dc557-354a-4ee9-ac42-a7da96bdc981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:43.080938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dc557-354a-4ee9-ac42-a7da96bdc981 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:43.081213 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dc557-354a-4ee9-ac42-a7da96bdc981 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:43.081483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dc557-354a-4ee9-ac42-a7da96bdc981 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:43.082056 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dc557-354a-4ee9-ac42-a7da96bdc981 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:43.083404 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dc557-354a-4ee9-ac42-a7da96bdc981 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-695dc557-354a-4ee9-ac42-a7da96bdc981 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:43.092028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:43.093238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:43.094062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:43.094062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:43.094062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:43.094062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:43.094062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:43.094062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:43.094062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:43.094062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:43.094062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:43.094062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:43.094062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:43.094062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:43.094062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 16:13:43.094062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:43.095333 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 500/1010] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:43.099940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d29d03-3b54-4700-a8d8-c2a7e7ffe687 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:43.169460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:43.200565 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d29d03-3b54-4700-a8d8-c2a7e7ffe687 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:43.236114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f3c9c-88bc-496d-a4a7-e9cfa2e9f335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:43.237491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f3c9c-88bc-496d-a4a7-e9cfa2e9f335 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:43.237770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f3c9c-88bc-496d-a4a7-e9cfa2e9f335 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:43.238040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f3c9c-88bc-496d-a4a7-e9cfa2e9f335 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:43.238683 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f3c9c-88bc-496d-a4a7-e9cfa2e9f335 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:43.238981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f3c9c-88bc-496d-a4a7-e9cfa2e9f335 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:43.240421 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f3c9c-88bc-496d-a4a7-e9cfa2e9f335 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:43.248871 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 511/1011] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Aug 11 16:13:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:43.251597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dc557-354a-4ee9-ac42-a7da96bdc981 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:43.351234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dc557-354a-4ee9-ac42-a7da96bdc981 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:43.379699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:43.386660 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f744b7-cdd1-41a5-bdeb-6ba9e4953357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:43.387263 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f744b7-cdd1-41a5-bdeb-6ba9e4953357 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:43.387535 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f744b7-cdd1-41a5-bdeb-6ba9e4953357 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:43.387805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f744b7-cdd1-41a5-bdeb-6ba9e4953357 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:43.388423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f744b7-cdd1-41a5-bdeb-6ba9e4953357 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:43.388749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f744b7-cdd1-41a5-bdeb-6ba9e4953357 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:43.390097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f744b7-cdd1-41a5-bdeb-6ba9e4953357 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:43.399547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 501/1012] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Aug 11 16:13:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:43.401201 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f3c9c-88bc-496d-a4a7-e9cfa2e9f335 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:43.507788 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f3c9c-88bc-496d-a4a7-e9cfa2e9f335 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:43.543701 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ace9c-0806-4398-a2de-1ac61ae5058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:43.544561 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ace9c-0806-4398-a2de-1ac61ae5058e None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:43.545015 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ace9c-0806-4398-a2de-1ac61ae5058e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:43.545429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ace9c-0806-4398-a2de-1ac61ae5058e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:43.546239 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ace9c-0806-4398-a2de-1ac61ae5058e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:43.547765 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ace9c-0806-4398-a2de-1ac61ae5058e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:43.553800 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:43.576615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 512/1013] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:13:43 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:13:43.958825 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9a587-d77f-419b-9b1c-8f9607ca6db6 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:43.959346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9a587-d77f-419b-9b1c-8f9607ca6db6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:43.959452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9a587-d77f-419b-9b1c-8f9607ca6db6 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:43.960753 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 502/1014] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:43.966005 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d6b09-adb7-4548-b78a-88b635998b08 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:43.966430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d6b09-adb7-4548-b78a-88b635998b08 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:43.966608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d6b09-adb7-4548-b78a-88b635998b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:43.985891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0e4d6b09-adb7-4548-b78a-88b635998b08 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:43.987678 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0e4d6b09-adb7-4548-b78a-88b635998b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:44.059818 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 513/1015] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:43 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:44.081683 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9a587-d77f-419b-9b1c-8f9607ca6db6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:44.188192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9a587-d77f-419b-9b1c-8f9607ca6db6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:44.222081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf00616-e729-48da-861d-fa4cd6d0603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:44.222622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf00616-e729-48da-861d-fa4cd6d0603e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:44.222892 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf00616-e729-48da-861d-fa4cd6d0603e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:44.223159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf00616-e729-48da-861d-fa4cd6d0603e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:44.224251 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf00616-e729-48da-861d-fa4cd6d0603e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:44.225695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf00616-e729-48da-861d-fa4cd6d0603e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:44.227450 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 503/1016] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:44.232928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d6b09-adb7-4548-b78a-88b635998b08 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:44.330613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d6b09-adb7-4548-b78a-88b635998b08 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:44.348295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:44.368576 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e8162-ec4f-4a09-a8c5-b78dfc41d44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:44.369211 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e8162-ec4f-4a09-a8c5-b78dfc41d44a None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:44.369487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e8162-ec4f-4a09-a8c5-b78dfc41d44a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:44.369754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e8162-ec4f-4a09-a8c5-b78dfc41d44a None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:44.370395 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e8162-ec4f-4a09-a8c5-b78dfc41d44a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:44.371817 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e8162-ec4f-4a09-a8c5-b78dfc41d44a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:44.404367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 514/1017] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Aug 11 16:13:44 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:13:44.786068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cba67a-b451-4179-9b9f-dc0cbe2e69c4 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:44.786263 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cba67a-b451-4179-9b9f-dc0cbe2e69c4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:44.786520 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cba67a-b451-4179-9b9f-dc0cbe2e69c4 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:44.787914 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 504/1018] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:44.794214 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5915d6-133a-4412-93cc-51ec79aa47a4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:44.794500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5915d6-133a-4412-93cc-51ec79aa47a4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:44.794781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5915d6-133a-4412-93cc-51ec79aa47a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:44.813164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ef5915d6-133a-4412-93cc-51ec79aa47a4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:44.814893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ef5915d6-133a-4412-93cc-51ec79aa47a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:44.881711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 515/1019] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:44 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:44.904627 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cba67a-b451-4179-9b9f-dc0cbe2e69c4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:44.970766 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:45.014048 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cba67a-b451-4179-9b9f-dc0cbe2e69c4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:45.048198 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe13f6-418e-42f2-b3e6-9e94058b9e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:45.049270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe13f6-418e-42f2-b3e6-9e94058b9e60 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:45.049542 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe13f6-418e-42f2-b3e6-9e94058b9e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:45.049807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe13f6-418e-42f2-b3e6-9e94058b9e60 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:45.050448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe13f6-418e-42f2-b3e6-9e94058b9e60 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:45.051874 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe13f6-418e-42f2-b3e6-9e94058b9e60 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:45.070028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 505/1020] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Aug 11 16:13:44 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:13:45.732670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6823ea-6512-4bf2-bdc4-254eccfdc906 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:45.733160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6823ea-6512-4bf2-bdc4-254eccfdc906 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:45.733160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6823ea-6512-4bf2-bdc4-254eccfdc906 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:45.734514 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 516/1021] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:45.740157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4185816-6132-460e-9c07-a30df5b21ccf None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:45.740450 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4185816-6132-460e-9c07-a30df5b21ccf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:45.740767 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4185816-6132-460e-9c07-a30df5b21ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:45.758995 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c4185816-6132-460e-9c07-a30df5b21ccf None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:45.760165 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c4185816-6132-460e-9c07-a30df5b21ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:45.832510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 506/1022] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:45.855239 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6823ea-6512-4bf2-bdc4-254eccfdc906 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:45.954212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:45.959169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6823ea-6512-4bf2-bdc4-254eccfdc906 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:45.993816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6afcdf-ae4f-4c4e-b1aa-272c4fd3399c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:45.994357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6afcdf-ae4f-4c4e-b1aa-272c4fd3399c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:45.994630 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6afcdf-ae4f-4c4e-b1aa-272c4fd3399c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:45.994892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6afcdf-ae4f-4c4e-b1aa-272c4fd3399c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:46.005278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6afcdf-ae4f-4c4e-b1aa-272c4fd3399c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-4c6afcdf-ae4f-4c4e-b1aa-272c4fd3399c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:46.009923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:46.010845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:46.011697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:46.011697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:46.011697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:46.011697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:46.011697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:46.011697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:46.011697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:46.011697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:46.011697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:46.011697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:46.011697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 16:13:46.011697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:46.011697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 517/1023] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Aug 11 16:13:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:46.018559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4185816-6132-460e-9c07-a30df5b21ccf None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:46.068075 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:46.120991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4185816-6132-460e-9c07-a30df5b21ccf None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:46.156776 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a135a-5303-4389-afe0-f88c2ee54a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:46.157381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a135a-5303-4389-afe0-f88c2ee54a62 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:46.157653 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a135a-5303-4389-afe0-f88c2ee54a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:46.158460 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a135a-5303-4389-afe0-f88c2ee54a62 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:46.159133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a135a-5303-4389-afe0-f88c2ee54a62 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:46.159416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a135a-5303-4389-afe0-f88c2ee54a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:46.160794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a135a-5303-4389-afe0-f88c2ee54a62 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:46.169483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 507/1024] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Aug 11 16:13:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:46.175948 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6afcdf-ae4f-4c4e-b1aa-272c4fd3399c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:46.276793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6afcdf-ae4f-4c4e-b1aa-272c4fd3399c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:46.311361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfcd1f-1f32-4f66-9e65-a23c80e17703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:46.311977 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfcd1f-1f32-4f66-9e65-a23c80e17703 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:46.312252 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfcd1f-1f32-4f66-9e65-a23c80e17703 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:46.312519 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfcd1f-1f32-4f66-9e65-a23c80e17703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:46.322479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfcd1f-1f32-4f66-9e65-a23c80e17703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:46.323966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfcd1f-1f32-4f66-9e65-a23c80e17703 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-96bfcd1f-1f32-4f66-9e65-a23c80e17703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:46.338094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:46.339020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:46.339919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:46.339919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:46.339919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:46.339919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 518/1025] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:46.346425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a135a-5303-4389-afe0-f88c2ee54a62 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:46.446811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a135a-5303-4389-afe0-f88c2ee54a62 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:46.457501 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:46.484642 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1608359-fa4d-4454-bfaa-f03d9ea28513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:46.485248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1608359-fa4d-4454-bfaa-f03d9ea28513 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:46.485519 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1608359-fa4d-4454-bfaa-f03d9ea28513 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:46.485789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1608359-fa4d-4454-bfaa-f03d9ea28513 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:46.486472 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1608359-fa4d-4454-bfaa-f03d9ea28513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:46.486765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1608359-fa4d-4454-bfaa-f03d9ea28513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:46.488166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1608359-fa4d-4454-bfaa-f03d9ea28513 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:46.495072 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27019807-487a-4e59-9867-21b79e9d5907 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:46.495356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27019807-487a-4e59-9867-21b79e9d5907 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:46.495622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27019807-487a-4e59-9867-21b79e9d5907 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:46.496995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 519/1026] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:46.501934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dda92-2abb-4f64-b084-6a569eb8bfe8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:46.502247 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dda92-2abb-4f64-b084-6a569eb8bfe8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:46.502523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dda92-2abb-4f64-b084-6a569eb8bfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:46.504322 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 508/1027] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:46.510048 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1608359-fa4d-4454-bfaa-f03d9ea28513 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:46.521999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-293dda92-2abb-4f64-b084-6a569eb8bfe8 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:46.523176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-293dda92-2abb-4f64-b084-6a569eb8bfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:46.530820 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:46.593598 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 520/1028] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:13:46.618065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dda92-2abb-4f64-b084-6a569eb8bfe8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:46.619231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1608359-fa4d-4454-bfaa-f03d9ea28513 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:46.656264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc979a-4013-4133-bd2c-b647eaeeffac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:46.657245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc979a-4013-4133-bd2c-b647eaeeffac None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:46.657700 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc979a-4013-4133-bd2c-b647eaeeffac None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:46.658727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc979a-4013-4133-bd2c-b647eaeeffac None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:46.667353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc979a-4013-4133-bd2c-b647eaeeffac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:46.669572 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc979a-4013-4133-bd2c-b647eaeeffac None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-77cc979a-4013-4133-bd2c-b647eaeeffac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:46.681951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:46.683155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:46.684364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:46.684364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:46.684364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:46.684364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:46.684364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:46.684364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:46.684364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:46.684364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:46.684364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:13:46.684364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:46.685639 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 509/1029] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Aug 11 16:13:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:46.690824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc979a-4013-4133-bd2c-b647eaeeffac None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:46.724120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:46.729193 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dda92-2abb-4f64-b084-6a569eb8bfe8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:46.763792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfb543-f0f4-4457-a798-1489712c9427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:46.764421 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfb543-f0f4-4457-a798-1489712c9427 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:46.764827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfb543-f0f4-4457-a798-1489712c9427 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:46.765099 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfb543-f0f4-4457-a798-1489712c9427 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:46.766253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfb543-f0f4-4457-a798-1489712c9427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:46.767814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfb543-f0f4-4457-a798-1489712c9427 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:46.769610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 521/1030] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:46.776294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfb543-f0f4-4457-a798-1489712c9427 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:46.788768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:46.809245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc979a-4013-4133-bd2c-b647eaeeffac None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:46.842240 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95b679-cc2e-49b3-a97d-96036372d7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:46.842843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95b679-cc2e-49b3-a97d-96036372d7ab None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:46.843104 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95b679-cc2e-49b3-a97d-96036372d7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:46.843370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95b679-cc2e-49b3-a97d-96036372d7ab None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:46.844121 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95b679-cc2e-49b3-a97d-96036372d7ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:46.844473 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95b679-cc2e-49b3-a97d-96036372d7ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:46.846624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95b679-cc2e-49b3-a97d-96036372d7ab None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:46.864067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 510/1031] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Aug 11 16:13:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:46.869509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95b679-cc2e-49b3-a97d-96036372d7ab None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:46.885579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfb543-f0f4-4457-a798-1489712c9427 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:46.922636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edd5d4-4c3e-4847-be44-c90278d19ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:46.924116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edd5d4-4c3e-4847-be44-c90278d19ebd None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:46.924604 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edd5d4-4c3e-4847-be44-c90278d19ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:46.924958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edd5d4-4c3e-4847-be44-c90278d19ebd None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:46.925656 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edd5d4-4c3e-4847-be44-c90278d19ebd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:46.927157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edd5d4-4c3e-4847-be44-c90278d19ebd None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:46.960618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 522/1032] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:13:46 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:13:46.971846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:46.986725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95b679-cc2e-49b3-a97d-96036372d7ab None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:47.025446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379250b-d792-4828-b531-d8dd477d426c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:47.026107 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379250b-d792-4828-b531-d8dd477d426c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:47.026387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379250b-d792-4828-b531-d8dd477d426c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:47.026590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379250b-d792-4828-b531-d8dd477d426c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:47.100814 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379250b-d792-4828-b531-d8dd477d426c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:47.102273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379250b-d792-4828-b531-d8dd477d426c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:47.131475 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5e71a-8385-4f14-8ec0-76dc907ebcf6 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:47.131754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5e71a-8385-4f14-8ec0-76dc907ebcf6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:47.132045 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5e71a-8385-4f14-8ec0-76dc907ebcf6 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:47.133410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 523/1033] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:47.138875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba20fcd-3a26-479d-9068-e82799ad33bd None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:47.139194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba20fcd-3a26-479d-9068-e82799ad33bd None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:47.139416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba20fcd-3a26-479d-9068-e82799ad33bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:47.162211 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-fba20fcd-3a26-479d-9068-e82799ad33bd None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:47.163410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fba20fcd-3a26-479d-9068-e82799ad33bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:47.198949 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:47.215395 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 511/1034] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 16:13:47.221763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379250b-d792-4828-b531-d8dd477d426c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:47.234721 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:47.249071 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 524/1035] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:13:47.270511 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba20fcd-3a26-479d-9068-e82799ad33bd None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:47.337277 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379250b-d792-4828-b531-d8dd477d426c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:47.373643 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18d814-d103-4cd9-bfb6-45a2cefbf891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:47.374185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18d814-d103-4cd9-bfb6-45a2cefbf891 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:47.374461 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18d814-d103-4cd9-bfb6-45a2cefbf891 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:47.374732 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18d814-d103-4cd9-bfb6-45a2cefbf891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:47.382877 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba20fcd-3a26-479d-9068-e82799ad33bd None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:47.386482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18d814-d103-4cd9-bfb6-45a2cefbf891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:47.387921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18d814-d103-4cd9-bfb6-45a2cefbf891 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-db18d814-d103-4cd9-bfb6-45a2cefbf891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:47.402445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:47.403379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:47.409396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:47.409396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:47.409396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:47.409396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 512/1036] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:47.409396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18d814-d103-4cd9-bfb6-45a2cefbf891 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:47.424526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bacee-3aec-4fb3-a7a4-ea84839c69ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:47.425183 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bacee-3aec-4fb3-a7a4-ea84839c69ba None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:47.425462 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bacee-3aec-4fb3-a7a4-ea84839c69ba None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:47.425731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bacee-3aec-4fb3-a7a4-ea84839c69ba None admin] PATH_INFO: `/v3/services/image` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:47.426469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bacee-3aec-4fb3-a7a4-ea84839c69ba None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:47.427939 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bacee-3aec-4fb3-a7a4-ea84839c69ba None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e56bacee-3aec-4fb3-a7a4-ea84839c69ba None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:47.436822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:47.437810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:47.438626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:47.438626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:47.438626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:47.438626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:47.438626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:47.438626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:47.438626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:47.438626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:47.438626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:47.438626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:47.438626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:47.438626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:47.438626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 16:13:47.438626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:47.438626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 525/1037] 10.222.0.40 () {56 vars in 1105 bytes} [Thu Aug 11 16:13:47 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:47.444256 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bacee-3aec-4fb3-a7a4-ea84839c69ba None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:47.459810 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:47.514060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:47.523933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18d814-d103-4cd9-bfb6-45a2cefbf891 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:47.558163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b41512-781e-47ae-b5f3-6cce1c451c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:47.558881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b41512-781e-47ae-b5f3-6cce1c451c34 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:47.559224 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b41512-781e-47ae-b5f3-6cce1c451c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:47.559370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bacee-3aec-4fb3-a7a4-ea84839c69ba None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:47.559647 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b41512-781e-47ae-b5f3-6cce1c451c34 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:47.560330 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b41512-781e-47ae-b5f3-6cce1c451c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:47.560729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b41512-781e-47ae-b5f3-6cce1c451c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:47.562086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b41512-781e-47ae-b5f3-6cce1c451c34 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:47.575244 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 513/1038] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:47.581849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b41512-781e-47ae-b5f3-6cce1c451c34 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:47.603874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edeb9a-9d8c-4c29-b154-483632cf19da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:47.604476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edeb9a-9d8c-4c29-b154-483632cf19da None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:47.604783 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edeb9a-9d8c-4c29-b154-483632cf19da None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:47.605052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edeb9a-9d8c-4c29-b154-483632cf19da None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:47.605675 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edeb9a-9d8c-4c29-b154-483632cf19da None admin] RBAC: Adding query filter params (name=image) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:47.605975 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edeb9a-9d8c-4c29-b154-483632cf19da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:47.607324 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edeb9a-9d8c-4c29-b154-483632cf19da None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:47.613337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 526/1039] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:47.618895 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edeb9a-9d8c-4c29-b154-483632cf19da None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:47.687988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:47.691300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b41512-781e-47ae-b5f3-6cce1c451c34 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:47.724838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edeb9a-9d8c-4c29-b154-483632cf19da None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:47.727686 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a6023-1b88-47b6-9143-5d3a646e5b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:47.728305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a6023-1b88-47b6-9143-5d3a646e5b22 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:47.728577 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a6023-1b88-47b6-9143-5d3a646e5b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:47.728884 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a6023-1b88-47b6-9143-5d3a646e5b22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:47.735483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a6023-1b88-47b6-9143-5d3a646e5b22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:47.737607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a6023-1b88-47b6-9143-5d3a646e5b22 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:47.748454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-dd2a6023-1b88-47b6-9143-5d3a646e5b22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:47.748454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:47.748454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:47.748454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:47.748454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:47.748454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:47.748454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:47.748454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:47.748454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:47.748454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:47.748454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:47.748454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:47.748454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:47.748454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:47.748454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:47.749571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:47.750881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:47.750881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:47.750881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:47.750881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:47.750881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:47.750881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:47.750881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:47.750881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:47.752016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:47.754590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 514/1040] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:47.755387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a6023-1b88-47b6-9143-5d3a646e5b22 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:47.764427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219aa32-3473-4d6d-8b9d-ca42498c9c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:47.765160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219aa32-3473-4d6d-8b9d-ca42498c9c79 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:47.765506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219aa32-3473-4d6d-8b9d-ca42498c9c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:47.765863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219aa32-3473-4d6d-8b9d-ca42498c9c79 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:47.766584 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219aa32-3473-4d6d-8b9d-ca42498c9c79 None admin] RBAC: Adding query filter params (type=image) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:47.766951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219aa32-3473-4d6d-8b9d-ca42498c9c79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:47.768405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219aa32-3473-4d6d-8b9d-ca42498c9c79 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:47.778094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 527/1041] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:47.779506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219aa32-3473-4d6d-8b9d-ca42498c9c79 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:47.861937 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a6023-1b88-47b6-9143-5d3a646e5b22 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:47.882613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219aa32-3473-4d6d-8b9d-ca42498c9c79 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:47.895786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baef328-88a5-461b-b0d6-e54b3298dc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:47.896493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baef328-88a5-461b-b0d6-e54b3298dc0e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:47.896892 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baef328-88a5-461b-b0d6-e54b3298dc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:47.897255 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baef328-88a5-461b-b0d6-e54b3298dc0e None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:47.898021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baef328-88a5-461b-b0d6-e54b3298dc0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:47.898435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baef328-88a5-461b-b0d6-e54b3298dc0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:47.900045 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baef328-88a5-461b-b0d6-e54b3298dc0e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:47.912489 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 515/1042] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:47.916768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cebfa-e41f-41f5-84a9-d3301a7acaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:47.917443 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cebfa-e41f-41f5-84a9-d3301a7acaca None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:47.918044 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cebfa-e41f-41f5-84a9-d3301a7acaca None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:47.918382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cebfa-e41f-41f5-84a9-d3301a7acaca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:47.918496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baef328-88a5-461b-b0d6-e54b3298dc0e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:47.919198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cebfa-e41f-41f5-84a9-d3301a7acaca None admin] RBAC: Adding query filter params (interface=public, service_id=e06e9a9c8c724313a6e1da51b159e9cf, region_id=RegionOne) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:47.919573 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cebfa-e41f-41f5-84a9-d3301a7acaca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:47.921040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cebfa-e41f-41f5-84a9-d3301a7acaca None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:47.931260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 528/1043] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Aug 11 16:13:47 2022] GET /identity/v3/endpoints?service_id=e06e9a9c8c724313a6e1da51b159e9cf&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:47.932214 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cebfa-e41f-41f5-84a9-d3301a7acaca None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:47.945051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:47.988501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:48.028370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baef328-88a5-461b-b0d6-e54b3298dc0e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:48.040339 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cebfa-e41f-41f5-84a9-d3301a7acaca None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:48.064741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6bf78-677b-40a6-81cb-60986f422329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:48.065346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6bf78-677b-40a6-81cb-60986f422329 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:48.065626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6bf78-677b-40a6-81cb-60986f422329 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:48.065900 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6bf78-677b-40a6-81cb-60986f422329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:48.066618 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6bf78-677b-40a6-81cb-60986f422329 None admin] RBAC: Adding query filter params (role.id=a785c8ffc53845be9d11e2cafc895ffe, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=4e91f3fbe098459dba0acf8ec1fb7098) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:48.066936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6bf78-677b-40a6-81cb-60986f422329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:48.068352 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6bf78-677b-40a6-81cb-60986f422329 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:48.074484 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 516/1044] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:47 2022] GET /identity/v3/role_assignments?user.id=4e91f3fbe098459dba0acf8ec1fb7098&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=a785c8ffc53845be9d11e2cafc895ffe => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:48.077337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1b563-eb66-49e4-b0e2-72a04f7d8ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:48.078112 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1b563-eb66-49e4-b0e2-72a04f7d8ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:48.078484 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1b563-eb66-49e4-b0e2-72a04f7d8ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:48.078852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1b563-eb66-49e4-b0e2-72a04f7d8ae6 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:48.080108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1b563-eb66-49e4-b0e2-72a04f7d8ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:48.081618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1b563-eb66-49e4-b0e2-72a04f7d8ae6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:48.089296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 529/1045] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Aug 11 16:13:47 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:13:49.042106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eeee9-e143-4073-aa65-e5980c6796b3 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:49.042914 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eeee9-e143-4073-aa65-e5980c6796b3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:49.042914 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eeee9-e143-4073-aa65-e5980c6796b3 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:49.044381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 517/1046] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:49.049792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8d89f-ca2f-4b6d-a5b5-8dd2637bd14f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:49.050166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8d89f-ca2f-4b6d-a5b5-8dd2637bd14f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:49.050338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8d89f-ca2f-4b6d-a5b5-8dd2637bd14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:49.068909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b2b8d89f-ca2f-4b6d-a5b5-8dd2637bd14f None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:49.070100 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b2b8d89f-ca2f-4b6d-a5b5-8dd2637bd14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:49.139989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 530/1047] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:49.163274 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7eeee9-e143-4073-aa65-e5980c6796b3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:49.253376 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:49.271078 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7eeee9-e143-4073-aa65-e5980c6796b3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:49.305894 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b79978-10a0-4172-8604-b4949142880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:49.306442 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b79978-10a0-4172-8604-b4949142880f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:49.306721 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b79978-10a0-4172-8604-b4949142880f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:49.306994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b79978-10a0-4172-8604-b4949142880f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:49.317009 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b79978-10a0-4172-8604-b4949142880f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-10b79978-10a0-4172-8604-b4949142880f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:49.321626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:49.322533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:49.323360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:49.323360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:49.323360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:49.323360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:49.323360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:49.323360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:49.323360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:49.323360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:49.323360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:49.323360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:49.323360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:49.323360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:49.324928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 518/1048] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:13:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:49.328656 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8d89f-ca2f-4b6d-a5b5-8dd2637bd14f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:49.374758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:49.428367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8d89f-ca2f-4b6d-a5b5-8dd2637bd14f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:49.461534 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c447cff-0f86-4759-a7f4-5eca454af02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:49.462187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c447cff-0f86-4759-a7f4-5eca454af02b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:49.462471 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c447cff-0f86-4759-a7f4-5eca454af02b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:49.462743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c447cff-0f86-4759-a7f4-5eca454af02b None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:49.463404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c447cff-0f86-4759-a7f4-5eca454af02b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:49.463707 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c447cff-0f86-4759-a7f4-5eca454af02b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:49.465097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c447cff-0f86-4759-a7f4-5eca454af02b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:49.480245 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 531/1049] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:13:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:49.481503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b79978-10a0-4172-8604-b4949142880f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:49.587479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b79978-10a0-4172-8604-b4949142880f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:49.621199 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbdf51-b94b-4c19-aeaf-a28fcc2e1340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:49.621820 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbdf51-b94b-4c19-aeaf-a28fcc2e1340 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:49.622095 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbdf51-b94b-4c19-aeaf-a28fcc2e1340 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:49.622362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbdf51-b94b-4c19-aeaf-a28fcc2e1340 None admin] PATH_INFO: `/v3/users/cbd76b97322a47029b2751c1c2b73ddd` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:49.635596 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbdf51-b94b-4c19-aeaf-a28fcc2e1340 None admin] RBAC: Authorizing `identity:get_user(user_id=cbd76b97322a47029b2751c1c2b73ddd)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:49.637184 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbdf51-b94b-4c19-aeaf-a28fcc2e1340 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:49.643967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 519/1050] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:13:49 2022] GET /identity/v3/users/cbd76b97322a47029b2751c1c2b73ddd => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:49.645057 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c447cff-0f86-4759-a7f4-5eca454af02b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:49.746636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c447cff-0f86-4759-a7f4-5eca454af02b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:49.756208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:49.781894 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa481a1-2af8-4b5f-8d43-75b3649ae308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:49.782501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa481a1-2af8-4b5f-8d43-75b3649ae308 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:49.782805 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa481a1-2af8-4b5f-8d43-75b3649ae308 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:49.783077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa481a1-2af8-4b5f-8d43-75b3649ae308 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:49.851251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa481a1-2af8-4b5f-8d43-75b3649ae308 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:49.852648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa481a1-2af8-4b5f-8d43-75b3649ae308 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:49.959029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 532/1051] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:49 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 16:13:49.960735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbdf51-b94b-4c19-aeaf-a28fcc2e1340 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:49.963569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:50.063348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbdf51-b94b-4c19-aeaf-a28fcc2e1340 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:50.082187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a65e8-b91c-41a0-a345-89d2451deae7 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:50.082693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a65e8-b91c-41a0-a345-89d2451deae7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:50.082775 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a65e8-b91c-41a0-a345-89d2451deae7 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:50.084289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 533/1052] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:50.089934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d33b75-e031-4f18-90d9-8a7cd8cd9dca None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:50.090223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d33b75-e031-4f18-90d9-8a7cd8cd9dca None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:50.090482 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d33b75-e031-4f18-90d9-8a7cd8cd9dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:50.099555 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084e1f1-2f93-4fd4-8243-3a9d0ff86165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:50.100178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084e1f1-2f93-4fd4-8243-3a9d0ff86165 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:50.100455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084e1f1-2f93-4fd4-8243-3a9d0ff86165 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:50.100757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084e1f1-2f93-4fd4-8243-3a9d0ff86165 None admin] PATH_INFO: `/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:50.101923 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084e1f1-2f93-4fd4-8243-3a9d0ff86165 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4c34757fc44d0ab821ec0cf93afcd0)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:50.103275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084e1f1-2f93-4fd4-8243-3a9d0ff86165 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:50.109935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 520/1053] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:13:49 2022] GET /identity/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:50.110785 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084e1f1-2f93-4fd4-8243-3a9d0ff86165 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:50.115077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c7d33b75-e031-4f18-90d9-8a7cd8cd9dca None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:50.116363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c7d33b75-e031-4f18-90d9-8a7cd8cd9dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:50.118580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:50.179607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:50.183579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 534/1054] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:13:50.184827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd8404-8b19-4d87-8b5f-a1ec31a44e41 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:50.185114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd8404-8b19-4d87-8b5f-a1ec31a44e41 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:50.185385 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd8404-8b19-4d87-8b5f-a1ec31a44e41 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:50.186736 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 535/1055] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:50.193936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570c64a-20bc-4618-bb4c-a29061b45291 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:50.194215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570c64a-20bc-4618-bb4c-a29061b45291 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:50.194529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570c64a-20bc-4618-bb4c-a29061b45291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:50.212468 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084e1f1-2f93-4fd4-8243-3a9d0ff86165 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:50.212683 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a570c64a-20bc-4618-bb4c-a29061b45291 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:50.213858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a570c64a-20bc-4618-bb4c-a29061b45291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:50.246836 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585bcf3-976c-490d-88ec-55d50582cffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:50.247428 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585bcf3-976c-490d-88ec-55d50582cffb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:50.247706 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585bcf3-976c-490d-88ec-55d50582cffb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:50.247980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585bcf3-976c-490d-88ec-55d50582cffb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:50.248726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585bcf3-976c-490d-88ec-55d50582cffb None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=6b4c34757fc44d0ab821ec0cf93afcd0, user.id=cbd76b97322a47029b2751c1c2b73ddd) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:50.249030 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585bcf3-976c-490d-88ec-55d50582cffb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:50.250443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585bcf3-976c-490d-88ec-55d50582cffb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:50.256287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 521/1056] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:50 2022] GET /identity/v3/role_assignments?user.id=cbd76b97322a47029b2751c1c2b73ddd&scope.project.id=6b4c34757fc44d0ab821ec0cf93afcd0&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:50.257826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585bcf3-976c-490d-88ec-55d50582cffb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:50.283305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 536/1057] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:13:50.307477 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570c64a-20bc-4618-bb4c-a29061b45291 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:50.380540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:50.395200 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585bcf3-976c-490d-88ec-55d50582cffb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:50.419975 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570c64a-20bc-4618-bb4c-a29061b45291 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:50.434845 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612f914-973b-49fc-a53d-44c52543e0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:50.435472 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612f914-973b-49fc-a53d-44c52543e0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:50.435745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612f914-973b-49fc-a53d-44c52543e0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:50.436013 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612f914-973b-49fc-a53d-44c52543e0f5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:50.437971 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:50.447952 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612f914-973b-49fc-a53d-44c52543e0f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6612f914-973b-49fc-a53d-44c52543e0f5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:50.452782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:50.453748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:50.454794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:50.454794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:50.454794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:50.454794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:50.454794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:50.454794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:50.454794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:50.454794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:50.454794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:50.454794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:50.454794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 16:13:50.454794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:50.457376 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f461743-94fb-4a98-a64a-b5264562ee3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:50.458009 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f461743-94fb-4a98-a64a-b5264562ee3f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:50.458287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f461743-94fb-4a98-a64a-b5264562ee3f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:50.458558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f461743-94fb-4a98-a64a-b5264562ee3f None admin] PATH_INFO: `/v3/services/image` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:50.459181 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 522/1058] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Aug 11 16:13:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:50.459292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f461743-94fb-4a98-a64a-b5264562ee3f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:50.460254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612f914-973b-49fc-a53d-44c52543e0f5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:50.460644 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f461743-94fb-4a98-a64a-b5264562ee3f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2f461743-94fb-4a98-a64a-b5264562ee3f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:50.469795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:50.470932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:50.473710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:50.473710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:50.473710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:50.473710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:50.473710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:50.473710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:50.473710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:50.473710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:50.473710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:50.473710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:50.473710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:13:50.473710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:13:50.473710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 16:13:50.473710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:50.473710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 537/1059] 10.222.0.40 () {56 vars in 1105 bytes} [Thu Aug 11 16:13:50 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:50.477118 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f461743-94fb-4a98-a64a-b5264562ee3f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:50.578868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f461743-94fb-4a98-a64a-b5264562ee3f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:50.590722 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612f914-973b-49fc-a53d-44c52543e0f5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:50.610191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:50.616375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2da111-0517-4855-ac3b-b689bb32d6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:50.617005 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2da111-0517-4855-ac3b-b689bb32d6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:50.617278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2da111-0517-4855-ac3b-b689bb32d6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:50.617545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2da111-0517-4855-ac3b-b689bb32d6b7 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:50.618176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2da111-0517-4855-ac3b-b689bb32d6b7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:50.618472 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2da111-0517-4855-ac3b-b689bb32d6b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:50.619828 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2da111-0517-4855-ac3b-b689bb32d6b7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:50.624933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 538/1060] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:50.629082 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235b45a-cf1c-4ad4-9a89-5c8daa7f8492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:50.629785 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235b45a-cf1c-4ad4-9a89-5c8daa7f8492 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:50.630158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235b45a-cf1c-4ad4-9a89-5c8daa7f8492 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:50.630403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2da111-0517-4855-ac3b-b689bb32d6b7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:50.630654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235b45a-cf1c-4ad4-9a89-5c8daa7f8492 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:50.631334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235b45a-cf1c-4ad4-9a89-5c8daa7f8492 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:50.631702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235b45a-cf1c-4ad4-9a89-5c8daa7f8492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:50.633142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235b45a-cf1c-4ad4-9a89-5c8daa7f8492 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:50.642452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 523/1061] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Aug 11 16:13:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:50.648457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235b45a-cf1c-4ad4-9a89-5c8daa7f8492 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:50.707678 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:50.744289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2da111-0517-4855-ac3b-b689bb32d6b7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:50.754537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235b45a-cf1c-4ad4-9a89-5c8daa7f8492 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:50.781345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8403ef-592e-4796-b5ba-a4dde8400abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:50.781953 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8403ef-592e-4796-b5ba-a4dde8400abc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:50.782220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8403ef-592e-4796-b5ba-a4dde8400abc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:50.782491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8403ef-592e-4796-b5ba-a4dde8400abc None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:50.783663 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8403ef-592e-4796-b5ba-a4dde8400abc None admin] RBAC: Adding query filter params (type=image) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:50.783961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8403ef-592e-4796-b5ba-a4dde8400abc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:50.785341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8403ef-592e-4796-b5ba-a4dde8400abc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:50.791329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e22eda-5043-4482-aa0f-383c5ef70181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:50.791952 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e22eda-5043-4482-aa0f-383c5ef70181 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:50.792227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e22eda-5043-4482-aa0f-383c5ef70181 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:50.792495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e22eda-5043-4482-aa0f-383c5ef70181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:50.795476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 539/1062] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:50.796287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8403ef-592e-4796-b5ba-a4dde8400abc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:50.804903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e22eda-5043-4482-aa0f-383c5ef70181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:50.806336 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e22eda-5043-4482-aa0f-383c5ef70181 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f0e22eda-5043-4482-aa0f-383c5ef70181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:50.820602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:50.821695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:50.827657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:50.827657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:50.827657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:50.827657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 524/1063] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:50.828988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e22eda-5043-4482-aa0f-383c5ef70181 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:50.860766 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:50.904976 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8403ef-592e-4796-b5ba-a4dde8400abc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:50.935132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e22eda-5043-4482-aa0f-383c5ef70181 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:50.944313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:50.944463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4883d0-6fd0-4eaa-aa78-7dd12896bd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:50.945093 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4883d0-6fd0-4eaa-aa78-7dd12896bd93 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:50.945372 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4883d0-6fd0-4eaa-aa78-7dd12896bd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:50.946243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4883d0-6fd0-4eaa-aa78-7dd12896bd93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:50.946757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4883d0-6fd0-4eaa-aa78-7dd12896bd93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:50.948424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4883d0-6fd0-4eaa-aa78-7dd12896bd93 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:50.969427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 540/1064] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:13:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:13:50.985472 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0938b-03c4-4166-a76b-2e6de72a2dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:50.986282 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0938b-03c4-4166-a76b-2e6de72a2dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:50.986656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0938b-03c4-4166-a76b-2e6de72a2dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:50.987094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0938b-03c4-4166-a76b-2e6de72a2dc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:50.987831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0938b-03c4-4166-a76b-2e6de72a2dc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:50.988234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0938b-03c4-4166-a76b-2e6de72a2dc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:50.989803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0938b-03c4-4166-a76b-2e6de72a2dc9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:51.008285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 525/1065] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:51.009989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4883d0-6fd0-4eaa-aa78-7dd12896bd93 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:51.124189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4883d0-6fd0-4eaa-aa78-7dd12896bd93 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:51.141626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:51.163073 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436e587-c904-44fe-baa7-013bc21edbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:51.163635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436e587-c904-44fe-baa7-013bc21edbf2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:51.163914 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436e587-c904-44fe-baa7-013bc21edbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:51.164184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436e587-c904-44fe-baa7-013bc21edbf2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:51.172251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436e587-c904-44fe-baa7-013bc21edbf2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:51.173781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436e587-c904-44fe-baa7-013bc21edbf2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-1436e587-c904-44fe-baa7-013bc21edbf2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:51.185075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:51.185992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:51.186919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:51.186919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:51.186919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:51.186919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:51.186919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:51.186919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:51.186919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:51.186919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:51.186919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:13:51.186919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:51.188658 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 541/1066] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Aug 11 16:13:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:51.192110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0938b-03c4-4166-a76b-2e6de72a2dc9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:51.296131 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0938b-03c4-4166-a76b-2e6de72a2dc9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:51.331788 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05a390-786f-4cfd-8355-14341fb1e94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:51.332673 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05a390-786f-4cfd-8355-14341fb1e94a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:51.333119 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05a390-786f-4cfd-8355-14341fb1e94a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:51.333558 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05a390-786f-4cfd-8355-14341fb1e94a None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:51.334497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05a390-786f-4cfd-8355-14341fb1e94a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:51.334953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05a390-786f-4cfd-8355-14341fb1e94a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:51.336514 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05a390-786f-4cfd-8355-14341fb1e94a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:51.355315 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 526/1067] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Aug 11 16:13:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:51.361489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436e587-c904-44fe-baa7-013bc21edbf2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:51.464681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436e587-c904-44fe-baa7-013bc21edbf2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:51.504369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480d05b-13d5-4d76-aece-db0516ce8aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:51.505008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480d05b-13d5-4d76-aece-db0516ce8aaf None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:51.505284 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480d05b-13d5-4d76-aece-db0516ce8aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:51.505551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480d05b-13d5-4d76-aece-db0516ce8aaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:51.516010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480d05b-13d5-4d76-aece-db0516ce8aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:51.517531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480d05b-13d5-4d76-aece-db0516ce8aaf None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-1480d05b-13d5-4d76-aece-db0516ce8aaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:51.531536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:51.532456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:51.534142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:51.534142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:51.534142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:51.536647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 542/1068] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:51.539327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05a390-786f-4cfd-8355-14341fb1e94a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:51.564312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:51.639417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05a390-786f-4cfd-8355-14341fb1e94a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:51.673752 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41876f5-9065-4dd1-a792-a1dfa46f39e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:51.674360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41876f5-9065-4dd1-a792-a1dfa46f39e5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:51.674636 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41876f5-9065-4dd1-a792-a1dfa46f39e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:51.674902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41876f5-9065-4dd1-a792-a1dfa46f39e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:51.675531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41876f5-9065-4dd1-a792-a1dfa46f39e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:51.675826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41876f5-9065-4dd1-a792-a1dfa46f39e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:51.677206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41876f5-9065-4dd1-a792-a1dfa46f39e5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:51.693325 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 527/1069] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:51.694616 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480d05b-13d5-4d76-aece-db0516ce8aaf None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:51.725338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:51.799812 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480d05b-13d5-4d76-aece-db0516ce8aaf None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:51.833116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf6819-f9ca-461c-b259-f96b7e6cd36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:51.833739 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf6819-f9ca-461c-b259-f96b7e6cd36a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:51.834017 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf6819-f9ca-461c-b259-f96b7e6cd36a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:51.834289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf6819-f9ca-461c-b259-f96b7e6cd36a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:51.840968 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf6819-f9ca-461c-b259-f96b7e6cd36a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:51.842454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf6819-f9ca-461c-b259-f96b7e6cd36a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:51.853447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-56cf6819-f9ca-461c-b259-f96b7e6cd36a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:51.853447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:51.853447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:51.853447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:51.853447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:51.853447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:51.853447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:51.853447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:51.853447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:51.853447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:51.853447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:51.853447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:51.853447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:51.853447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:51.853447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:51.854310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:51.855192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:51.855192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:51.855192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:51.855192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:51.855192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:51.855192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:51.855192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:51.855192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:51.856331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 543/1070] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:51.860333 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41876f5-9065-4dd1-a792-a1dfa46f39e5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:51.947832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:51.967668 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41876f5-9065-4dd1-a792-a1dfa46f39e5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:52.003032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492f44c-d7ba-4f71-85f6-9ec0ea701979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:52.003554 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492f44c-d7ba-4f71-85f6-9ec0ea701979 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:52.003826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492f44c-d7ba-4f71-85f6-9ec0ea701979 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:52.004091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492f44c-d7ba-4f71-85f6-9ec0ea701979 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:52.004832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492f44c-d7ba-4f71-85f6-9ec0ea701979 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:52.005134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492f44c-d7ba-4f71-85f6-9ec0ea701979 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:52.006526 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492f44c-d7ba-4f71-85f6-9ec0ea701979 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:52.023791 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 528/1071] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:52.025277 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf6819-f9ca-461c-b259-f96b7e6cd36a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:52.120173 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:52.133365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf6819-f9ca-461c-b259-f96b7e6cd36a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:52.168101 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba329d-ef68-4015-8437-751c5b20c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:52.168843 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba329d-ef68-4015-8437-751c5b20c65c None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:52.169121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba329d-ef68-4015-8437-751c5b20c65c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:52.169389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba329d-ef68-4015-8437-751c5b20c65c None admin] PATH_INFO: `/v3/projects/3b0514f7236d42d1955e895adaf41389/users/4e91f3fbe098459dba0acf8ec1fb7098/roles/a785c8ffc53845be9d11e2cafc895ffe` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:52.171627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba329d-ef68-4015-8437-751c5b20c65c None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0514f7236d42d1955e895adaf41389, user_id=4e91f3fbe098459dba0acf8ec1fb7098, role_id=a785c8ffc53845be9d11e2cafc895ffe)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:52.173086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba329d-ef68-4015-8437-751c5b20c65c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:52.187698 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 544/1072] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:13:52 2022] PUT /identity/v3/projects/3b0514f7236d42d1955e895adaf41389/users/4e91f3fbe098459dba0acf8ec1fb7098/roles/a785c8ffc53845be9d11e2cafc895ffe => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:13:52.273383 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76edc5b-6701-4143-9e17-9c9c7825d101 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:52.273883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76edc5b-6701-4143-9e17-9c9c7825d101 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:52.273883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76edc5b-6701-4143-9e17-9c9c7825d101 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:52.275380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 529/1073] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:52.280801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70b7b8-6365-4464-8f88-95e9d56b77c4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:52.281111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70b7b8-6365-4464-8f88-95e9d56b77c4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:52.281363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70b7b8-6365-4464-8f88-95e9d56b77c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:52.301846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-de70b7b8-6365-4464-8f88-95e9d56b77c4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:52.303076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-de70b7b8-6365-4464-8f88-95e9d56b77c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:52.375824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 545/1074] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:52.397922 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76edc5b-6701-4143-9e17-9c9c7825d101 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:52.503229 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76edc5b-6701-4143-9e17-9c9c7825d101 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:52.539583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d6af9-8e70-4036-9cd1-77b1d0aa4bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:52.540129 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d6af9-8e70-4036-9cd1-77b1d0aa4bfb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:52.540417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d6af9-8e70-4036-9cd1-77b1d0aa4bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:52.540786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d6af9-8e70-4036-9cd1-77b1d0aa4bfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:52.551903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d6af9-8e70-4036-9cd1-77b1d0aa4bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ef2d6af9-8e70-4036-9cd1-77b1d0aa4bfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:52.556622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:52.557548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:52.558394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:52.558394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:52.558394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:52.558394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:52.558394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:52.558394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:52.558394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:52.558394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:52.558394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:52.558394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:52.558394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:52.558394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:52.558394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 530/1075] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:13:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:52.565112 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70b7b8-6365-4464-8f88-95e9d56b77c4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:52.648314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:52.672397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70b7b8-6365-4464-8f88-95e9d56b77c4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:52.709608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b339b09-78d1-47a5-bd4a-e3d05c69cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:52.710212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b339b09-78d1-47a5-bd4a-e3d05c69cdc4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:52.710488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b339b09-78d1-47a5-bd4a-e3d05c69cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:52.710758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b339b09-78d1-47a5-bd4a-e3d05c69cdc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:52.711421 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b339b09-78d1-47a5-bd4a-e3d05c69cdc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:52.711722 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b339b09-78d1-47a5-bd4a-e3d05c69cdc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:52.713182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b339b09-78d1-47a5-bd4a-e3d05c69cdc4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:52.726725 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 546/1076] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:13:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:52.728249 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d6af9-8e70-4036-9cd1-77b1d0aa4bfb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:52.731716 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:52.830740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d6af9-8e70-4036-9cd1-77b1d0aa4bfb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:52.866440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e262a-f01d-449a-b6b3-2c075d1131b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:52.867060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e262a-f01d-449a-b6b3-2c075d1131b8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:52.867334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e262a-f01d-449a-b6b3-2c075d1131b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:52.867601 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e262a-f01d-449a-b6b3-2c075d1131b8 None admin] PATH_INFO: `/v3/users/cbd76b97322a47029b2751c1c2b73ddd` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:52.868731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e262a-f01d-449a-b6b3-2c075d1131b8 None admin] RBAC: Authorizing `identity:get_user(user_id=cbd76b97322a47029b2751c1c2b73ddd)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:52.870145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e262a-f01d-449a-b6b3-2c075d1131b8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:52.871881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 531/1077] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:13:52 2022] GET /identity/v3/users/cbd76b97322a47029b2751c1c2b73ddd => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:52.877816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b339b09-78d1-47a5-bd4a-e3d05c69cdc4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:52.979652 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b339b09-78d1-47a5-bd4a-e3d05c69cdc4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:53.006781 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dab897-c55a-4d08-9d80-5c347e936b3b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:53.007065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dab897-c55a-4d08-9d80-5c347e936b3b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:53.007338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dab897-c55a-4d08-9d80-5c347e936b3b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:53.008822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 532/1078] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:53.013311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e613af-116c-41fa-81fd-e018b5973147 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:53.013606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e613af-116c-41fa-81fd-e018b5973147 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:53.013865 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e613af-116c-41fa-81fd-e018b5973147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:53.014775 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de852b-0773-4662-9c50-11e344a13eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:53.015395 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de852b-0773-4662-9c50-11e344a13eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:53.015668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de852b-0773-4662-9c50-11e344a13eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:53.015936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de852b-0773-4662-9c50-11e344a13eb0 None admin] PATH_INFO: `/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:53.017096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de852b-0773-4662-9c50-11e344a13eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4c34757fc44d0ab821ec0cf93afcd0)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:53.018498 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de852b-0773-4662-9c50-11e344a13eb0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:53.025074 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 547/1079] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:13:52 2022] GET /identity/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:53.025718 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de852b-0773-4662-9c50-11e344a13eb0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:53.036636 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-85e613af-116c-41fa-81fd-e018b5973147 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:53.037812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-85e613af-116c-41fa-81fd-e018b5973147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:53.039866 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:53.104577 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:53.110365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 533/1080] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:13:53.133139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e613af-116c-41fa-81fd-e018b5973147 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:53.134731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de852b-0773-4662-9c50-11e344a13eb0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:53.176426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c2ff3-a5ca-46bd-b419-e9e9d1039e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:53.177102 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c2ff3-a5ca-46bd-b419-e9e9d1039e2c None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:53.177384 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c2ff3-a5ca-46bd-b419-e9e9d1039e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:53.177655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c2ff3-a5ca-46bd-b419-e9e9d1039e2c None admin] PATH_INFO: `/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0/users/cbd76b97322a47029b2751c1c2b73ddd/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:53.179575 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c2ff3-a5ca-46bd-b419-e9e9d1039e2c None admin] RBAC: Authorizing `identity:create_grant(project_id=6b4c34757fc44d0ab821ec0cf93afcd0, user_id=cbd76b97322a47029b2751c1c2b73ddd, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:53.181037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c2ff3-a5ca-46bd-b419-e9e9d1039e2c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:53.195136 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 548/1081] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:13:53 2022] PUT /identity/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0/users/cbd76b97322a47029b2751c1c2b73ddd/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:13:53.248884 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e613af-116c-41fa-81fd-e018b5973147 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:53.289402 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b896642-7a63-43fb-abbe-1f944bd8a23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:53.290769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b896642-7a63-43fb-abbe-1f944bd8a23e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:53.291245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b896642-7a63-43fb-abbe-1f944bd8a23e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:53.291718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b896642-7a63-43fb-abbe-1f944bd8a23e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:53.370581 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:53.373164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b896642-7a63-43fb-abbe-1f944bd8a23e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:53.374885 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b896642-7a63-43fb-abbe-1f944bd8a23e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:53.478875 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 534/1082] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 16:13:53.484826 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c2ff3-a5ca-46bd-b419-e9e9d1039e2c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:53.553585 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:53.589635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c2ff3-a5ca-46bd-b419-e9e9d1039e2c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:53.623225 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe31980-5fa0-400d-ad01-321d443c369c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:53.623776 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe31980-5fa0-400d-ad01-321d443c369c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:53.624052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe31980-5fa0-400d-ad01-321d443c369c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:53.624321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe31980-5fa0-400d-ad01-321d443c369c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:53.636050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe31980-5fa0-400d-ad01-321d443c369c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:53.637560 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe31980-5fa0-400d-ad01-321d443c369c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-afe31980-5fa0-400d-ad01-321d443c369c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:53.651884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:53.652891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:53.653795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:53.653795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:53.653795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:53.653795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 549/1083] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:53.660147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b896642-7a63-43fb-abbe-1f944bd8a23e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:53.762948 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:53.766771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b896642-7a63-43fb-abbe-1f944bd8a23e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:53.801770 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5566e-9a47-46c5-90dd-f10548bc43b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:53.802370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5566e-9a47-46c5-90dd-f10548bc43b1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:53.802646 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5566e-9a47-46c5-90dd-f10548bc43b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:53.802914 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5566e-9a47-46c5-90dd-f10548bc43b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:53.803544 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5566e-9a47-46c5-90dd-f10548bc43b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:53.803843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5566e-9a47-46c5-90dd-f10548bc43b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:53.805228 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5566e-9a47-46c5-90dd-f10548bc43b1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:53.820619 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 535/1084] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:54.254638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c64a9-f518-4d92-af85-cc09241cb5f9 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:54.255186 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c64a9-f518-4d92-af85-cc09241cb5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:54.255186 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c64a9-f518-4d92-af85-cc09241cb5f9 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:54.256537 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 550/1085] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:54.261715 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53888d3-0804-4728-b430-63405f811b9b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:54.262002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53888d3-0804-4728-b430-63405f811b9b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:54.262336 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53888d3-0804-4728-b430-63405f811b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:54.280311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f53888d3-0804-4728-b430-63405f811b9b None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:54.281527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f53888d3-0804-4728-b430-63405f811b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:54.349338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 536/1086] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:54.372373 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c64a9-f518-4d92-af85-cc09241cb5f9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:54.476984 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c64a9-f518-4d92-af85-cc09241cb5f9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:54.496747 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:54.510481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbe0f6-ef0a-4469-ae28-af778403df27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:54.511039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbe0f6-ef0a-4469-ae28-af778403df27 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:54.511315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbe0f6-ef0a-4469-ae28-af778403df27 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:54.511583 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbe0f6-ef0a-4469-ae28-af778403df27 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:54.521877 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbe0f6-ef0a-4469-ae28-af778403df27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-66dbe0f6-ef0a-4469-ae28-af778403df27 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:54.526460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:54.527440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:54.528676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:54.528676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:54.528676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:54.528676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:54.528676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:54.528676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:54.528676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:54.528676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:54.528676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:54.528676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:54.528676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 16:13:54.528676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:54.528676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 551/1087] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Aug 11 16:13:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:54.534048 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53888d3-0804-4728-b430-63405f811b9b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:54.623778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:54.633589 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53888d3-0804-4728-b430-63405f811b9b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:54.667031 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fff602-6da0-4926-9520-8172aaeaab50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:54.667881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fff602-6da0-4926-9520-8172aaeaab50 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:54.668154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fff602-6da0-4926-9520-8172aaeaab50 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:54.668420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fff602-6da0-4926-9520-8172aaeaab50 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:54.669101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fff602-6da0-4926-9520-8172aaeaab50 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:54.669397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fff602-6da0-4926-9520-8172aaeaab50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:54.670733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fff602-6da0-4926-9520-8172aaeaab50 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:54.679392 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 537/1088] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Aug 11 16:13:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:54.684872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbe0f6-ef0a-4469-ae28-af778403df27 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:54.788303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbe0f6-ef0a-4469-ae28-af778403df27 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:54.821531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b799d01-51d5-4b97-b840-ee1ef236e3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:54.822351 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b799d01-51d5-4b97-b840-ee1ef236e3ca None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:54.822633 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b799d01-51d5-4b97-b840-ee1ef236e3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:54.822903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b799d01-51d5-4b97-b840-ee1ef236e3ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:54.833120 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b799d01-51d5-4b97-b840-ee1ef236e3ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:54.834550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b799d01-51d5-4b97-b840-ee1ef236e3ca None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5b799d01-51d5-4b97-b840-ee1ef236e3ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:54.848524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:54.849649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:54.850796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:54.850796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:54.850796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:54.852734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 552/1089] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:54.855281 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fff602-6da0-4926-9520-8172aaeaab50 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:54.953416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fff602-6da0-4926-9520-8172aaeaab50 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:54.988763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92549d-a25b-4638-a251-c95fb5a61bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:54.989368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92549d-a25b-4638-a251-c95fb5a61bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:54.989645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92549d-a25b-4638-a251-c95fb5a61bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:54.989915 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92549d-a25b-4638-a251-c95fb5a61bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:54.990550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92549d-a25b-4638-a251-c95fb5a61bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:54.990849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92549d-a25b-4638-a251-c95fb5a61bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:54.992193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92549d-a25b-4638-a251-c95fb5a61bf0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:55.004163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 538/1090] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:55.009797 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b799d01-51d5-4b97-b840-ee1ef236e3ca None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:55.040063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:55.108702 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b799d01-51d5-4b97-b840-ee1ef236e3ca None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:55.142118 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ea0ee-7442-45a1-b1de-00b8a08df245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:55.142745 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ea0ee-7442-45a1-b1de-00b8a08df245 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:55.143025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ea0ee-7442-45a1-b1de-00b8a08df245 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:55.143295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ea0ee-7442-45a1-b1de-00b8a08df245 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:55.150761 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ea0ee-7442-45a1-b1de-00b8a08df245 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:55.152202 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ea0ee-7442-45a1-b1de-00b8a08df245 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c61ea0ee-7442-45a1-b1de-00b8a08df245 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:13:55.163499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:55.164578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:55.165853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:55.165853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:55.165853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:13:55.165853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:13:55.165853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:13:55.165853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:13:55.165853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:13:55.165853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:13:55.165853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 16:13:55.165853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:55.165853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 553/1091] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Aug 11 16:13:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:55.170498 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92549d-a25b-4638-a251-c95fb5a61bf0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:55.185623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:55.233942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b3adf-4737-439f-b0da-3cbc8e97f78f None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:55.234226 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b3adf-4737-439f-b0da-3cbc8e97f78f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:55.234501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b3adf-4737-439f-b0da-3cbc8e97f78f None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:55.236497 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 554/1092] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:13:55.241385 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9f390-dca0-4dde-9859-70911e14a8d4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:55.241671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9f390-dca0-4dde-9859-70911e14a8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:55.241948 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9f390-dca0-4dde-9859-70911e14a8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:55.259265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4ba9f390-dca0-4dde-9859-70911e14a8d4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:55.260451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4ba9f390-dca0-4dde-9859-70911e14a8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:55.271393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92549d-a25b-4638-a251-c95fb5a61bf0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:55.305844 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a0c4b-313c-483d-89fd-568d0cbfaeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:55.306366 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a0c4b-313c-483d-89fd-568d0cbfaeab None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:55.306641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a0c4b-313c-483d-89fd-568d0cbfaeab None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:55.306911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a0c4b-313c-483d-89fd-568d0cbfaeab None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:55.307633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a0c4b-313c-483d-89fd-568d0cbfaeab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:55.307940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a0c4b-313c-483d-89fd-568d0cbfaeab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:55.309381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a0c4b-313c-483d-89fd-568d0cbfaeab None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:55.326804 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 539/1093] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Aug 11 16:13:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:55.331608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 555/1094] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:13:55.332440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a0c4b-313c-483d-89fd-568d0cbfaeab None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:55.350856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9f390-dca0-4dde-9859-70911e14a8d4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:55.374754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:55.400144 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:55.432465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a0c4b-313c-483d-89fd-568d0cbfaeab None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:55.449567 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9f390-dca0-4dde-9859-70911e14a8d4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:55.466401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce6249-6869-4272-a979-58cccec291cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:55.467007 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce6249-6869-4272-a979-58cccec291cf None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:55.467293 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce6249-6869-4272-a979-58cccec291cf None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:55.467567 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce6249-6869-4272-a979-58cccec291cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:55.487232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc43ac-bf34-4f33-bcd1-c10deccea399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:55.487859 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc43ac-bf34-4f33-bcd1-c10deccea399 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:55.488134 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc43ac-bf34-4f33-bcd1-c10deccea399 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:55.488404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc43ac-bf34-4f33-bcd1-c10deccea399 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:55.498275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc43ac-bf34-4f33-bcd1-c10deccea399 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-52fc43ac-bf34-4f33-bcd1-c10deccea399 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:13:55.503069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:55.504037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:55.505427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:55.505427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:55.505427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:55.505427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:55.505427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:13:55.505427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:13:55.505427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:13:55.505427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:13:55.505427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:13:55.505427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:13:55.505427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:13:55.505427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:13:55.505427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 556/1095] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:13:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:55.510046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc43ac-bf34-4f33-bcd1-c10deccea399 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:55.539546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce6249-6869-4272-a979-58cccec291cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:55.541010 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce6249-6869-4272-a979-58cccec291cf None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:55.589612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:55.607933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:55.608810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc43ac-bf34-4f33-bcd1-c10deccea399 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:55.638568 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 540/1096] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 16:13:55.642723 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb6d80-d711-46bd-9d23-7c0144e35061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:55.643322 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb6d80-d711-46bd-9d23-7c0144e35061 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:55.643678 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb6d80-d711-46bd-9d23-7c0144e35061 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:55.644012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb6d80-d711-46bd-9d23-7c0144e35061 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:55.644716 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb6d80-d711-46bd-9d23-7c0144e35061 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:55.644862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce6249-6869-4272-a979-58cccec291cf None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:55.645021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb6d80-d711-46bd-9d23-7c0144e35061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:55.646390 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb6d80-d711-46bd-9d23-7c0144e35061 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:55.654481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 557/1097] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:13:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:55.660534 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb6d80-d711-46bd-9d23-7c0144e35061 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:55.742886 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce6249-6869-4272-a979-58cccec291cf None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:55.757690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb6d80-d711-46bd-9d23-7c0144e35061 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:55.776957 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b09b10-c38d-47d6-ace7-5841d7d07e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:55.777572 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b09b10-c38d-47d6-ace7-5841d7d07e24 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:55.777853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b09b10-c38d-47d6-ace7-5841d7d07e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:55.778123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b09b10-c38d-47d6-ace7-5841d7d07e24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:55.788139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b09b10-c38d-47d6-ace7-5841d7d07e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:55.789607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b09b10-c38d-47d6-ace7-5841d7d07e24 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:55.794988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f2600-a592-4981-bf8c-e10a9ec27e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:55.795604 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f2600-a592-4981-bf8c-e10a9ec27e7c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:55.795878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f2600-a592-4981-bf8c-e10a9ec27e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:55.796148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f2600-a592-4981-bf8c-e10a9ec27e7c None admin] PATH_INFO: `/v3/users/cbd76b97322a47029b2751c1c2b73ddd` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:55.797291 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f2600-a592-4981-bf8c-e10a9ec27e7c None admin] RBAC: Authorizing `identity:get_user(user_id=cbd76b97322a47029b2751c1c2b73ddd)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:55.799229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f2600-a592-4981-bf8c-e10a9ec27e7c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:55.800829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 558/1098] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:13:55 2022] GET /identity/v3/users/cbd76b97322a47029b2751c1c2b73ddd => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e2b09b10-c38d-47d6-ace7-5841d7d07e24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:13:55.804871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:55.805893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:13:55.806769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:13:55.806769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:13:55.806769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:55.806769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 541/1099] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:13:55.807003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f2600-a592-4981-bf8c-e10a9ec27e7c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:55.811381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b09b10-c38d-47d6-ace7-5841d7d07e24 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:55.822231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:55.836396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:55.904866 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f2600-a592-4981-bf8c-e10a9ec27e7c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:55.911788 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b09b10-c38d-47d6-ace7-5841d7d07e24 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:55.937737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cb74f-2f2b-4745-b718-6726dabde76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:55.938334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cb74f-2f2b-4745-b718-6726dabde76b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:55.938643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cb74f-2f2b-4745-b718-6726dabde76b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:55.938914 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cb74f-2f2b-4745-b718-6726dabde76b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:55.945130 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac37922-e906-44f1-9f84-c3ff7e739ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:55.945717 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac37922-e906-44f1-9f84-c3ff7e739ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:55.945982 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac37922-e906-44f1-9f84-c3ff7e739ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:55.946249 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac37922-e906-44f1-9f84-c3ff7e739ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:55.946869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac37922-e906-44f1-9f84-c3ff7e739ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:55.947168 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac37922-e906-44f1-9f84-c3ff7e739ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:55.948508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac37922-e906-44f1-9f84-c3ff7e739ef6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:55.959790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 542/1100] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:55.965304 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac37922-e906-44f1-9f84-c3ff7e739ef6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:56.004253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cb74f-2f2b-4745-b718-6726dabde76b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:56.005768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cb74f-2f2b-4745-b718-6726dabde76b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:56.019051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:56.045928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:56.064933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac37922-e906-44f1-9f84-c3ff7e739ef6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:56.097936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4840e-694f-4bb3-a04a-0046c169f8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:56.098578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4840e-694f-4bb3-a04a-0046c169f8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:56.098856 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4840e-694f-4bb3-a04a-0046c169f8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:56.099136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4840e-694f-4bb3-a04a-0046c169f8b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:56.102744 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 559/1101] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:13:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 16:13:56.107495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4840e-694f-4bb3-a04a-0046c169f8b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:56.108513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cb74f-2f2b-4745-b718-6726dabde76b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:56.108987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4840e-694f-4bb3-a04a-0046c169f8b9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:56.120606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-21e4840e-694f-4bb3-a04a-0046c169f8b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:56.120606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:13:56.120606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:13:56.120606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:13:56.120606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:13:56.120606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:13:56.120606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:13:56.120606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:13:56.120606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:13:56.120606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:13:56.120606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:13:56.120606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:13:56.120606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:13:56.120606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:13:56.120606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:13:56.121479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:13:56.122689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:13:56.122689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:13:56.122689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:13:56.122689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:13:56.122689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:13:56.122689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:13:56.122689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:13:56.122689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:13:56.122689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 543/1102] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:13:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:13:56.127245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4840e-694f-4bb3-a04a-0046c169f8b9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:56.209814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cb74f-2f2b-4745-b718-6726dabde76b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:56.223150 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:56.226512 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4840e-694f-4bb3-a04a-0046c169f8b9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:56.244555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd187a85-b1d5-469e-b0f7-27d96ff97dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:56.245200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd187a85-b1d5-469e-b0f7-27d96ff97dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:56.245480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd187a85-b1d5-469e-b0f7-27d96ff97dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:56.245749 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd187a85-b1d5-469e-b0f7-27d96ff97dd4 None admin] PATH_INFO: `/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:56.246870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd187a85-b1d5-469e-b0f7-27d96ff97dd4 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4c34757fc44d0ab821ec0cf93afcd0)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:56.248290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd187a85-b1d5-469e-b0f7-27d96ff97dd4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:56.249949 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 560/1103] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:13:56 2022] GET /identity/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:13:56.256634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd187a85-b1d5-469e-b0f7-27d96ff97dd4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:56.260316 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4856c0-b6c0-48ce-bb3d-f25b7f11e460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:56.260943 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4856c0-b6c0-48ce-bb3d-f25b7f11e460 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:56.261232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4856c0-b6c0-48ce-bb3d-f25b7f11e460 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:56.261503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4856c0-b6c0-48ce-bb3d-f25b7f11e460 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:56.262189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4856c0-b6c0-48ce-bb3d-f25b7f11e460 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:56.262491 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4856c0-b6c0-48ce-bb3d-f25b7f11e460 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:56.263891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4856c0-b6c0-48ce-bb3d-f25b7f11e460 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:56.275872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 544/1104] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:13:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:56.281521 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4856c0-b6c0-48ce-bb3d-f25b7f11e460 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:56.284077 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:56.354802 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd187a85-b1d5-469e-b0f7-27d96ff97dd4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:56.387136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4856c0-b6c0-48ce-bb3d-f25b7f11e460 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:56.388205 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e018220-9add-4131-a2b3-16ecf53cc20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:56.388833 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e018220-9add-4131-a2b3-16ecf53cc20c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:56.389109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e018220-9add-4131-a2b3-16ecf53cc20c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:56.389384 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e018220-9add-4131-a2b3-16ecf53cc20c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:56.390104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e018220-9add-4131-a2b3-16ecf53cc20c None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=6b4c34757fc44d0ab821ec0cf93afcd0, user.id=cbd76b97322a47029b2751c1c2b73ddd) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:56.390406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e018220-9add-4131-a2b3-16ecf53cc20c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:56.391852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e018220-9add-4131-a2b3-16ecf53cc20c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:56.397547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 561/1105] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:56 2022] GET /identity/v3/role_assignments?user.id=cbd76b97322a47029b2751c1c2b73ddd&scope.project.id=6b4c34757fc44d0ab821ec0cf93afcd0&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:56.425821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd02982-94af-4cd2-8f28-cca8c59977e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:56.426436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd02982-94af-4cd2-8f28-cca8c59977e0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:56.426711 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd02982-94af-4cd2-8f28-cca8c59977e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:56.426979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd02982-94af-4cd2-8f28-cca8c59977e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:56.427713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd02982-94af-4cd2-8f28-cca8c59977e0 None admin] RBAC: Adding query filter params (role.id=a785c8ffc53845be9d11e2cafc895ffe, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=4e91f3fbe098459dba0acf8ec1fb7098) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:13:56.428020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd02982-94af-4cd2-8f28-cca8c59977e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:56.429500 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd02982-94af-4cd2-8f28-cca8c59977e0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:56.436094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 545/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:13:56 2022] GET /identity/v3/role_assignments?user.id=4e91f3fbe098459dba0acf8ec1fb7098&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=a785c8ffc53845be9d11e2cafc895ffe => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:58.434945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0d85b-e0be-47d1-a7fc-37515a33c978 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:58.435500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0d85b-e0be-47d1-a7fc-37515a33c978 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:58.435500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0d85b-e0be-47d1-a7fc-37515a33c978 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:58.436851 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 562/1107] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:13:58.442701 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097f3ce-8615-4cd1-a10f-9768581235e0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:58.443086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097f3ce-8615-4cd1-a10f-9768581235e0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:58.443239 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097f3ce-8615-4cd1-a10f-9768581235e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:58.461518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0097f3ce-8615-4cd1-a10f-9768581235e0 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:13:58.462675 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0097f3ce-8615-4cd1-a10f-9768581235e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:13:58.521430 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:58.529137 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 546/1108] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:13:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:13:58.553364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0d85b-e0be-47d1-a7fc-37515a33c978 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:58.598903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:13:58.651662 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0d85b-e0be-47d1-a7fc-37515a33c978 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:58.684484 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ebd3b-c402-4545-8c1e-99cdd0717b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:58.685173 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ebd3b-c402-4545-8c1e-99cdd0717b48 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:58.685389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ebd3b-c402-4545-8c1e-99cdd0717b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:58.685656 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ebd3b-c402-4545-8c1e-99cdd0717b48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:58.686743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ebd3b-c402-4545-8c1e-99cdd0717b48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:58.688148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ebd3b-c402-4545-8c1e-99cdd0717b48 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:58.690332 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 563/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:13:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:13:58.696119 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097f3ce-8615-4cd1-a10f-9768581235e0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:13:58.790936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097f3ce-8615-4cd1-a10f-9768581235e0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:13:58.824223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76f96c-9129-4ad4-90b3-8f744adf1a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:13:58.824826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76f96c-9129-4ad4-90b3-8f744adf1a5b None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:13:58.825102 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76f96c-9129-4ad4-90b3-8f744adf1a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:13:58.825371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76f96c-9129-4ad4-90b3-8f744adf1a5b None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:13:58.826006 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76f96c-9129-4ad4-90b3-8f744adf1a5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:13:58.827409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76f96c-9129-4ad4-90b3-8f744adf1a5b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:13:58.848002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 547/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:13:58 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:14:00.873872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed8264-fb56-40d6-937e-3920b6c60dc1 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:00.874425 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed8264-fb56-40d6-937e-3920b6c60dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:00.874425 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed8264-fb56-40d6-937e-3920b6c60dc1 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:00.875794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 564/1111] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:14:00.881363 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6e0ca-7c5d-48d2-99ee-b9dc59bec519 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:00.881757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6e0ca-7c5d-48d2-99ee-b9dc59bec519 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:00.881902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6e0ca-7c5d-48d2-99ee-b9dc59bec519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:00.899309 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a8c6e0ca-7c5d-48d2-99ee-b9dc59bec519 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:14:00.900510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a8c6e0ca-7c5d-48d2-99ee-b9dc59bec519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:14:00.947133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:00.969674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 548/1112] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:14:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:14:00.993638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed8264-fb56-40d6-937e-3920b6c60dc1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:01.092247 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed8264-fb56-40d6-937e-3920b6c60dc1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:01.106023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:01.127372 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744812e6-7bba-4033-8813-a756365ce324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:01.127949 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744812e6-7bba-4033-8813-a756365ce324 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:01.128228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744812e6-7bba-4033-8813-a756365ce324 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:01.128493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744812e6-7bba-4033-8813-a756365ce324 None admin] PATH_INFO: `/v3/roles/a507b36f2493428fbb8fcdc4fbad6911` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:01.129885 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744812e6-7bba-4033-8813-a756365ce324 None admin] RBAC: Authorizing `identity:get_role(role_id=a507b36f2493428fbb8fcdc4fbad6911)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:01.131234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744812e6-7bba-4033-8813-a756365ce324 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:01.132525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 565/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:14:00 2022] GET /identity/v3/roles/a507b36f2493428fbb8fcdc4fbad6911 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:01.138277 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6e0ca-7c5d-48d2-99ee-b9dc59bec519 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:01.233090 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6e0ca-7c5d-48d2-99ee-b9dc59bec519 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:01.265608 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc218a-796f-423c-a5b3-f1595625306f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:01.266215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc218a-796f-423c-a5b3-f1595625306f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:01.266514 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc218a-796f-423c-a5b3-f1595625306f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:01.266787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc218a-796f-423c-a5b3-f1595625306f None admin] PATH_INFO: `/v3/users/069b9c1b5e584054a3ddd347a2427f18` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:01.279273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc218a-796f-423c-a5b3-f1595625306f None admin] RBAC: Authorizing `identity:get_user(user_id=069b9c1b5e584054a3ddd347a2427f18)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:01.280715 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc218a-796f-423c-a5b3-f1595625306f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:01.282800 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 549/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:14:01 2022] GET /identity/v3/users/069b9c1b5e584054a3ddd347a2427f18 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:01.288753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744812e6-7bba-4033-8813-a756365ce324 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:01.385613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744812e6-7bba-4033-8813-a756365ce324 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:01.418630 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb524f1-595c-443e-bd5f-88135be0939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:01.419215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb524f1-595c-443e-bd5f-88135be0939e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:01.419488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb524f1-595c-443e-bd5f-88135be0939e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:01.419755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb524f1-595c-443e-bd5f-88135be0939e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:01.465933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:01.487004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb524f1-595c-443e-bd5f-88135be0939e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:01.488442 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb524f1-595c-443e-bd5f-88135be0939e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:01.582718 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 566/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:14:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 16:14:01.588786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc218a-796f-423c-a5b3-f1595625306f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:01.629455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:01.686338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc218a-796f-423c-a5b3-f1595625306f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:01.718951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a2d61-8b97-4bcc-9346-e00c290280ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:01.719573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a2d61-8b97-4bcc-9346-e00c290280ea None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:01.720365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a2d61-8b97-4bcc-9346-e00c290280ea None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:01.720666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a2d61-8b97-4bcc-9346-e00c290280ea None admin] PATH_INFO: `/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:01.721769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a2d61-8b97-4bcc-9346-e00c290280ea None admin] RBAC: Authorizing `identity:get_project(project_id=6b4c34757fc44d0ab821ec0cf93afcd0)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:01.723184 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a2d61-8b97-4bcc-9346-e00c290280ea None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:01.724821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 550/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:14:01 2022] GET /identity/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:01.730922 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb524f1-595c-443e-bd5f-88135be0939e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:01.808830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:01.827799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb524f1-595c-443e-bd5f-88135be0939e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:01.860792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9bd31-663f-4243-ab2e-3f9756b199a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:01.861383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9bd31-663f-4243-ab2e-3f9756b199a8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:01.861663 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9bd31-663f-4243-ab2e-3f9756b199a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:01.861931 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9bd31-663f-4243-ab2e-3f9756b199a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:01.862645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9bd31-663f-4243-ab2e-3f9756b199a8 None admin] RBAC: Adding query filter params (role.id=a507b36f2493428fbb8fcdc4fbad6911, scope.project.id=6b4c34757fc44d0ab821ec0cf93afcd0, user.id=069b9c1b5e584054a3ddd347a2427f18) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:14:01.862950 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9bd31-663f-4243-ab2e-3f9756b199a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:01.864358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9bd31-663f-4243-ab2e-3f9756b199a8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:01.869526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 567/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:14:01 2022] GET /identity/v3/role_assignments?user.id=069b9c1b5e584054a3ddd347a2427f18&scope.project.id=6b4c34757fc44d0ab821ec0cf93afcd0&role.id=a507b36f2493428fbb8fcdc4fbad6911 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:03.817418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1894de-0163-418f-8cf4-b7d40e0cb865 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:03.817927 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1894de-0163-418f-8cf4-b7d40e0cb865 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:03.818036 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1894de-0163-418f-8cf4-b7d40e0cb865 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:03.819284 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 551/1118] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:14:03.824264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d4777-0309-477d-9773-8e06a4f75655 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:03.824679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d4777-0309-477d-9773-8e06a4f75655 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:03.824836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d4777-0309-477d-9773-8e06a4f75655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:03.842917 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a95d4777-0309-477d-9773-8e06a4f75655 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:14:03.844095 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a95d4777-0309-477d-9773-8e06a4f75655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:14:03.908681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 568/1119] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:14:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:14:03.930520 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1894de-0163-418f-8cf4-b7d40e0cb865 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:04.040831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1894de-0163-418f-8cf4-b7d40e0cb865 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:04.050028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:04.074543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528e09a-0371-4911-928d-5b2d112e9bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:04.075091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528e09a-0371-4911-928d-5b2d112e9bad None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:04.075368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528e09a-0371-4911-928d-5b2d112e9bad None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:04.075638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528e09a-0371-4911-928d-5b2d112e9bad None admin] PATH_INFO: `/v3/roles/a507b36f2493428fbb8fcdc4fbad6911` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:04.077045 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528e09a-0371-4911-928d-5b2d112e9bad None admin] RBAC: Authorizing `identity:get_role(role_id=a507b36f2493428fbb8fcdc4fbad6911)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:04.078411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528e09a-0371-4911-928d-5b2d112e9bad None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:04.080211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 552/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:14:03 2022] GET /identity/v3/roles/a507b36f2493428fbb8fcdc4fbad6911 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:04.086186 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d4777-0309-477d-9773-8e06a4f75655 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:04.158163 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:04.183255 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d4777-0309-477d-9773-8e06a4f75655 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:04.215989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ce791-2f1b-492e-aaa1-a7fc5219ad8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:04.216604 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ce791-2f1b-492e-aaa1-a7fc5219ad8f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:04.216895 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ce791-2f1b-492e-aaa1-a7fc5219ad8f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:04.217161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ce791-2f1b-492e-aaa1-a7fc5219ad8f None admin] PATH_INFO: `/v3/users/069b9c1b5e584054a3ddd347a2427f18` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:04.218255 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ce791-2f1b-492e-aaa1-a7fc5219ad8f None admin] RBAC: Authorizing `identity:get_user(user_id=069b9c1b5e584054a3ddd347a2427f18)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:04.219684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ce791-2f1b-492e-aaa1-a7fc5219ad8f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:04.221250 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 569/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:14:04 2022] GET /identity/v3/users/069b9c1b5e584054a3ddd347a2427f18 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:04.226816 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528e09a-0371-4911-928d-5b2d112e9bad None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:04.322937 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528e09a-0371-4911-928d-5b2d112e9bad None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:04.356630 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e86156-1c7d-4dbd-92ee-996ab86b898b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:04.357197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e86156-1c7d-4dbd-92ee-996ab86b898b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:04.357474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e86156-1c7d-4dbd-92ee-996ab86b898b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:04.357746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e86156-1c7d-4dbd-92ee-996ab86b898b None admin] PATH_INFO: `/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:04.358838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e86156-1c7d-4dbd-92ee-996ab86b898b None admin] RBAC: Authorizing `identity:get_project(project_id=6b4c34757fc44d0ab821ec0cf93afcd0)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:04.360245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e86156-1c7d-4dbd-92ee-996ab86b898b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:04.361849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 553/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:14:04 2022] GET /identity/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:04.367638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ce791-2f1b-492e-aaa1-a7fc5219ad8f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:04.463796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ce791-2f1b-492e-aaa1-a7fc5219ad8f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:04.498048 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b78d08-1829-4dcc-bcfc-a1bd45a8d656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:04.498690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b78d08-1829-4dcc-bcfc-a1bd45a8d656 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:04.498965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b78d08-1829-4dcc-bcfc-a1bd45a8d656 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:04.499233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b78d08-1829-4dcc-bcfc-a1bd45a8d656 None admin] PATH_INFO: `/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0/users/069b9c1b5e584054a3ddd347a2427f18/roles/a507b36f2493428fbb8fcdc4fbad6911` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:04.501941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b78d08-1829-4dcc-bcfc-a1bd45a8d656 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b4c34757fc44d0ab821ec0cf93afcd0, user_id=069b9c1b5e584054a3ddd347a2427f18, role_id=a507b36f2493428fbb8fcdc4fbad6911)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:04.503340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b78d08-1829-4dcc-bcfc-a1bd45a8d656 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:04.515290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 570/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:14:04 2022] PUT /identity/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0/users/069b9c1b5e584054a3ddd347a2427f18/roles/a507b36f2493428fbb8fcdc4fbad6911 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:14:06.480037 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0146e4-ae40-4b28-abf4-ace91375bf53 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:06.480476 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0146e4-ae40-4b28-abf4-ace91375bf53 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:06.480574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0146e4-ae40-4b28-abf4-ace91375bf53 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:06.481916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 554/1124] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:14:06.487769 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76baf58-5329-4bc1-9c46-67793f6fa2c9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:06.488201 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76baf58-5329-4bc1-9c46-67793f6fa2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:06.488368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76baf58-5329-4bc1-9c46-67793f6fa2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:06.495444 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:06.508398 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d76baf58-5329-4bc1-9c46-67793f6fa2c9 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:14:06.509612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d76baf58-5329-4bc1-9c46-67793f6fa2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:14:06.572845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 571/1125] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:14:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:14:06.596022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0146e4-ae40-4b28-abf4-ace91375bf53 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:06.641723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:06.698236 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0146e4-ae40-4b28-abf4-ace91375bf53 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:06.731330 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35283e5-b2e1-438d-9d2d-10880bb57d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:06.731879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35283e5-b2e1-438d-9d2d-10880bb57d37 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:06.732155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35283e5-b2e1-438d-9d2d-10880bb57d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:06.732425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35283e5-b2e1-438d-9d2d-10880bb57d37 None admin] PATH_INFO: `/v3/roles/a507b36f2493428fbb8fcdc4fbad6911` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:06.733938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35283e5-b2e1-438d-9d2d-10880bb57d37 None admin] RBAC: Authorizing `identity:get_role(role_id=a507b36f2493428fbb8fcdc4fbad6911)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:06.735819 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35283e5-b2e1-438d-9d2d-10880bb57d37 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:06.737148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 555/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:14:06 2022] GET /identity/v3/roles/a507b36f2493428fbb8fcdc4fbad6911 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:06.743012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76baf58-5329-4bc1-9c46-67793f6fa2c9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:06.838448 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76baf58-5329-4bc1-9c46-67793f6fa2c9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:06.867373 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:06.872365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c12aff-0640-4c2d-ba62-3ed20cd52b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:06.873013 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c12aff-0640-4c2d-ba62-3ed20cd52b06 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:06.873292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c12aff-0640-4c2d-ba62-3ed20cd52b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:06.873565 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c12aff-0640-4c2d-ba62-3ed20cd52b06 None admin] PATH_INFO: `/v3/users/069b9c1b5e584054a3ddd347a2427f18` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:06.874686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c12aff-0640-4c2d-ba62-3ed20cd52b06 None admin] RBAC: Authorizing `identity:get_user(user_id=069b9c1b5e584054a3ddd347a2427f18)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:06.876688 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c12aff-0640-4c2d-ba62-3ed20cd52b06 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:06.878236 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 572/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:14:06 2022] GET /identity/v3/users/069b9c1b5e584054a3ddd347a2427f18 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:06.884013 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35283e5-b2e1-438d-9d2d-10880bb57d37 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:06.979007 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35283e5-b2e1-438d-9d2d-10880bb57d37 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:06.992071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:07.012876 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348473de-a2a8-40b8-b6a0-009e08d986f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:07.013465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348473de-a2a8-40b8-b6a0-009e08d986f1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:07.013741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348473de-a2a8-40b8-b6a0-009e08d986f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:07.014011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348473de-a2a8-40b8-b6a0-009e08d986f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:07.081646 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348473de-a2a8-40b8-b6a0-009e08d986f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:07.083068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348473de-a2a8-40b8-b6a0-009e08d986f1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:07.177746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 556/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:14:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 16:14:07.183623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c12aff-0640-4c2d-ba62-3ed20cd52b06 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:07.279221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c12aff-0640-4c2d-ba62-3ed20cd52b06 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:07.312169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db2947-8911-4f1a-a874-70401a7a2d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:07.312802 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db2947-8911-4f1a-a874-70401a7a2d57 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:07.313105 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db2947-8911-4f1a-a874-70401a7a2d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:07.313379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db2947-8911-4f1a-a874-70401a7a2d57 None admin] PATH_INFO: `/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:07.314480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db2947-8911-4f1a-a874-70401a7a2d57 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4c34757fc44d0ab821ec0cf93afcd0)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:07.315896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db2947-8911-4f1a-a874-70401a7a2d57 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:07.317526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 573/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:14:07 2022] GET /identity/v3/projects/6b4c34757fc44d0ab821ec0cf93afcd0 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:07.323423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348473de-a2a8-40b8-b6a0-009e08d986f1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:07.337231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:07.419633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348473de-a2a8-40b8-b6a0-009e08d986f1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:07.452710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c614b-45c8-4be4-a415-3a051f376cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:07.453290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c614b-45c8-4be4-a415-3a051f376cbe None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:07.453564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c614b-45c8-4be4-a415-3a051f376cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:07.454365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c614b-45c8-4be4-a415-3a051f376cbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:07.455067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c614b-45c8-4be4-a415-3a051f376cbe None admin] RBAC: Adding query filter params (role.id=a507b36f2493428fbb8fcdc4fbad6911, scope.project.id=6b4c34757fc44d0ab821ec0cf93afcd0, user.id=069b9c1b5e584054a3ddd347a2427f18) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:14:07.455366 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c614b-45c8-4be4-a415-3a051f376cbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:07.456784 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c614b-45c8-4be4-a415-3a051f376cbe None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:07.462299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 557/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:14:07 2022] GET /identity/v3/role_assignments?user.id=069b9c1b5e584054a3ddd347a2427f18&scope.project.id=6b4c34757fc44d0ab821ec0cf93afcd0&role.id=a507b36f2493428fbb8fcdc4fbad6911 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:09.450301 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba55af6-8571-47be-ba75-22e92d603dfd None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:09.450833 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba55af6-8571-47be-ba75-22e92d603dfd None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:09.450833 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba55af6-8571-47be-ba75-22e92d603dfd None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:09.452179 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 574/1131] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:14:09.457190 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635a1e8-e497-4611-9878-bbf4d04cd4a4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:09.457620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635a1e8-e497-4611-9878-bbf4d04cd4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:09.457713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635a1e8-e497-4611-9878-bbf4d04cd4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:09.478067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4635a1e8-e497-4611-9878-bbf4d04cd4a4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:14:09.479257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4635a1e8-e497-4611-9878-bbf4d04cd4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:14:09.545771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 558/1132] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:14:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:14:09.569979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba55af6-8571-47be-ba75-22e92d603dfd None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:09.634547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:09.671181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba55af6-8571-47be-ba75-22e92d603dfd None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:09.704109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1c8de-f8e2-442c-a45a-0d6dde037e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:09.704715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1c8de-f8e2-442c-a45a-0d6dde037e2c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:09.704992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1c8de-f8e2-442c-a45a-0d6dde037e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:09.705263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1c8de-f8e2-442c-a45a-0d6dde037e2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:09.706366 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1c8de-f8e2-442c-a45a-0d6dde037e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:09.707784 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1c8de-f8e2-442c-a45a-0d6dde037e2c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:09.709363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 575/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:14:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:09.715412 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635a1e8-e497-4611-9878-bbf4d04cd4a4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:09.723959 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:09.811546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635a1e8-e497-4611-9878-bbf4d04cd4a4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:09.844116 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2da60c-911f-4dc6-8a45-b0fc08c9bdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:09.845329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2da60c-911f-4dc6-8a45-b0fc08c9bdcb None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:09.845605 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2da60c-911f-4dc6-8a45-b0fc08c9bdcb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:09.845873 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2da60c-911f-4dc6-8a45-b0fc08c9bdcb None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:09.846505 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2da60c-911f-4dc6-8a45-b0fc08c9bdcb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:09.847910 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2da60c-911f-4dc6-8a45-b0fc08c9bdcb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:09.872868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 559/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Aug 11 16:14:09 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:14:11.875703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd83d1-8139-4113-b8fb-5a25c5f0fb97 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:11.876240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd83d1-8139-4113-b8fb-5a25c5f0fb97 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:11.876240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd83d1-8139-4113-b8fb-5a25c5f0fb97 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:11.877600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 576/1135] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:14:11.882596 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba919e4-41f2-43bc-b5e4-77d8d911e24d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:11.882974 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba919e4-41f2-43bc-b5e4-77d8d911e24d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:11.883148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba919e4-41f2-43bc-b5e4-77d8d911e24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:11.900704 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2ba919e4-41f2-43bc-b5e4-77d8d911e24d None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:14:11.901870 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2ba919e4-41f2-43bc-b5e4-77d8d911e24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:14:11.953189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:11.967681 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 560/1136] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:14:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:14:11.997213 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd83d1-8139-4113-b8fb-5a25c5f0fb97 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:12.096650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd83d1-8139-4113-b8fb-5a25c5f0fb97 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:12.129027 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd17a8c-47aa-46b3-9032-9ebb28cc6973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:12.129575 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd17a8c-47aa-46b3-9032-9ebb28cc6973 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:12.129851 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd17a8c-47aa-46b3-9032-9ebb28cc6973 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:12.130122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd17a8c-47aa-46b3-9032-9ebb28cc6973 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:12.131220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd17a8c-47aa-46b3-9032-9ebb28cc6973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:12.132658 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd17a8c-47aa-46b3-9032-9ebb28cc6973 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:12.134206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 577/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:14:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:12.140393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba919e4-41f2-43bc-b5e4-77d8d911e24d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:12.237783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba919e4-41f2-43bc-b5e4-77d8d911e24d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:12.272930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a221e-bfcc-47e3-afb2-0bd98d5acb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:12.273527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a221e-bfcc-47e3-afb2-0bd98d5acb32 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:12.273798 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a221e-bfcc-47e3-afb2-0bd98d5acb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:12.274063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a221e-bfcc-47e3-afb2-0bd98d5acb32 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:12.274703 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a221e-bfcc-47e3-afb2-0bd98d5acb32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:12.276116 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a221e-bfcc-47e3-afb2-0bd98d5acb32 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:12.296207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 561/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:14:12 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:14:14.311051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4545e3-4006-4dec-9b08-908815a96630 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:14.311605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4545e3-4006-4dec-9b08-908815a96630 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:14.311605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4545e3-4006-4dec-9b08-908815a96630 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:14.313807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 578/1139] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:14:14.318817 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935a22c-0dd9-4e63-8f87-671006c2444a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:14.319234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935a22c-0dd9-4e63-8f87-671006c2444a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:14.319359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935a22c-0dd9-4e63-8f87-671006c2444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:14.336970 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0935a22c-0dd9-4e63-8f87-671006c2444a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:14:14.338145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0935a22c-0dd9-4e63-8f87-671006c2444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:14:14.377105 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:14.403602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 562/1140] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:14:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:14:14.427292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4545e3-4006-4dec-9b08-908815a96630 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:14.430985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:14.527035 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4545e3-4006-4dec-9b08-908815a96630 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:14.559461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15cb0c-67a1-4a50-823f-1e1fe9c3b9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:14.560060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15cb0c-67a1-4a50-823f-1e1fe9c3b9ad None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:14.560335 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15cb0c-67a1-4a50-823f-1e1fe9c3b9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:14.560620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15cb0c-67a1-4a50-823f-1e1fe9c3b9ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:14.571083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15cb0c-67a1-4a50-823f-1e1fe9c3b9ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-7b15cb0c-67a1-4a50-823f-1e1fe9c3b9ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:14:14.575632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:14:14.576810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:14:14.577901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:14:14.577901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:14:14.577901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:14:14.577901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:14:14.577901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:14:14.577901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:14:14.577901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:14:14.577901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:14:14.577901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:14:14.577901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:14:14.577901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:14:14.577901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:14:14.577901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 579/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:14:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:14:14.582848 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935a22c-0dd9-4e63-8f87-671006c2444a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:14.679270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935a22c-0dd9-4e63-8f87-671006c2444a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:14.714199 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744dfb2-e76f-48c0-b9ff-8c65e44bed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:14.714792 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744dfb2-e76f-48c0-b9ff-8c65e44bed39 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:14.715071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744dfb2-e76f-48c0-b9ff-8c65e44bed39 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:14.715345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744dfb2-e76f-48c0-b9ff-8c65e44bed39 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:14.716002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744dfb2-e76f-48c0-b9ff-8c65e44bed39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:14:14.716304 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744dfb2-e76f-48c0-b9ff-8c65e44bed39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:14.717701 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744dfb2-e76f-48c0-b9ff-8c65e44bed39 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:14.726059 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 563/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:14:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:14.731791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15cb0c-67a1-4a50-823f-1e1fe9c3b9ad None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:14.792534 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:14.828660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15cb0c-67a1-4a50-823f-1e1fe9c3b9ad None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:14.861502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a9fe7-8849-4bf3-90e3-ea661c41c2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:14.862107 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a9fe7-8849-4bf3-90e3-ea661c41c2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:14.862383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a9fe7-8849-4bf3-90e3-ea661c41c2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:14.862655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a9fe7-8849-4bf3-90e3-ea661c41c2b4 None admin] PATH_INFO: `/v3/users/7f2f7137c60b45c8b0820d9a19819987` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:14.875886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a9fe7-8849-4bf3-90e3-ea661c41c2b4 None admin] RBAC: Authorizing `identity:get_user(user_id=7f2f7137c60b45c8b0820d9a19819987)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:14.877364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a9fe7-8849-4bf3-90e3-ea661c41c2b4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:14.878937 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 580/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:14:14 2022] GET /identity/v3/users/7f2f7137c60b45c8b0820d9a19819987 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:14.884575 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744dfb2-e76f-48c0-b9ff-8c65e44bed39 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:14.919421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:14.983632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744dfb2-e76f-48c0-b9ff-8c65e44bed39 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:15.015638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab01c6e-5fd8-4616-8242-1f1061c276c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:15.016764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab01c6e-5fd8-4616-8242-1f1061c276c9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:15.017046 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab01c6e-5fd8-4616-8242-1f1061c276c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:15.017322 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab01c6e-5fd8-4616-8242-1f1061c276c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:15.085666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab01c6e-5fd8-4616-8242-1f1061c276c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:15.087029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab01c6e-5fd8-4616-8242-1f1061c276c9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:15.119144 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:15.184058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 564/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:14:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 16:14:15.190097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a9fe7-8849-4bf3-90e3-ea661c41c2b4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:15.287224 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a9fe7-8849-4bf3-90e3-ea661c41c2b4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:15.316677 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:15.328889 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682b904-d925-4c3b-ba79-d9710949ab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:15.329533 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682b904-d925-4c3b-ba79-d9710949ab11 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:15.329813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682b904-d925-4c3b-ba79-d9710949ab11 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:15.330084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682b904-d925-4c3b-ba79-d9710949ab11 None admin] PATH_INFO: `/v3/projects/6c131ed4d88d4908abdcdcbe2e490794` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:15.331223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682b904-d925-4c3b-ba79-d9710949ab11 None admin] RBAC: Authorizing `identity:get_project(project_id=6c131ed4d88d4908abdcdcbe2e490794)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:15.332666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682b904-d925-4c3b-ba79-d9710949ab11 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:15.334295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 581/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:14:15 2022] GET /identity/v3/projects/6c131ed4d88d4908abdcdcbe2e490794 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:15.340613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab01c6e-5fd8-4616-8242-1f1061c276c9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:15.437540 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab01c6e-5fd8-4616-8242-1f1061c276c9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:15.470969 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8ceac-ccf4-46d5-a29f-486d72fd9c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:15.471596 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8ceac-ccf4-46d5-a29f-486d72fd9c63 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:15.471877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8ceac-ccf4-46d5-a29f-486d72fd9c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:15.472147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8ceac-ccf4-46d5-a29f-486d72fd9c63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:15.472908 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8ceac-ccf4-46d5-a29f-486d72fd9c63 None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=6c131ed4d88d4908abdcdcbe2e490794, user.id=7f2f7137c60b45c8b0820d9a19819987) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:14:15.473214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8ceac-ccf4-46d5-a29f-486d72fd9c63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:15.474629 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8ceac-ccf4-46d5-a29f-486d72fd9c63 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:15.477581 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:15.484637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 565/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:14:15 2022] GET /identity/v3/role_assignments?user.id=7f2f7137c60b45c8b0820d9a19819987&scope.project.id=6c131ed4d88d4908abdcdcbe2e490794&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:17.426599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c20b3c-e99e-4d8e-9131-307b45a86512 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:17.427157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c20b3c-e99e-4d8e-9131-307b45a86512 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:17.427157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c20b3c-e99e-4d8e-9131-307b45a86512 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:17.428459 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 582/1147] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:14:17.433780 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d2e4e-331b-4344-8b6c-7345cc4775e5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:17.434158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d2e4e-331b-4344-8b6c-7345cc4775e5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:17.434323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d2e4e-331b-4344-8b6c-7345cc4775e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:17.451902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-225d2e4e-331b-4344-8b6c-7345cc4775e5 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:14:17.453115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-225d2e4e-331b-4344-8b6c-7345cc4775e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:14:17.518729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 566/1148] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:14:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:14:17.541083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c20b3c-e99e-4d8e-9131-307b45a86512 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:17.638464 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c20b3c-e99e-4d8e-9131-307b45a86512 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:17.671083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0cdc1-fc48-400a-b268-b6681e168681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:17.671681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0cdc1-fc48-400a-b268-b6681e168681 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:17.671954 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0cdc1-fc48-400a-b268-b6681e168681 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:17.672219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0cdc1-fc48-400a-b268-b6681e168681 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:17.682031 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0cdc1-fc48-400a-b268-b6681e168681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-07c0cdc1-fc48-400a-b268-b6681e168681 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:14:17.686527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:14:17.688113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:14:17.689171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:14:17.689171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:14:17.689171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:14:17.689171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:14:17.689171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:14:17.689171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:14:17.689171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:14:17.689171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:14:17.689171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:14:17.689171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:14:17.689171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:14:17.689171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:14:17.689171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 583/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:14:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:14:17.695931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d2e4e-331b-4344-8b6c-7345cc4775e5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:17.800468 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d2e4e-331b-4344-8b6c-7345cc4775e5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:17.828184 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:17.834556 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5016b-4297-47b6-af67-caad213799ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:17.835151 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5016b-4297-47b6-af67-caad213799ee None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:17.835432 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5016b-4297-47b6-af67-caad213799ee None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:17.835702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5016b-4297-47b6-af67-caad213799ee None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:17.836357 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5016b-4297-47b6-af67-caad213799ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:14:17.836683 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5016b-4297-47b6-af67-caad213799ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:17.838037 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5016b-4297-47b6-af67-caad213799ee None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:17.845908 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 567/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:14:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:17.851760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0cdc1-fc48-400a-b268-b6681e168681 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:17.901033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:17.949638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0cdc1-fc48-400a-b268-b6681e168681 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:17.982194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb573337-81f0-425a-84a6-b3786ea3a0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:17.982797 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573337-81f0-425a-84a6-b3786ea3a0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:17.983077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573337-81f0-425a-84a6-b3786ea3a0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:17.983350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573337-81f0-425a-84a6-b3786ea3a0f8 None admin] PATH_INFO: `/v3/users/7f2f7137c60b45c8b0820d9a19819987` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:17.985014 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb573337-81f0-425a-84a6-b3786ea3a0f8 None admin] RBAC: Authorizing `identity:get_user(user_id=7f2f7137c60b45c8b0820d9a19819987)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:17.986431 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb573337-81f0-425a-84a6-b3786ea3a0f8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:17.987979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 584/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:14:17 2022] GET /identity/v3/users/7f2f7137c60b45c8b0820d9a19819987 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:17.993550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5016b-4297-47b6-af67-caad213799ee None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:18.094356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5016b-4297-47b6-af67-caad213799ee None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:18.127216 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932ef71-13f6-4484-8681-6b888c9cef02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:18.127821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932ef71-13f6-4484-8681-6b888c9cef02 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:18.128097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932ef71-13f6-4484-8681-6b888c9cef02 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:18.128365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932ef71-13f6-4484-8681-6b888c9cef02 None admin] PATH_INFO: `/v3/projects/6c131ed4d88d4908abdcdcbe2e490794` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:18.129482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932ef71-13f6-4484-8681-6b888c9cef02 None admin] RBAC: Authorizing `identity:get_project(project_id=6c131ed4d88d4908abdcdcbe2e490794)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:18.130905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932ef71-13f6-4484-8681-6b888c9cef02 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:18.132506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 568/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:14:17 2022] GET /identity/v3/projects/6c131ed4d88d4908abdcdcbe2e490794 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:18.138424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb573337-81f0-425a-84a6-b3786ea3a0f8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:18.233207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb573337-81f0-425a-84a6-b3786ea3a0f8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:18.250052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:18.267879 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248cf59-5122-4672-9c9e-fac62066b9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:18.268522 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248cf59-5122-4672-9c9e-fac62066b9c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:18.268832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248cf59-5122-4672-9c9e-fac62066b9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:18.269106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248cf59-5122-4672-9c9e-fac62066b9c9 None admin] PATH_INFO: `/v3/projects/6c131ed4d88d4908abdcdcbe2e490794/users/7f2f7137c60b45c8b0820d9a19819987/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:18.271000 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248cf59-5122-4672-9c9e-fac62066b9c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c131ed4d88d4908abdcdcbe2e490794, user_id=7f2f7137c60b45c8b0820d9a19819987, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:18.272426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248cf59-5122-4672-9c9e-fac62066b9c9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:18.284557 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 585/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:14:18 2022] PUT /identity/v3/projects/6c131ed4d88d4908abdcdcbe2e490794/users/7f2f7137c60b45c8b0820d9a19819987/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:14:20.249133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7da56-dc0e-4bf7-bdff-0c1c91c400cb None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:20.249691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7da56-dc0e-4bf7-bdff-0c1c91c400cb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:20.249691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7da56-dc0e-4bf7-bdff-0c1c91c400cb None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:20.251619 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 569/1154] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:14:20.256791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d580c55-0afd-49d4-b841-bf8bbde66585 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:20.257200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d580c55-0afd-49d4-b841-bf8bbde66585 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:20.257335 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d580c55-0afd-49d4-b841-bf8bbde66585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:20.274745 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7d580c55-0afd-49d4-b841-bf8bbde66585 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:14:20.275908 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7d580c55-0afd-49d4-b841-bf8bbde66585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:14:20.339947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 586/1155] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:14:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:14:20.362520 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7da56-dc0e-4bf7-bdff-0c1c91c400cb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:20.420620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:20.462036 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7da56-dc0e-4bf7-bdff-0c1c91c400cb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:20.495405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37462fb9-f20d-4f11-95c8-15324504c817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:20.496025 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37462fb9-f20d-4f11-95c8-15324504c817 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:20.496302 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37462fb9-f20d-4f11-95c8-15324504c817 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:20.496574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37462fb9-f20d-4f11-95c8-15324504c817 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:20.507427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37462fb9-f20d-4f11-95c8-15324504c817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-37462fb9-f20d-4f11-95c8-15324504c817 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:14:20.512020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:14:20.513143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:14:20.514425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:14:20.514425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:14:20.514425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:14:20.514425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:14:20.514425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:14:20.514425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:14:20.514425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:14:20.514425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:14:20.514425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:14:20.514425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:14:20.514425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:14:20.514425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:14:20.514425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 570/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:14:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:14:20.519282 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d580c55-0afd-49d4-b841-bf8bbde66585 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:20.616391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d580c55-0afd-49d4-b841-bf8bbde66585 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:20.625274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:20.649737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88a3aa-5aa2-4fba-9537-cbd40915c0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:20.650505 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88a3aa-5aa2-4fba-9537-cbd40915c0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:20.650868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88a3aa-5aa2-4fba-9537-cbd40915c0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:20.651181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88a3aa-5aa2-4fba-9537-cbd40915c0e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:20.651837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88a3aa-5aa2-4fba-9537-cbd40915c0e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:14:20.652180 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88a3aa-5aa2-4fba-9537-cbd40915c0e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:20.653639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88a3aa-5aa2-4fba-9537-cbd40915c0e0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:20.661772 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 587/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:14:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:20.667623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37462fb9-f20d-4f11-95c8-15324504c817 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:20.772098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37462fb9-f20d-4f11-95c8-15324504c817 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:20.791548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:20.806688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e2dbb-8510-4191-8a96-813de6823d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:20.807307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e2dbb-8510-4191-8a96-813de6823d37 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:20.807586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e2dbb-8510-4191-8a96-813de6823d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:20.807858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e2dbb-8510-4191-8a96-813de6823d37 None admin] PATH_INFO: `/v3/users/7f2f7137c60b45c8b0820d9a19819987` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:20.808982 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e2dbb-8510-4191-8a96-813de6823d37 None admin] RBAC: Authorizing `identity:get_user(user_id=7f2f7137c60b45c8b0820d9a19819987)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:20.810393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e2dbb-8510-4191-8a96-813de6823d37 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:20.811962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 571/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:14:20 2022] GET /identity/v3/users/7f2f7137c60b45c8b0820d9a19819987 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:20.817727 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88a3aa-5aa2-4fba-9537-cbd40915c0e0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:20.913732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88a3aa-5aa2-4fba-9537-cbd40915c0e0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:20.946274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16858d-ee93-4b79-aff6-02d72a774429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:20.946865 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16858d-ee93-4b79-aff6-02d72a774429 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:20.947144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16858d-ee93-4b79-aff6-02d72a774429 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:20.947420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16858d-ee93-4b79-aff6-02d72a774429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:20.985168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:21.012730 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16858d-ee93-4b79-aff6-02d72a774429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:21.014143 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16858d-ee93-4b79-aff6-02d72a774429 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:21.115655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 588/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:14:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 16:14:21.121508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e2dbb-8510-4191-8a96-813de6823d37 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:21.218567 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e2dbb-8510-4191-8a96-813de6823d37 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:21.251439 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8f5b7-d129-42a3-943d-619678206bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:21.252035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8f5b7-d129-42a3-943d-619678206bfd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:21.252307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8f5b7-d129-42a3-943d-619678206bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:21.252574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8f5b7-d129-42a3-943d-619678206bfd None admin] PATH_INFO: `/v3/projects/6c131ed4d88d4908abdcdcbe2e490794` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:21.253686 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8f5b7-d129-42a3-943d-619678206bfd None admin] RBAC: Authorizing `identity:get_project(project_id=6c131ed4d88d4908abdcdcbe2e490794)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:21.255091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8f5b7-d129-42a3-943d-619678206bfd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:21.256682 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 572/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:14:21 2022] GET /identity/v3/projects/6c131ed4d88d4908abdcdcbe2e490794 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:21.262789 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16858d-ee93-4b79-aff6-02d72a774429 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:21.328362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:21.358342 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16858d-ee93-4b79-aff6-02d72a774429 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:21.390852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd308f52-9003-406f-b548-8911dc484d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:21.391383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd308f52-9003-406f-b548-8911dc484d2d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:21.391658 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd308f52-9003-406f-b548-8911dc484d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:21.391925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd308f52-9003-406f-b548-8911dc484d2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:21.392669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd308f52-9003-406f-b548-8911dc484d2d None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=6c131ed4d88d4908abdcdcbe2e490794, user.id=7f2f7137c60b45c8b0820d9a19819987) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:14:21.392973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd308f52-9003-406f-b548-8911dc484d2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:21.394385 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd308f52-9003-406f-b548-8911dc484d2d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:21.399851 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 589/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:14:21 2022] GET /identity/v3/role_assignments?user.id=7f2f7137c60b45c8b0820d9a19819987&scope.project.id=6c131ed4d88d4908abdcdcbe2e490794&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:23.387345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab3ee1-f7b7-410b-99b1-666673117e3c None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:23.387873 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab3ee1-f7b7-410b-99b1-666673117e3c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:23.387873 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab3ee1-f7b7-410b-99b1-666673117e3c None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:23.389232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 573/1162] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:14:23.394383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117be655-7262-42a2-8984-c5681c248d29 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:23.394770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117be655-7262-42a2-8984-c5681c248d29 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:23.394923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117be655-7262-42a2-8984-c5681c248d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:23.412383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-117be655-7262-42a2-8984-c5681c248d29 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:14:23.413607 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-117be655-7262-42a2-8984-c5681c248d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:14:23.479096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 590/1163] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:14:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:14:23.501853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab3ee1-f7b7-410b-99b1-666673117e3c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:23.557541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:23.600877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab3ee1-f7b7-410b-99b1-666673117e3c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:23.632729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b010eb-562a-4835-8f62-cb627f4f94cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:23.633312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b010eb-562a-4835-8f62-cb627f4f94cc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:23.633588 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b010eb-562a-4835-8f62-cb627f4f94cc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:23.633856 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b010eb-562a-4835-8f62-cb627f4f94cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:23.698306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b010eb-562a-4835-8f62-cb627f4f94cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:23.699664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b010eb-562a-4835-8f62-cb627f4f94cc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:23.751488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:23.794164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 574/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:14:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 16:14:23.800916 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117be655-7262-42a2-8984-c5681c248d29 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:23.858941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:23.894619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117be655-7262-42a2-8984-c5681c248d29 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:23.928462 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db06ce-65de-4327-ae6a-6dde84dee762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:23.929120 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db06ce-65de-4327-ae6a-6dde84dee762 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:23.929397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db06ce-65de-4327-ae6a-6dde84dee762 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:23.929665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db06ce-65de-4327-ae6a-6dde84dee762 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:23.936023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db06ce-65de-4327-ae6a-6dde84dee762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:23.937517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db06ce-65de-4327-ae6a-6dde84dee762 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-55db06ce-65de-4327-ae6a-6dde84dee762 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:14:23.948365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:14:23.949558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:14:23.950596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:14:23.950596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:14:23.950596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:14:23.950596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:14:23.950596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:14:23.950596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:14:23.950596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:14:23.950596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:14:23.950596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:14:23.950596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:14:23.950596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 11 16:14:23.950596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:14:23.950596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 11 16:14:23.950596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:14:23.950596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 591/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Aug 11 16:14:23 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:14:23.955874 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b010eb-562a-4835-8f62-cb627f4f94cc None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:24.050661 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b010eb-562a-4835-8f62-cb627f4f94cc None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:24.083815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee0c8-ce55-4385-8bc7-b83893fa7908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:24.084462 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee0c8-ce55-4385-8bc7-b83893fa7908 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:24.084766 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee0c8-ce55-4385-8bc7-b83893fa7908 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:24.085041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee0c8-ce55-4385-8bc7-b83893fa7908 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:24.085662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee0c8-ce55-4385-8bc7-b83893fa7908 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:14:24.085954 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee0c8-ce55-4385-8bc7-b83893fa7908 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:24.087279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee0c8-ce55-4385-8bc7-b83893fa7908 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:24.094607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 575/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Aug 11 16:14:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:26.064295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b05f35-d29f-45fb-9294-fac014cd8ccf None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:26.064863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b05f35-d29f-45fb-9294-fac014cd8ccf None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:26.064955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b05f35-d29f-45fb-9294-fac014cd8ccf None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:26.066357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 592/1167] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:14:26.071719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae212d09-2374-40a8-91be-02472aef7573 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:26.072141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae212d09-2374-40a8-91be-02472aef7573 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:26.072258 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae212d09-2374-40a8-91be-02472aef7573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:26.091367 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ae212d09-2374-40a8-91be-02472aef7573 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:14:26.092557 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ae212d09-2374-40a8-91be-02472aef7573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:14:26.107197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:26.158466 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 576/1168] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:14:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:14:26.181188 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b05f35-d29f-45fb-9294-fac014cd8ccf None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:26.279193 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b05f35-d29f-45fb-9294-fac014cd8ccf None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:26.301885 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:26.313033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981fce8-7bca-4795-bb61-9088277511e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:26.313616 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981fce8-7bca-4795-bb61-9088277511e5 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:26.313889 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981fce8-7bca-4795-bb61-9088277511e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:26.314151 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981fce8-7bca-4795-bb61-9088277511e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:26.314836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981fce8-7bca-4795-bb61-9088277511e5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:26.316128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981fce8-7bca-4795-bb61-9088277511e5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:26.330317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 593/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Thu Aug 11 16:14:26 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:14:28.314006 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52948159-0a55-4ba6-a3f0-ce40a988e9d7 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:28.314533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52948159-0a55-4ba6-a3f0-ce40a988e9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:28.314533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52948159-0a55-4ba6-a3f0-ce40a988e9d7 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:28.315869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 577/1170] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:14:28.321023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ebd04-0203-4154-a229-d8d77ad2521e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:28.321384 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ebd04-0203-4154-a229-d8d77ad2521e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:28.321571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ebd04-0203-4154-a229-d8d77ad2521e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:28.339149 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5c2ebd04-0203-4154-a229-d8d77ad2521e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:14:28.340326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5c2ebd04-0203-4154-a229-d8d77ad2521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:14:28.404193 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 594/1171] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:14:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:14:28.427909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52948159-0a55-4ba6-a3f0-ce40a988e9d7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:28.525694 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52948159-0a55-4ba6-a3f0-ce40a988e9d7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:28.558600 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e0b17-bf8e-46e0-ba59-75d9daddec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:28.559206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e0b17-bf8e-46e0-ba59-75d9daddec1b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:28.559484 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e0b17-bf8e-46e0-ba59-75d9daddec1b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:28.559757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e0b17-bf8e-46e0-ba59-75d9daddec1b None admin] PATH_INFO: `/v3/domains/235d8d9f2a2e4c5b923305da74124c6e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:28.569792 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e0b17-bf8e-46e0-ba59-75d9daddec1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=235d8d9f2a2e4c5b923305da74124c6e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:28.571162 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e0b17-bf8e-46e0-ba59-75d9daddec1b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:28.572799 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 578/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Thu Aug 11 16:14:28 2022] GET /identity/v3/domains/235d8d9f2a2e4c5b923305da74124c6e => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:28.579192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ebd04-0203-4154-a229-d8d77ad2521e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:28.674706 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ebd04-0203-4154-a229-d8d77ad2521e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:28.694719 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:28.725016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa29903-3320-4d92-a4ba-66c6441f7deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:28.725626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa29903-3320-4d92-a4ba-66c6441f7deb None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:28.729756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa29903-3320-4d92-a4ba-66c6441f7deb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:28.730045 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa29903-3320-4d92-a4ba-66c6441f7deb None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:28.730687 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa29903-3320-4d92-a4ba-66c6441f7deb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:28.732110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa29903-3320-4d92-a4ba-66c6441f7deb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:28.759757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 595/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Aug 11 16:14:28 2022] POST /identity/v3/projects => generated 361 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:14:30.763890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9956729-1e26-4b10-a63e-24f4f2fe77a2 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:30.764404 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9956729-1e26-4b10-a63e-24f4f2fe77a2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:30.764404 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9956729-1e26-4b10-a63e-24f4f2fe77a2 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:30.765758 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 579/1174] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:14:30.770930 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f59dcb-93ec-4eaf-a69b-c8eba0bc4c3d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:30.771307 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f59dcb-93ec-4eaf-a69b-c8eba0bc4c3d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:30.771476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f59dcb-93ec-4eaf-a69b-c8eba0bc4c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:30.789351 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a5f59dcb-93ec-4eaf-a69b-c8eba0bc4c3d None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:14:30.790510 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a5f59dcb-93ec-4eaf-a69b-c8eba0bc4c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:14:30.856199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 596/1175] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:14:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:14:30.881300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9956729-1e26-4b10-a63e-24f4f2fe77a2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:30.893802 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:30.980664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9956729-1e26-4b10-a63e-24f4f2fe77a2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:31.013560 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa765e-7702-4858-9582-0070eb70c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:31.014208 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa765e-7702-4858-9582-0070eb70c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:31.014433 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa765e-7702-4858-9582-0070eb70c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:31.014698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa765e-7702-4858-9582-0070eb70c7d7 None admin] PATH_INFO: `/v3/domains/235d8d9f2a2e4c5b923305da74124c6e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:31.015805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa765e-7702-4858-9582-0070eb70c7d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=235d8d9f2a2e4c5b923305da74124c6e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:31.017242 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa765e-7702-4858-9582-0070eb70c7d7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:31.018757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 580/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Thu Aug 11 16:14:30 2022] GET /identity/v3/domains/235d8d9f2a2e4c5b923305da74124c6e => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:31.024599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f59dcb-93ec-4eaf-a69b-c8eba0bc4c3d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:31.113526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:31.119905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f59dcb-93ec-4eaf-a69b-c8eba0bc4c3d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:31.152782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf467c6-bdd9-4ebe-ac14-7d04137a3e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:31.153369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf467c6-bdd9-4ebe-ac14-7d04137a3e70 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:31.153642 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf467c6-bdd9-4ebe-ac14-7d04137a3e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:31.153908 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf467c6-bdd9-4ebe-ac14-7d04137a3e70 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:31.154530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf467c6-bdd9-4ebe-ac14-7d04137a3e70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:31.156461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf467c6-bdd9-4ebe-ac14-7d04137a3e70 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:31.177970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 597/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:14:31 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:14:33.208362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f721f-9487-465f-bbd7-fb1d83ed7a7a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:33.208962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f721f-9487-465f-bbd7-fb1d83ed7a7a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:33.208962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f721f-9487-465f-bbd7-fb1d83ed7a7a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:33.210396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 581/1178] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:14:33.215543 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75df98-863d-49fe-9c9c-ddfa671d2b29 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:33.215938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75df98-863d-49fe-9c9c-ddfa671d2b29 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:33.216088 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75df98-863d-49fe-9c9c-ddfa671d2b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:33.235067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6b75df98-863d-49fe-9c9c-ddfa671d2b29 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:14:33.236241 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6b75df98-863d-49fe-9c9c-ddfa671d2b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:14:33.300730 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 598/1179] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:14:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:14:33.323638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f721f-9487-465f-bbd7-fb1d83ed7a7a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:33.401364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:33.424960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f721f-9487-465f-bbd7-fb1d83ed7a7a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:33.459414 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe622e-1684-4b54-96bb-a43a1c58bc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:33.459966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe622e-1684-4b54-96bb-a43a1c58bc93 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:33.460248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe622e-1684-4b54-96bb-a43a1c58bc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:33.460522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe622e-1684-4b54-96bb-a43a1c58bc93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:33.470919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe622e-1684-4b54-96bb-a43a1c58bc93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-d6fe622e-1684-4b54-96bb-a43a1c58bc93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:14:33.475523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:14:33.476637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:14:33.477649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:14:33.477649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:14:33.477649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:14:33.477649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:14:33.477649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:14:33.477649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:14:33.477649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:14:33.477649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:14:33.477649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:14:33.477649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:14:33.477649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:14:33.477649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:14:33.477649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 582/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:14:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:14:33.482847 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75df98-863d-49fe-9c9c-ddfa671d2b29 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:33.560146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:33.578859 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75df98-863d-49fe-9c9c-ddfa671d2b29 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:33.611042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab993ede-8620-4fd5-ae1a-c793efa418ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:33.611640 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab993ede-8620-4fd5-ae1a-c793efa418ca None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:33.611925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab993ede-8620-4fd5-ae1a-c793efa418ca None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:33.612200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab993ede-8620-4fd5-ae1a-c793efa418ca None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:33.612898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab993ede-8620-4fd5-ae1a-c793efa418ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:14:33.613207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab993ede-8620-4fd5-ae1a-c793efa418ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:33.614564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab993ede-8620-4fd5-ae1a-c793efa418ca None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:33.622369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 599/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:14:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:33.628521 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe622e-1684-4b54-96bb-a43a1c58bc93 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:33.724671 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe622e-1684-4b54-96bb-a43a1c58bc93 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:33.757659 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4be77-cb30-496c-9267-1b07c5e5c3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:33.758267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4be77-cb30-496c-9267-1b07c5e5c3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:33.758547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4be77-cb30-496c-9267-1b07c5e5c3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:33.758821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4be77-cb30-496c-9267-1b07c5e5c3c7 None admin] PATH_INFO: `/v3/users/fcb6f9e323c447c6aa6c1075b2eb386b` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:33.767226 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:33.773163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4be77-cb30-496c-9267-1b07c5e5c3c7 None admin] RBAC: Authorizing `identity:get_user(user_id=fcb6f9e323c447c6aa6c1075b2eb386b)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:33.774597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4be77-cb30-496c-9267-1b07c5e5c3c7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:33.776171 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 583/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:14:33 2022] GET /identity/v3/users/fcb6f9e323c447c6aa6c1075b2eb386b => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:33.781952 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab993ede-8620-4fd5-ae1a-c793efa418ca None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:33.879478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab993ede-8620-4fd5-ae1a-c793efa418ca None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:33.911262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b45d7f-a6d6-442c-af4f-50e2c6c4af73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:33.911855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45d7f-a6d6-442c-af4f-50e2c6c4af73 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:33.912135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45d7f-a6d6-442c-af4f-50e2c6c4af73 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:33.912406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45d7f-a6d6-442c-af4f-50e2c6c4af73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:33.926868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:33.977956 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b45d7f-a6d6-442c-af4f-50e2c6c4af73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:33.979331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b45d7f-a6d6-442c-af4f-50e2c6c4af73 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:34.079259 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 600/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:14:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 16:14:34.085189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4be77-cb30-496c-9267-1b07c5e5c3c7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:34.188604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4be77-cb30-496c-9267-1b07c5e5c3c7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:34.221584 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db7bcd-be51-429d-8dc9-dec5bbda73fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:34.222192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db7bcd-be51-429d-8dc9-dec5bbda73fb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:34.222467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db7bcd-be51-429d-8dc9-dec5bbda73fb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:34.222736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db7bcd-be51-429d-8dc9-dec5bbda73fb None admin] PATH_INFO: `/v3/projects/e0c120a60b7341c3a59064c8848353a6` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:34.223823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db7bcd-be51-429d-8dc9-dec5bbda73fb None admin] RBAC: Authorizing `identity:get_project(project_id=e0c120a60b7341c3a59064c8848353a6)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:34.225268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db7bcd-be51-429d-8dc9-dec5bbda73fb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:34.226858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 584/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:14:34 2022] GET /identity/v3/projects/e0c120a60b7341c3a59064c8848353a6 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:34.233249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b45d7f-a6d6-442c-af4f-50e2c6c4af73 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:34.278013 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:34.329704 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b45d7f-a6d6-442c-af4f-50e2c6c4af73 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:34.361699 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7023c-c73b-41f9-a060-ec62ebb0060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:34.362289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7023c-c73b-41f9-a060-ec62ebb0060d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:34.362566 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7023c-c73b-41f9-a060-ec62ebb0060d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:34.362843 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7023c-c73b-41f9-a060-ec62ebb0060d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:34.363574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7023c-c73b-41f9-a060-ec62ebb0060d None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=e0c120a60b7341c3a59064c8848353a6, user.id=fcb6f9e323c447c6aa6c1075b2eb386b) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:14:34.363878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7023c-c73b-41f9-a060-ec62ebb0060d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:34.365314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7023c-c73b-41f9-a060-ec62ebb0060d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:34.370402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 601/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:14:34 2022] GET /identity/v3/role_assignments?user.id=fcb6f9e323c447c6aa6c1075b2eb386b&scope.project.id=e0c120a60b7341c3a59064c8848353a6&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:36.348721 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca664762-a289-4dc3-860b-3775a133b8b3 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:36.349356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca664762-a289-4dc3-860b-3775a133b8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:36.349356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca664762-a289-4dc3-860b-3775a133b8b3 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:36.350576 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 585/1186] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:14:36.355807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cff5e8-4856-4904-9c25-c1324dbf7ca1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:36.356232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cff5e8-4856-4904-9c25-c1324dbf7ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:36.356355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cff5e8-4856-4904-9c25-c1324dbf7ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:36.374100 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-12cff5e8-4856-4904-9c25-c1324dbf7ca1 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:14:36.375790 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-12cff5e8-4856-4904-9c25-c1324dbf7ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:14:36.441815 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 602/1187] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:14:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 16:14:36.464345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca664762-a289-4dc3-860b-3775a133b8b3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:36.526280 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:36.564006 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca664762-a289-4dc3-860b-3775a133b8b3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:36.596962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429dad5-3607-4d45-b6ea-26961114b26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:36.597573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429dad5-3607-4d45-b6ea-26961114b26e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:36.597853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429dad5-3607-4d45-b6ea-26961114b26e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:36.598126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429dad5-3607-4d45-b6ea-26961114b26e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:36.607929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429dad5-3607-4d45-b6ea-26961114b26e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-8429dad5-3607-4d45-b6ea-26961114b26e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:14:36.612496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:14:36.613658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:14:36.614755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:14:36.614755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:14:36.614755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:14:36.614755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:14:36.614755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:14:36.614755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:14:36.614755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:14:36.614755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:14:36.614755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:14:36.614755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:14:36.614755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:14:36.614755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:14:36.614755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 586/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:14:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:14:36.619590 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cff5e8-4856-4904-9c25-c1324dbf7ca1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:36.658245 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:36.716600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cff5e8-4856-4904-9c25-c1324dbf7ca1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:36.749805 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981b4ff-cf22-4fe8-907b-8caac12d46a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:36.750409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981b4ff-cf22-4fe8-907b-8caac12d46a9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:36.750690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981b4ff-cf22-4fe8-907b-8caac12d46a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:36.750964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981b4ff-cf22-4fe8-907b-8caac12d46a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:36.751622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981b4ff-cf22-4fe8-907b-8caac12d46a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:14:36.751924 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981b4ff-cf22-4fe8-907b-8caac12d46a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:36.753310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981b4ff-cf22-4fe8-907b-8caac12d46a9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:36.761016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 603/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:14:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:36.766735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429dad5-3607-4d45-b6ea-26961114b26e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:36.866551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429dad5-3607-4d45-b6ea-26961114b26e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:36.889339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:36.899991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32247c3a-2f3c-4380-8bad-f824f9c807a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:36.900614 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32247c3a-2f3c-4380-8bad-f824f9c807a0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:36.900911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32247c3a-2f3c-4380-8bad-f824f9c807a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:36.901180 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32247c3a-2f3c-4380-8bad-f824f9c807a0 None admin] PATH_INFO: `/v3/users/fcb6f9e323c447c6aa6c1075b2eb386b` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:36.902282 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32247c3a-2f3c-4380-8bad-f824f9c807a0 None admin] RBAC: Authorizing `identity:get_user(user_id=fcb6f9e323c447c6aa6c1075b2eb386b)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:36.903710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32247c3a-2f3c-4380-8bad-f824f9c807a0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:36.905271 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 587/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:14:36 2022] GET /identity/v3/users/fcb6f9e323c447c6aa6c1075b2eb386b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:36.911077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981b4ff-cf22-4fe8-907b-8caac12d46a9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:37.005067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:37.008075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981b4ff-cf22-4fe8-907b-8caac12d46a9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:37.040396 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4a630-3e9f-43b1-98d3-11fa1a8ed662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:37.041043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4a630-3e9f-43b1-98d3-11fa1a8ed662 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:37.041324 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4a630-3e9f-43b1-98d3-11fa1a8ed662 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:37.041596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4a630-3e9f-43b1-98d3-11fa1a8ed662 None admin] PATH_INFO: `/v3/projects/e0c120a60b7341c3a59064c8848353a6` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:37.042989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4a630-3e9f-43b1-98d3-11fa1a8ed662 None admin] RBAC: Authorizing `identity:get_project(project_id=e0c120a60b7341c3a59064c8848353a6)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:37.044402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4a630-3e9f-43b1-98d3-11fa1a8ed662 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:37.046570 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 604/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:14:36 2022] GET /identity/v3/projects/e0c120a60b7341c3a59064c8848353a6 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:37.052494 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32247c3a-2f3c-4380-8bad-f824f9c807a0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:37.149169 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32247c3a-2f3c-4380-8bad-f824f9c807a0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:37.182833 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f8f96-15fb-4d15-bd03-71d31b6a8403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:37.183470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f8f96-15fb-4d15-bd03-71d31b6a8403 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:37.183751 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f8f96-15fb-4d15-bd03-71d31b6a8403 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:37.184025 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f8f96-15fb-4d15-bd03-71d31b6a8403 None admin] PATH_INFO: `/v3/projects/e0c120a60b7341c3a59064c8848353a6/users/fcb6f9e323c447c6aa6c1075b2eb386b/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:37.185966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f8f96-15fb-4d15-bd03-71d31b6a8403 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0c120a60b7341c3a59064c8848353a6, user_id=fcb6f9e323c447c6aa6c1075b2eb386b, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:37.187383 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f8f96-15fb-4d15-bd03-71d31b6a8403 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:37.200106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 588/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:14:37 2022] PUT /identity/v3/projects/e0c120a60b7341c3a59064c8848353a6/users/fcb6f9e323c447c6aa6c1075b2eb386b/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:14:39.159723 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec80ef1-c67b-415e-9c19-f2b709a8bfd9 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:39.160310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec80ef1-c67b-415e-9c19-f2b709a8bfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:39.160310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec80ef1-c67b-415e-9c19-f2b709a8bfd9 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:39.161630 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 605/1193] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:14:39.166728 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624be59-1e6e-49d2-b38f-ebbeba41f2c1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:39.167421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624be59-1e6e-49d2-b38f-ebbeba41f2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:39.167650 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624be59-1e6e-49d2-b38f-ebbeba41f2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:39.185198 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7624be59-1e6e-49d2-b38f-ebbeba41f2c1 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:14:39.186355 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7624be59-1e6e-49d2-b38f-ebbeba41f2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:14:39.233099 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:39.252708 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 589/1194] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:14:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:14:39.275986 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec80ef1-c67b-415e-9c19-f2b709a8bfd9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:39.373344 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec80ef1-c67b-415e-9c19-f2b709a8bfd9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:39.405967 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a0080-ad32-43b4-b4f5-ac4fd53d7702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:39.406569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a0080-ad32-43b4-b4f5-ac4fd53d7702 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:39.406843 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a0080-ad32-43b4-b4f5-ac4fd53d7702 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:39.407114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a0080-ad32-43b4-b4f5-ac4fd53d7702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:39.417518 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a0080-ad32-43b4-b4f5-ac4fd53d7702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-6c0a0080-ad32-43b4-b4f5-ac4fd53d7702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:14:39.422067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:14:39.423127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:14:39.424141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:14:39.424141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:14:39.424141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:14:39.424141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:14:39.424141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:14:39.424141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:14:39.424141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:14:39.424141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:14:39.424141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:14:39.424141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:14:39.424141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:14:39.424141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:14:39.424141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 606/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:14:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:14:39.429075 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624be59-1e6e-49d2-b38f-ebbeba41f2c1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:39.528428 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624be59-1e6e-49d2-b38f-ebbeba41f2c1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:39.560380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6079e-676f-4532-9b16-9c388f3b4183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:39.561002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6079e-676f-4532-9b16-9c388f3b4183 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:39.561274 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6079e-676f-4532-9b16-9c388f3b4183 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:39.561543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6079e-676f-4532-9b16-9c388f3b4183 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:39.562713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6079e-676f-4532-9b16-9c388f3b4183 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:14:39.563008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6079e-676f-4532-9b16-9c388f3b4183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:39.564350 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6079e-676f-4532-9b16-9c388f3b4183 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:39.572008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 590/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:14:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:39.578434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a0080-ad32-43b4-b4f5-ac4fd53d7702 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:39.605758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:39.674973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a0080-ad32-43b4-b4f5-ac4fd53d7702 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:39.707468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336731d-83d4-47bc-b333-73845d64058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:39.708066 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336731d-83d4-47bc-b333-73845d64058a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:39.708339 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336731d-83d4-47bc-b333-73845d64058a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:39.708627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336731d-83d4-47bc-b333-73845d64058a None admin] PATH_INFO: `/v3/users/fcb6f9e323c447c6aa6c1075b2eb386b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:39.709727 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336731d-83d4-47bc-b333-73845d64058a None admin] RBAC: Authorizing `identity:get_user(user_id=fcb6f9e323c447c6aa6c1075b2eb386b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:39.711128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336731d-83d4-47bc-b333-73845d64058a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:39.712673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 607/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Aug 11 16:14:39 2022] GET /identity/v3/users/fcb6f9e323c447c6aa6c1075b2eb386b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:39.718405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6079e-676f-4532-9b16-9c388f3b4183 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:39.763107 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:39.816985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6079e-676f-4532-9b16-9c388f3b4183 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:39.853960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d36541-328a-47d0-97d3-82eea96845e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:39.854549 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d36541-328a-47d0-97d3-82eea96845e0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:39.854824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d36541-328a-47d0-97d3-82eea96845e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:39.855091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d36541-328a-47d0-97d3-82eea96845e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:39.920138 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d36541-328a-47d0-97d3-82eea96845e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:39.922287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d36541-328a-47d0-97d3-82eea96845e0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:39.964257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:40.018527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 591/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:14:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 16:14:40.024601 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336731d-83d4-47bc-b333-73845d64058a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:40.117471 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:40.123393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336731d-83d4-47bc-b333-73845d64058a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:40.157875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414be1ff-c0a6-4b9b-83eb-e76d7bd33837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:40.158494 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414be1ff-c0a6-4b9b-83eb-e76d7bd33837 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:40.158773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414be1ff-c0a6-4b9b-83eb-e76d7bd33837 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:40.159043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414be1ff-c0a6-4b9b-83eb-e76d7bd33837 None admin] PATH_INFO: `/v3/projects/e0c120a60b7341c3a59064c8848353a6` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:40.160159 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414be1ff-c0a6-4b9b-83eb-e76d7bd33837 None admin] RBAC: Authorizing `identity:get_project(project_id=e0c120a60b7341c3a59064c8848353a6)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:40.161598 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414be1ff-c0a6-4b9b-83eb-e76d7bd33837 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:40.163224 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 608/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Aug 11 16:14:40 2022] GET /identity/v3/projects/e0c120a60b7341c3a59064c8848353a6 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:40.169604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d36541-328a-47d0-97d3-82eea96845e0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:14:40.264657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d36541-328a-47d0-97d3-82eea96845e0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:14:40.297560 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b855b69-e77c-4232-8678-dfbc081c30dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:14:40.298139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b855b69-e77c-4232-8678-dfbc081c30dc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:14:40.298412 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b855b69-e77c-4232-8678-dfbc081c30dc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:14:40.298679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b855b69-e77c-4232-8678-dfbc081c30dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:14:40.299380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b855b69-e77c-4232-8678-dfbc081c30dc None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=e0c120a60b7341c3a59064c8848353a6, user.id=fcb6f9e323c447c6aa6c1075b2eb386b) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:14:40.299677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b855b69-e77c-4232-8678-dfbc081c30dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:14:40.301105 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b855b69-e77c-4232-8678-dfbc081c30dc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:14:40.306538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 592/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:14:40 2022] GET /identity/v3/role_assignments?user.id=fcb6f9e323c447c6aa6c1075b2eb386b&scope.project.id=e0c120a60b7341c3a59064c8848353a6&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:14:50.153145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=18 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:14:50.304063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:35.148681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016ee8a-e9cb-4c39-b394-8cb45c7007af None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:35.149357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016ee8a-e9cb-4c39-b394-8cb45c7007af None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:35.149357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016ee8a-e9cb-4c39-b394-8cb45c7007af None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:35.150407 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 609/1201] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:15:35.157743 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438de64c-bc63-4437-a09d-2ecbd1d983f4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:35.158364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438de64c-bc63-4437-a09d-2ecbd1d983f4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:35.158364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438de64c-bc63-4437-a09d-2ecbd1d983f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:35.184306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-438de64c-bc63-4437-a09d-2ecbd1d983f4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:15:35.186154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-438de64c-bc63-4437-a09d-2ecbd1d983f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:15:35.266960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 593/1202] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:15:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:15:35.294470 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016ee8a-e9cb-4c39-b394-8cb45c7007af None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:35.434127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016ee8a-e9cb-4c39-b394-8cb45c7007af None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:35.495622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6fe5c-9ca8-41b4-9b1a-4a551bd6449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:35.496274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6fe5c-9ca8-41b4-9b1a-4a551bd6449e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:35.496546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6fe5c-9ca8-41b4-9b1a-4a551bd6449e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:35.496839 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6fe5c-9ca8-41b4-9b1a-4a551bd6449e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:35.509640 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6fe5c-9ca8-41b4-9b1a-4a551bd6449e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:35.511077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6fe5c-9ca8-41b4-9b1a-4a551bd6449e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-69b6fe5c-9ca8-41b4-9b1a-4a551bd6449e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:15:35.526288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:35.527353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:15:35.528321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:15:35.528321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:35.528321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:15:35.529870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 610/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:35.536280 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438de64c-bc63-4437-a09d-2ecbd1d983f4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:35.662778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438de64c-bc63-4437-a09d-2ecbd1d983f4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:35.703639 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:35.711993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b225fd9-9c98-4b0a-abc7-f9bf04c19981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:35.712729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b225fd9-9c98-4b0a-abc7-f9bf04c19981 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:35.713046 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b225fd9-9c98-4b0a-abc7-f9bf04c19981 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:35.713371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b225fd9-9c98-4b0a-abc7-f9bf04c19981 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:35.714126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b225fd9-9c98-4b0a-abc7-f9bf04c19981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:35.714466 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b225fd9-9c98-4b0a-abc7-f9bf04c19981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:35.716191 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b225fd9-9c98-4b0a-abc7-f9bf04c19981 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:35.734510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 594/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:15:35.740737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6fe5c-9ca8-41b4-9b1a-4a551bd6449e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:35.819326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:35.888838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6fe5c-9ca8-41b4-9b1a-4a551bd6449e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:35.935670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749ac12-ae24-4e4f-8ec8-b2ea275f8efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:35.935670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749ac12-ae24-4e4f-8ec8-b2ea275f8efc None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:35.935670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749ac12-ae24-4e4f-8ec8-b2ea275f8efc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:35.935670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749ac12-ae24-4e4f-8ec8-b2ea275f8efc None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:35.936184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749ac12-ae24-4e4f-8ec8-b2ea275f8efc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:35.936184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749ac12-ae24-4e4f-8ec8-b2ea275f8efc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:35.964710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 611/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Aug 11 16:15:35 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:15:38.134700 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f57b6a-b3f6-469e-b3f4-6915c40c915a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:38.135305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f57b6a-b3f6-469e-b3f4-6915c40c915a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:38.135305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f57b6a-b3f6-469e-b3f4-6915c40c915a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:38.137001 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 595/1206] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:15:38.142809 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a05902-99fd-4fff-a4b8-b6a11f4d530a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:38.145889 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a05902-99fd-4fff-a4b8-b6a11f4d530a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:38.146284 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a05902-99fd-4fff-a4b8-b6a11f4d530a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:38.172152 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b7a05902-99fd-4fff-a4b8-b6a11f4d530a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:15:38.173887 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b7a05902-99fd-4fff-a4b8-b6a11f4d530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:15:38.256648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 612/1207] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:15:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:15:38.276349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f57b6a-b3f6-469e-b3f4-6915c40c915a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:38.397508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f57b6a-b3f6-469e-b3f4-6915c40c915a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:38.439319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa297df-aa75-426f-adce-e25dacbf8b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:38.439966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa297df-aa75-426f-adce-e25dacbf8b45 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:38.440254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa297df-aa75-426f-adce-e25dacbf8b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:38.440523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa297df-aa75-426f-adce-e25dacbf8b45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:38.452530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa297df-aa75-426f-adce-e25dacbf8b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-7fa297df-aa75-426f-adce-e25dacbf8b45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:15:38.457727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:38.458936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:38.460206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:38.460206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:38.460206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:38.460206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:38.460206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:15:38.460206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:15:38.460206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:15:38.460206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:15:38.460206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:15:38.460206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:15:38.460206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:15:38.460206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:15:38.460206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 596/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:15:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:38.465019 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a05902-99fd-4fff-a4b8-b6a11f4d530a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:38.512350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:38.586493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a05902-99fd-4fff-a4b8-b6a11f4d530a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:38.623905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed213a55-72ce-4de4-a4d8-74962ac3e6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:38.624555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed213a55-72ce-4de4-a4d8-74962ac3e6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:38.624876 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed213a55-72ce-4de4-a4d8-74962ac3e6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:38.625144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed213a55-72ce-4de4-a4d8-74962ac3e6d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:38.625800 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed213a55-72ce-4de4-a4d8-74962ac3e6d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:38.626137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed213a55-72ce-4de4-a4d8-74962ac3e6d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:38.627513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed213a55-72ce-4de4-a4d8-74962ac3e6d4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:38.636100 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 613/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:15:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:15:38.642603 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa297df-aa75-426f-adce-e25dacbf8b45 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:38.707960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:38.768783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa297df-aa75-426f-adce-e25dacbf8b45 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:38.809197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db51e24-384a-4bb9-ac53-b7d9cf98e6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:38.809793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db51e24-384a-4bb9-ac53-b7d9cf98e6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:38.810065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db51e24-384a-4bb9-ac53-b7d9cf98e6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:38.810341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db51e24-384a-4bb9-ac53-b7d9cf98e6d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:38.821580 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db51e24-384a-4bb9-ac53-b7d9cf98e6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:38.823040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db51e24-384a-4bb9-ac53-b7d9cf98e6d2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-4db51e24-384a-4bb9-ac53-b7d9cf98e6d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:15:38.837591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:38.839214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:15:38.840109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:15:38.840109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:38.840109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:15:38.843989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 597/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:38.845011 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed213a55-72ce-4de4-a4d8-74962ac3e6d4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:38.966528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:38.971769 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed213a55-72ce-4de4-a4d8-74962ac3e6d4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:39.009682 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d32a0b-c7da-4884-a47e-ce78f2015c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:39.010300 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d32a0b-c7da-4884-a47e-ce78f2015c9f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:39.010615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d32a0b-c7da-4884-a47e-ce78f2015c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:39.010915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d32a0b-c7da-4884-a47e-ce78f2015c9f None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:39.011656 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d32a0b-c7da-4884-a47e-ce78f2015c9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:39.011957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d32a0b-c7da-4884-a47e-ce78f2015c9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:39.014250 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d32a0b-c7da-4884-a47e-ce78f2015c9f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:39.032351 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 614/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:39.033749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db51e24-384a-4bb9-ac53-b7d9cf98e6d2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:39.148706 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db51e24-384a-4bb9-ac53-b7d9cf98e6d2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:39.149365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:39.188215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d942a-1623-490a-be92-f1b167c46dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:39.188911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d942a-1623-490a-be92-f1b167c46dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:39.189141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d942a-1623-490a-be92-f1b167c46dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:39.189459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d942a-1623-490a-be92-f1b167c46dc3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:39.197685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d942a-1623-490a-be92-f1b167c46dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:39.199328 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d942a-1623-490a-be92-f1b167c46dc3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-253d942a-1623-490a-be92-f1b167c46dc3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:15:39.211493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:39.212662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:39.213992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:39.213992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:39.213992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:15:39.213992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:15:39.213992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:15:39.213992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:15:39.213992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:15:39.213992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:15:39.213992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 16:15:39.213992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:15:39.213992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 598/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:39.219326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d32a0b-c7da-4884-a47e-ce78f2015c9f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:39.336528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d32a0b-c7da-4884-a47e-ce78f2015c9f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:39.379418 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec1264-aa04-4b2a-9907-160fc8f918b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:39.380084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec1264-aa04-4b2a-9907-160fc8f918b7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:39.380400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec1264-aa04-4b2a-9907-160fc8f918b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:39.380703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec1264-aa04-4b2a-9907-160fc8f918b7 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:39.381456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec1264-aa04-4b2a-9907-160fc8f918b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:39.381770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec1264-aa04-4b2a-9907-160fc8f918b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:39.383280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec1264-aa04-4b2a-9907-160fc8f918b7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:39.404393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 615/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Aug 11 16:15:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:39.410571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d942a-1623-490a-be92-f1b167c46dc3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:39.535310 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d942a-1623-490a-be92-f1b167c46dc3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:39.579887 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8983fb0-db3c-4003-8855-143a0e1b1857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:39.580502 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8983fb0-db3c-4003-8855-143a0e1b1857 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:39.580806 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8983fb0-db3c-4003-8855-143a0e1b1857 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:39.581079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8983fb0-db3c-4003-8855-143a0e1b1857 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:39.613161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:39.661943 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8983fb0-db3c-4003-8855-143a0e1b1857 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:39.663488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8983fb0-db3c-4003-8855-143a0e1b1857 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:39.790753 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 599/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:15:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 16:15:39.792343 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec1264-aa04-4b2a-9907-160fc8f918b7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:39.813506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:39.922092 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec1264-aa04-4b2a-9907-160fc8f918b7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:39.965275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cfdfe-50c2-405b-a942-631e8bcf02f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:39.965902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cfdfe-50c2-405b-a942-631e8bcf02f2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:39.966172 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cfdfe-50c2-405b-a942-631e8bcf02f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:39.966437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cfdfe-50c2-405b-a942-631e8bcf02f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:39.985010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cfdfe-50c2-405b-a942-631e8bcf02f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:39.986739 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cfdfe-50c2-405b-a942-631e8bcf02f2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-866cfdfe-50c2-405b-a942-631e8bcf02f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:15:40.006493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:40.007552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:15:40.012937 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:15:40.012937 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:40.012937 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:15:40.012937 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 616/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:40.013499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8983fb0-db3c-4003-8855-143a0e1b1857 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:40.085592 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:40.136133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8983fb0-db3c-4003-8855-143a0e1b1857 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:40.178435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca928b6e-09d0-416f-a779-5f68fced9e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:40.179162 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca928b6e-09d0-416f-a779-5f68fced9e57 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:40.180207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca928b6e-09d0-416f-a779-5f68fced9e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:40.180207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca928b6e-09d0-416f-a779-5f68fced9e57 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:40.180507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca928b6e-09d0-416f-a779-5f68fced9e57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:40.180843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca928b6e-09d0-416f-a779-5f68fced9e57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:40.182233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca928b6e-09d0-416f-a779-5f68fced9e57 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:40.196065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 600/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:40.202003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cfdfe-50c2-405b-a942-631e8bcf02f2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:40.291876 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:40.324331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cfdfe-50c2-405b-a942-631e8bcf02f2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:40.370047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5152c9-15ef-4e20-a09b-b301fc68c905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:40.370628 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5152c9-15ef-4e20-a09b-b301fc68c905 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:40.370899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5152c9-15ef-4e20-a09b-b301fc68c905 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:40.371168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5152c9-15ef-4e20-a09b-b301fc68c905 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:40.378741 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5152c9-15ef-4e20-a09b-b301fc68c905 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:40.380194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5152c9-15ef-4e20-a09b-b301fc68c905 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:40.393409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2a5152c9-15ef-4e20-a09b-b301fc68c905 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:15:40.393409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:40.393409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:40.393409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:40.393409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:40.393409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:40.393409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:40.393409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:40.393409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:40.393409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:40.393409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:40.393409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:40.393409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:15:40.393409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:15:40.393409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:40.399422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:40.400517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:15:40.400517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:15:40.400517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:15:40.400517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:15:40.400517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:15:40.400517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:15:40.400517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:15:40.400517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:15:40.400517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 617/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:15:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:40.402270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca928b6e-09d0-416f-a779-5f68fced9e57 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:40.532679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca928b6e-09d0-416f-a779-5f68fced9e57 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:40.556329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:40.569039 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e409b5b-3b85-4c28-a538-778fa97836e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:40.569642 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e409b5b-3b85-4c28-a538-778fa97836e0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:40.569916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e409b5b-3b85-4c28-a538-778fa97836e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:40.570184 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e409b5b-3b85-4c28-a538-778fa97836e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:40.570870 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e409b5b-3b85-4c28-a538-778fa97836e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:40.571167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e409b5b-3b85-4c28-a538-778fa97836e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:40.572579 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e409b5b-3b85-4c28-a538-778fa97836e0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:40.585424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 601/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:15:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:40.591394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5152c9-15ef-4e20-a09b-b301fc68c905 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:40.700100 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5152c9-15ef-4e20-a09b-b301fc68c905 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:40.729849 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:40.737756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f84ee-a225-48cb-866d-52f61881cd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:40.738362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f84ee-a225-48cb-866d-52f61881cd08 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:40.738650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f84ee-a225-48cb-866d-52f61881cd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:40.738902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f84ee-a225-48cb-866d-52f61881cd08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:40.739620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f84ee-a225-48cb-866d-52f61881cd08 None admin] RBAC: Adding query filter params (role.id=b4c209d1895841af9203c4e432176eb9, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=64e1c7e6ee814b47912760cf7daf54c0) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:40.739922 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f84ee-a225-48cb-866d-52f61881cd08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:40.741374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f84ee-a225-48cb-866d-52f61881cd08 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:40.747075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 618/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:15:40 2022] GET /identity/v3/role_assignments?user.id=64e1c7e6ee814b47912760cf7daf54c0&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=b4c209d1895841af9203c4e432176eb9 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:15:42.877684 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf59d9-2102-4b88-bd1d-96e40d6242fa None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:42.878242 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf59d9-2102-4b88-bd1d-96e40d6242fa None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:42.878242 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf59d9-2102-4b88-bd1d-96e40d6242fa None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:42.879541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 602/1220] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:15:42.884767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5af4d-4f21-4aa3-b9e2-ecd36c4987c9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:42.885353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5af4d-4f21-4aa3-b9e2-ecd36c4987c9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:42.885353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5af4d-4f21-4aa3-b9e2-ecd36c4987c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:42.903753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7fd5af4d-4f21-4aa3-b9e2-ecd36c4987c9 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:15:42.904965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7fd5af4d-4f21-4aa3-b9e2-ecd36c4987c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:15:42.979181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 619/1221] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:15:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:15:43.002762 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf59d9-2102-4b88-bd1d-96e40d6242fa None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:43.114723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf59d9-2102-4b88-bd1d-96e40d6242fa None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:43.148446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f935c31-08ef-47f5-8023-9b74a657d9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:43.149027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f935c31-08ef-47f5-8023-9b74a657d9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:43.149304 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f935c31-08ef-47f5-8023-9b74a657d9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:43.149576 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f935c31-08ef-47f5-8023-9b74a657d9b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:43.160613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f935c31-08ef-47f5-8023-9b74a657d9b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-5f935c31-08ef-47f5-8023-9b74a657d9b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:15:43.165248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:43.166756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:43.167909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:43.167909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:43.167909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:43.167909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:43.167909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:15:43.167909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:15:43.167909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:15:43.167909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:15:43.167909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:15:43.167909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:15:43.167909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:15:43.167909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:15:43.175330 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 603/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:15:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:43.175480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5af4d-4f21-4aa3-b9e2-ecd36c4987c9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:43.274693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5af4d-4f21-4aa3-b9e2-ecd36c4987c9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:43.303643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:43.315703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14901ab0-dd29-404d-b0d0-fe50e97b999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:43.316308 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14901ab0-dd29-404d-b0d0-fe50e97b999a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:43.316613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14901ab0-dd29-404d-b0d0-fe50e97b999a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:43.316879 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14901ab0-dd29-404d-b0d0-fe50e97b999a None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:43.317543 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14901ab0-dd29-404d-b0d0-fe50e97b999a None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:43.317842 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14901ab0-dd29-404d-b0d0-fe50e97b999a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:43.319231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14901ab0-dd29-404d-b0d0-fe50e97b999a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:43.326971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 620/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:15:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:43.332940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f935c31-08ef-47f5-8023-9b74a657d9b4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:43.385844 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:43.445882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f935c31-08ef-47f5-8023-9b74a657d9b4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:43.489122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e1afb-32ba-47a7-997e-2e09ec9d955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:43.489738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e1afb-32ba-47a7-997e-2e09ec9d955f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:43.490018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e1afb-32ba-47a7-997e-2e09ec9d955f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:43.490282 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e1afb-32ba-47a7-997e-2e09ec9d955f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:43.504833 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e1afb-32ba-47a7-997e-2e09ec9d955f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:43.506364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e1afb-32ba-47a7-997e-2e09ec9d955f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-c13e1afb-32ba-47a7-997e-2e09ec9d955f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:15:43.522011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:43.523170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:15:43.524348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:15:43.524348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:43.524348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:15:43.524778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 604/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:15:43.528816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14901ab0-dd29-404d-b0d0-fe50e97b999a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:43.639340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14901ab0-dd29-404d-b0d0-fe50e97b999a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:43.675172 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b2a7e-e7fb-419d-872e-5e4da225e472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:43.675909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b2a7e-e7fb-419d-872e-5e4da225e472 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:43.676362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b2a7e-e7fb-419d-872e-5e4da225e472 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:43.676808 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b2a7e-e7fb-419d-872e-5e4da225e472 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:43.677571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b2a7e-e7fb-419d-872e-5e4da225e472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:43.677856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b2a7e-e7fb-419d-872e-5e4da225e472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:43.679314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b2a7e-e7fb-419d-872e-5e4da225e472 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:43.691565 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 621/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:43.697947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e1afb-32ba-47a7-997e-2e09ec9d955f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:43.799769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:43.807297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e1afb-32ba-47a7-997e-2e09ec9d955f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:43.846852 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619af059-5d60-4747-b53f-1239ead2c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:43.847694 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619af059-5d60-4747-b53f-1239ead2c568 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:43.848014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619af059-5d60-4747-b53f-1239ead2c568 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:43.848367 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619af059-5d60-4747-b53f-1239ead2c568 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:43.856747 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619af059-5d60-4747-b53f-1239ead2c568 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:43.858197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619af059-5d60-4747-b53f-1239ead2c568 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-619af059-5d60-4747-b53f-1239ead2c568 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:15:43.869014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:43.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:43.871275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:43.871275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:43.871275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:15:43.871275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:15:43.871275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:15:43.871275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:15:43.871275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:15:43.871275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:15:43.871275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 16:15:43.871275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:15:43.873171 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 605/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:43.876426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b2a7e-e7fb-419d-872e-5e4da225e472 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:43.926978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:43.983862 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b2a7e-e7fb-419d-872e-5e4da225e472 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:44.021539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6856378-87ad-404d-9c05-5fd94006e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:44.022197 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6856378-87ad-404d-9c05-5fd94006e35b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:44.022477 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6856378-87ad-404d-9c05-5fd94006e35b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:44.022773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6856378-87ad-404d-9c05-5fd94006e35b None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:44.023570 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6856378-87ad-404d-9c05-5fd94006e35b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:44.023895 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6856378-87ad-404d-9c05-5fd94006e35b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:44.025530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6856378-87ad-404d-9c05-5fd94006e35b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:44.045927 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 622/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Aug 11 16:15:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:44.053033 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619af059-5d60-4747-b53f-1239ead2c568 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:44.170968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619af059-5d60-4747-b53f-1239ead2c568 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:44.206816 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9247e4d-0bc7-40ae-8cef-466ed48af7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:44.207440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9247e4d-0bc7-40ae-8cef-466ed48af7ff None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:44.207713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9247e4d-0bc7-40ae-8cef-466ed48af7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:44.207983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9247e4d-0bc7-40ae-8cef-466ed48af7ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:44.218534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9247e4d-0bc7-40ae-8cef-466ed48af7ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:44.220056 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9247e4d-0bc7-40ae-8cef-466ed48af7ff None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b9247e4d-0bc7-40ae-8cef-466ed48af7ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:15:44.235741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:44.236946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:15:44.237841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:15:44.237841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:44.237841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:15:44.237841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 606/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:44.242997 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6856378-87ad-404d-9c05-5fd94006e35b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:44.349669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6856378-87ad-404d-9c05-5fd94006e35b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:44.351966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:44.387298 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2d546-1640-45f0-bd9d-81230a5283d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:44.388109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2d546-1640-45f0-bd9d-81230a5283d8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:44.389102 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2d546-1640-45f0-bd9d-81230a5283d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:44.389389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2d546-1640-45f0-bd9d-81230a5283d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:44.390036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2d546-1640-45f0-bd9d-81230a5283d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:44.390339 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2d546-1640-45f0-bd9d-81230a5283d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:44.391700 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2d546-1640-45f0-bd9d-81230a5283d8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:44.403552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 623/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:15:44.409742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9247e4d-0bc7-40ae-8cef-466ed48af7ff None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:44.420477 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:44.526750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9247e4d-0bc7-40ae-8cef-466ed48af7ff None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:44.564974 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c7bdf-00a3-4989-a451-9b70c3a789cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:44.565629 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c7bdf-00a3-4989-a451-9b70c3a789cd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:44.565877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c7bdf-00a3-4989-a451-9b70c3a789cd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:44.566173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c7bdf-00a3-4989-a451-9b70c3a789cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:44.573005 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c7bdf-00a3-4989-a451-9b70c3a789cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:44.574540 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c7bdf-00a3-4989-a451-9b70c3a789cd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:44.586189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-d13c7bdf-00a3-4989-a451-9b70c3a789cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:15:44.586189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:44.586189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:44.586189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:44.586189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:44.586189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:44.586189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:44.586189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:44.586189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:44.586189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:44.586189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:44.586189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:44.586189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:15:44.586189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:15:44.586189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:44.587340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:44.588436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:15:44.588436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:15:44.588436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:15:44.588436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:15:44.588436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:15:44.588436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:15:44.588436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:15:44.588436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:15:44.588436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 607/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:15:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:44.595170 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2d546-1640-45f0-bd9d-81230a5283d8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:44.700144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2d546-1640-45f0-bd9d-81230a5283d8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:44.735994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35246d-aa07-4899-b8d4-97ed936203e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:44.736793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35246d-aa07-4899-b8d4-97ed936203e2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:44.737071 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35246d-aa07-4899-b8d4-97ed936203e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:44.737371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35246d-aa07-4899-b8d4-97ed936203e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:44.738259 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35246d-aa07-4899-b8d4-97ed936203e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:44.738666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35246d-aa07-4899-b8d4-97ed936203e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:44.740191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35246d-aa07-4899-b8d4-97ed936203e2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:44.753624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 624/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:15:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:44.759764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c7bdf-00a3-4989-a451-9b70c3a789cd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:44.828665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:44.868521 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c7bdf-00a3-4989-a451-9b70c3a789cd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:44.907495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486c14a-a658-409c-ac5b-adb62e6ca637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:44.908143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486c14a-a658-409c-ac5b-adb62e6ca637 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:44.908415 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486c14a-a658-409c-ac5b-adb62e6ca637 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:44.908717 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486c14a-a658-409c-ac5b-adb62e6ca637 None admin] PATH_INFO: `/v3/projects/3b0514f7236d42d1955e895adaf41389/users/64e1c7e6ee814b47912760cf7daf54c0/roles/b4c209d1895841af9203c4e432176eb9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:44.925191 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486c14a-a658-409c-ac5b-adb62e6ca637 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0514f7236d42d1955e895adaf41389, user_id=64e1c7e6ee814b47912760cf7daf54c0, role_id=b4c209d1895841af9203c4e432176eb9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:44.926725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486c14a-a658-409c-ac5b-adb62e6ca637 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:44.939832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 608/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:15:44 2022] PUT /identity/v3/projects/3b0514f7236d42d1955e895adaf41389/users/64e1c7e6ee814b47912760cf7daf54c0/roles/b4c209d1895841af9203c4e432176eb9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:15:46.948358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b52463-31be-4216-8eb6-158ec5f50f5e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:46.948924 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b52463-31be-4216-8eb6-158ec5f50f5e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:46.948924 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b52463-31be-4216-8eb6-158ec5f50f5e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:46.950262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 625/1233] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:15:46.956016 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7de73-66e1-42ec-b7c2-2ca88fc2923d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:46.956443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7de73-66e1-42ec-b7c2-2ca88fc2923d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:46.956536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7de73-66e1-42ec-b7c2-2ca88fc2923d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:46.976208 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9dd7de73-66e1-42ec-b7c2-2ca88fc2923d None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:15:46.977439 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9dd7de73-66e1-42ec-b7c2-2ca88fc2923d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:15:47.051152 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 609/1234] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:15:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:15:47.078586 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b52463-31be-4216-8eb6-158ec5f50f5e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:47.107412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:47.203860 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b52463-31be-4216-8eb6-158ec5f50f5e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:47.240639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4876a64-42f9-4529-bafe-71b602be034e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:47.241268 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4876a64-42f9-4529-bafe-71b602be034e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:47.241545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4876a64-42f9-4529-bafe-71b602be034e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:47.241814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4876a64-42f9-4529-bafe-71b602be034e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:47.254426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4876a64-42f9-4529-bafe-71b602be034e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-b4876a64-42f9-4529-bafe-71b602be034e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:15:47.259653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:47.260782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:47.261824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:47.261824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:47.261824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:47.261824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:47.261824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:15:47.261824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:15:47.261824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:15:47.261824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:15:47.261824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:15:47.261824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:15:47.261824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 16:15:47.261824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:15:47.266649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 626/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Aug 11 16:15:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:47.267376 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7de73-66e1-42ec-b7c2-2ca88fc2923d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:47.318879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:47.379047 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7de73-66e1-42ec-b7c2-2ca88fc2923d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:47.416979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba9cea-b633-4cb3-abf3-11a7660b05cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:47.417586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba9cea-b633-4cb3-abf3-11a7660b05cf None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:47.417866 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba9cea-b633-4cb3-abf3-11a7660b05cf None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:47.418139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba9cea-b633-4cb3-abf3-11a7660b05cf None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:47.418802 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba9cea-b633-4cb3-abf3-11a7660b05cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:47.419103 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba9cea-b633-4cb3-abf3-11a7660b05cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:47.421003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba9cea-b633-4cb3-abf3-11a7660b05cf None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:47.429087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 610/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Aug 11 16:15:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:15:47.434995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4876a64-42f9-4529-bafe-71b602be034e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:47.530204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:47.547021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4876a64-42f9-4529-bafe-71b602be034e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:47.582249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532dfda-54bf-4380-beeb-c21739f0c3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:47.582892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532dfda-54bf-4380-beeb-c21739f0c3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:47.583212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532dfda-54bf-4380-beeb-c21739f0c3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:47.583525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532dfda-54bf-4380-beeb-c21739f0c3e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:47.594791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532dfda-54bf-4380-beeb-c21739f0c3e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:47.596245 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532dfda-54bf-4380-beeb-c21739f0c3e6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-0532dfda-54bf-4380-beeb-c21739f0c3e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:15:47.611811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:47.613391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:15:47.614507 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:15:47.614507 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:47.614507 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:15:47.614507 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 627/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:15:47.619163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba9cea-b633-4cb3-abf3-11a7660b05cf None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:47.730914 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba9cea-b633-4cb3-abf3-11a7660b05cf None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:47.740383 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:47.766109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651958cc-4953-4c99-a384-0c538a4550bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:47.766712 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651958cc-4953-4c99-a384-0c538a4550bb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:47.767032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651958cc-4953-4c99-a384-0c538a4550bb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:47.767311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651958cc-4953-4c99-a384-0c538a4550bb None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:47.767879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651958cc-4953-4c99-a384-0c538a4550bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:47.768167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651958cc-4953-4c99-a384-0c538a4550bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:47.769835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651958cc-4953-4c99-a384-0c538a4550bb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:47.783204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 611/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:47.788921 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532dfda-54bf-4380-beeb-c21739f0c3e6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:47.897685 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532dfda-54bf-4380-beeb-c21739f0c3e6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:47.935221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9439439-c864-43a2-a9f2-bb426ba7f963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:47.935971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9439439-c864-43a2-a9f2-bb426ba7f963 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:47.936278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9439439-c864-43a2-a9f2-bb426ba7f963 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:47.936648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9439439-c864-43a2-a9f2-bb426ba7f963 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:47.939887 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:47.946067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9439439-c864-43a2-a9f2-bb426ba7f963 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:47.947920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9439439-c864-43a2-a9f2-bb426ba7f963 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c9439439-c864-43a2-a9f2-bb426ba7f963 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:15:47.960349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:47.967458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:47.968661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:47.968661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:47.968661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:15:47.968661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:15:47.968661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:15:47.968661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:15:47.968661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:15:47.968661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:15:47.968661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 16:15:47.968661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:15:47.968661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 628/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:47.969668 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651958cc-4953-4c99-a384-0c538a4550bb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:48.084740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651958cc-4953-4c99-a384-0c538a4550bb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:48.126543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8d245-8812-4956-b175-8966731d9826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:48.127300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8d245-8812-4956-b175-8966731d9826 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:48.127585 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8d245-8812-4956-b175-8966731d9826 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:48.127858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8d245-8812-4956-b175-8966731d9826 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:48.128620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8d245-8812-4956-b175-8966731d9826 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:48.128930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8d245-8812-4956-b175-8966731d9826 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:48.130360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8d245-8812-4956-b175-8966731d9826 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:48.151073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 612/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Aug 11 16:15:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:48.158572 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9439439-c864-43a2-a9f2-bb426ba7f963 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:48.280446 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9439439-c864-43a2-a9f2-bb426ba7f963 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:48.317768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150116a-0564-4c46-908d-da88644e29ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:48.318458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150116a-0564-4c46-908d-da88644e29ee None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:48.318742 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150116a-0564-4c46-908d-da88644e29ee None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:48.319093 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150116a-0564-4c46-908d-da88644e29ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:48.383247 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:48.393084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150116a-0564-4c46-908d-da88644e29ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:48.394486 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150116a-0564-4c46-908d-da88644e29ee None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:48.515979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 629/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:15:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 16:15:48.521998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8d245-8812-4956-b175-8966731d9826 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:48.551490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:48.639595 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8d245-8812-4956-b175-8966731d9826 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:48.673759 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a2270-94b2-43e8-a668-d8e44e64f408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:48.674379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a2270-94b2-43e8-a668-d8e44e64f408 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:48.674653 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a2270-94b2-43e8-a668-d8e44e64f408 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:48.674920 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a2270-94b2-43e8-a668-d8e44e64f408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:48.685773 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a2270-94b2-43e8-a668-d8e44e64f408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:48.687302 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a2270-94b2-43e8-a668-d8e44e64f408 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6f3a2270-94b2-43e8-a668-d8e44e64f408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:15:48.701465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:48.702464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:15:48.703679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:15:48.703679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:48.703679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:15:48.703679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 613/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:48.708493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150116a-0564-4c46-908d-da88644e29ee None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:48.806796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:48.813914 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150116a-0564-4c46-908d-da88644e29ee None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:48.849304 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10307fc0-6f2e-4eca-a36c-b2e65d33a727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:48.849926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10307fc0-6f2e-4eca-a36c-b2e65d33a727 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:48.850206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10307fc0-6f2e-4eca-a36c-b2e65d33a727 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:48.850520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10307fc0-6f2e-4eca-a36c-b2e65d33a727 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:48.851267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10307fc0-6f2e-4eca-a36c-b2e65d33a727 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:48.851613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10307fc0-6f2e-4eca-a36c-b2e65d33a727 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:48.853352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10307fc0-6f2e-4eca-a36c-b2e65d33a727 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:48.868014 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 630/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:48.874822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a2270-94b2-43e8-a668-d8e44e64f408 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:48.975162 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:48.999575 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a2270-94b2-43e8-a668-d8e44e64f408 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:49.035468 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bb3cf-fd66-4e26-8cfa-3b70a567bc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:49.036163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bb3cf-fd66-4e26-8cfa-3b70a567bc24 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:49.036443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bb3cf-fd66-4e26-8cfa-3b70a567bc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:49.036750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bb3cf-fd66-4e26-8cfa-3b70a567bc24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:49.044977 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90bb3cf-fd66-4e26-8cfa-3b70a567bc24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:49.046403 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90bb3cf-fd66-4e26-8cfa-3b70a567bc24 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:49.058823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e90bb3cf-fd66-4e26-8cfa-3b70a567bc24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:15:49.058823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:49.058823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:49.058823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:49.058823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:49.058823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:49.058823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:49.058823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:49.058823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:49.058823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:49.058823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:49.058823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:49.058823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:15:49.058823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:15:49.058823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:49.060435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:49.061561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:15:49.061561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:15:49.061561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:15:49.061561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:15:49.061561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:15:49.061561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:15:49.061561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:15:49.061561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:15:49.061561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 614/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:49.067308 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10307fc0-6f2e-4eca-a36c-b2e65d33a727 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:49.181770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10307fc0-6f2e-4eca-a36c-b2e65d33a727 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:49.225724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780a7ba-827f-4ffc-b60d-7a497084b8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:49.226250 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780a7ba-827f-4ffc-b60d-7a497084b8ec None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:49.226530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780a7ba-827f-4ffc-b60d-7a497084b8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:49.226804 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780a7ba-827f-4ffc-b60d-7a497084b8ec None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:49.227494 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780a7ba-827f-4ffc-b60d-7a497084b8ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:49.227797 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780a7ba-827f-4ffc-b60d-7a497084b8ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:49.229257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780a7ba-827f-4ffc-b60d-7a497084b8ec None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:49.243043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 631/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:15:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:49.249411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bb3cf-fd66-4e26-8cfa-3b70a567bc24 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:49.353598 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bb3cf-fd66-4e26-8cfa-3b70a567bc24 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:49.389388 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fc56e-99a8-4398-973f-fe88caccb1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:49.390013 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fc56e-99a8-4398-973f-fe88caccb1ea None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:49.390286 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fc56e-99a8-4398-973f-fe88caccb1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:49.390561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fc56e-99a8-4398-973f-fe88caccb1ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:49.391278 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fc56e-99a8-4398-973f-fe88caccb1ea None admin] RBAC: Adding query filter params (role.id=b4c209d1895841af9203c4e432176eb9, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=64e1c7e6ee814b47912760cf7daf54c0) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:49.391581 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fc56e-99a8-4398-973f-fe88caccb1ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:49.393169 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fc56e-99a8-4398-973f-fe88caccb1ea None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:49.400193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 615/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:15:49 2022] GET /identity/v3/role_assignments?user.id=64e1c7e6ee814b47912760cf7daf54c0&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=b4c209d1895841af9203c4e432176eb9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:51.493736 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87123402-2a07-45fa-bf15-425b223d15b4 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:51.494352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87123402-2a07-45fa-bf15-425b223d15b4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:51.494352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87123402-2a07-45fa-bf15-425b223d15b4 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:51.495749 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 632/1247] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:15:51.501660 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c7405-9d3b-48d7-a934-6cee77ee287b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:51.502123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c7405-9d3b-48d7-a934-6cee77ee287b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:51.502253 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c7405-9d3b-48d7-a934-6cee77ee287b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:51.509108 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:51.525300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e62c7405-9d3b-48d7-a934-6cee77ee287b None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:15:51.526655 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e62c7405-9d3b-48d7-a934-6cee77ee287b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:15:51.601140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 616/1248] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:15:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:15:51.624871 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87123402-2a07-45fa-bf15-425b223d15b4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:51.644820 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:51.739269 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87123402-2a07-45fa-bf15-425b223d15b4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:51.776707 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883e494-d108-43ed-9fb1-45051ccd9691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:51.777336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883e494-d108-43ed-9fb1-45051ccd9691 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:51.777612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883e494-d108-43ed-9fb1-45051ccd9691 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:51.779417 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883e494-d108-43ed-9fb1-45051ccd9691 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:51.788701 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883e494-d108-43ed-9fb1-45051ccd9691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-9883e494-d108-43ed-9fb1-45051ccd9691 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:15:51.793673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:51.800257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:51.801393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:51.801393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:51.801393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:51.801393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:51.801393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:15:51.801393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:15:51.801393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:15:51.801393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:15:51.801393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:15:51.801393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:15:51.801393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:15:51.801393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:15:51.801393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 633/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:15:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:51.802254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c7405-9d3b-48d7-a934-6cee77ee287b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:51.911446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c7405-9d3b-48d7-a934-6cee77ee287b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:51.947779 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:51.954438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffaeeb-19d6-4ab4-bf12-ef7074d73f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:51.955091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffaeeb-19d6-4ab4-bf12-ef7074d73f30 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:51.955355 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffaeeb-19d6-4ab4-bf12-ef7074d73f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:51.955619 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffaeeb-19d6-4ab4-bf12-ef7074d73f30 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:51.956340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffaeeb-19d6-4ab4-bf12-ef7074d73f30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:51.956714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffaeeb-19d6-4ab4-bf12-ef7074d73f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:51.959059 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffaeeb-19d6-4ab4-bf12-ef7074d73f30 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:51.970411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 617/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:15:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:51.975801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883e494-d108-43ed-9fb1-45051ccd9691 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:52.058352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:52.087627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883e494-d108-43ed-9fb1-45051ccd9691 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:52.124654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54315a78-0dee-4018-9780-699a8c272395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:52.125270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54315a78-0dee-4018-9780-699a8c272395 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:52.125540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54315a78-0dee-4018-9780-699a8c272395 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:52.125806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54315a78-0dee-4018-9780-699a8c272395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:52.136222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54315a78-0dee-4018-9780-699a8c272395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:52.137655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54315a78-0dee-4018-9780-699a8c272395 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-54315a78-0dee-4018-9780-699a8c272395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:15:52.152993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:52.154568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:15:52.160389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:15:52.160389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:52.160389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:15:52.160389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 634/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 16:15:52.160635 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffaeeb-19d6-4ab4-bf12-ef7074d73f30 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:52.272538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffaeeb-19d6-4ab4-bf12-ef7074d73f30 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:52.313281 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386d9aa-a1ca-450a-be52-819c4796e3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:52.315114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d9aa-a1ca-450a-be52-819c4796e3cb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:52.315446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d9aa-a1ca-450a-be52-819c4796e3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:52.315714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d9aa-a1ca-450a-be52-819c4796e3cb None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:52.316483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386d9aa-a1ca-450a-be52-819c4796e3cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:52.316847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386d9aa-a1ca-450a-be52-819c4796e3cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:52.318411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386d9aa-a1ca-450a-be52-819c4796e3cb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:52.331718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 618/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:52.337384 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54315a78-0dee-4018-9780-699a8c272395 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:52.449979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54315a78-0dee-4018-9780-699a8c272395 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:52.483127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:52.491756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65cc55-d037-43a1-a75b-4ec0dc919a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:52.492395 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65cc55-d037-43a1-a75b-4ec0dc919a54 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:52.492746 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65cc55-d037-43a1-a75b-4ec0dc919a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:52.493055 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65cc55-d037-43a1-a75b-4ec0dc919a54 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:52.501293 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65cc55-d037-43a1-a75b-4ec0dc919a54 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:52.502727 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65cc55-d037-43a1-a75b-4ec0dc919a54 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2e65cc55-d037-43a1-a75b-4ec0dc919a54 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:15:52.514429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:52.515634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:52.516763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:52.516763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:52.516763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:15:52.516763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:15:52.516763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:15:52.516763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:15:52.516763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:15:52.516763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:15:52.516763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 16:15:52.516763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:15:52.516763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 635/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:52.521930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386d9aa-a1ca-450a-be52-819c4796e3cb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:52.583996 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:52.634859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386d9aa-a1ca-450a-be52-819c4796e3cb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:52.674525 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccc87c-c35f-43d0-849e-219ccf7a88b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:52.675136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccc87c-c35f-43d0-849e-219ccf7a88b6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:52.675438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccc87c-c35f-43d0-849e-219ccf7a88b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:52.675737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccc87c-c35f-43d0-849e-219ccf7a88b6 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:52.676435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccc87c-c35f-43d0-849e-219ccf7a88b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:52.676777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccc87c-c35f-43d0-849e-219ccf7a88b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:52.678189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccc87c-c35f-43d0-849e-219ccf7a88b6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:52.697547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 619/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Aug 11 16:15:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:52.704413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65cc55-d037-43a1-a75b-4ec0dc919a54 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:52.814570 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65cc55-d037-43a1-a75b-4ec0dc919a54 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:52.849322 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7619645-c13f-4b84-beac-9f8bb459b6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:52.849942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7619645-c13f-4b84-beac-9f8bb459b6fe None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:52.850270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7619645-c13f-4b84-beac-9f8bb459b6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:52.850579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7619645-c13f-4b84-beac-9f8bb459b6fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:52.909206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:52.922292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7619645-c13f-4b84-beac-9f8bb459b6fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:52.923780 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7619645-c13f-4b84-beac-9f8bb459b6fe None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:53.027314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 636/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:15:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 16:15:53.033236 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccc87c-c35f-43d0-849e-219ccf7a88b6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:53.135408 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccc87c-c35f-43d0-849e-219ccf7a88b6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:53.149571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:53.175517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1378107-64b2-4fb6-929a-c6445b294142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:53.176165 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1378107-64b2-4fb6-929a-c6445b294142 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:53.176446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1378107-64b2-4fb6-929a-c6445b294142 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:53.176844 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1378107-64b2-4fb6-929a-c6445b294142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:53.189811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1378107-64b2-4fb6-929a-c6445b294142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:53.191510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1378107-64b2-4fb6-929a-c6445b294142 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a1378107-64b2-4fb6-929a-c6445b294142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:15:53.208829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:53.210029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:15:53.211122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:15:53.211122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:53.211122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:15:53.211122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 620/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:53.218007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7619645-c13f-4b84-beac-9f8bb459b6fe None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:53.317941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:53.332235 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7619645-c13f-4b84-beac-9f8bb459b6fe None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:53.371683 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90a96e-c477-4aaf-a262-06ffb93e54bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:53.372907 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90a96e-c477-4aaf-a262-06ffb93e54bc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:53.373183 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90a96e-c477-4aaf-a262-06ffb93e54bc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:53.373453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90a96e-c477-4aaf-a262-06ffb93e54bc None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:53.374174 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90a96e-c477-4aaf-a262-06ffb93e54bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:53.374476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90a96e-c477-4aaf-a262-06ffb93e54bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:53.375855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90a96e-c477-4aaf-a262-06ffb93e54bc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:53.387716 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 637/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:53.394241 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1378107-64b2-4fb6-929a-c6445b294142 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:53.507220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1378107-64b2-4fb6-929a-c6445b294142 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:53.541923 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce722c-3835-4cb6-a538-b793514d5702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:53.542586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce722c-3835-4cb6-a538-b793514d5702 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:53.542785 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce722c-3835-4cb6-a538-b793514d5702 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:53.543073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce722c-3835-4cb6-a538-b793514d5702 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:53.550216 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce722c-3835-4cb6-a538-b793514d5702 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:53.551640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce722c-3835-4cb6-a538-b793514d5702 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:53.563106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-94ce722c-3835-4cb6-a538-b793514d5702 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:15:53.563106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:53.563106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:53.563106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:53.563106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:53.563106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:53.563106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:53.563106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:53.563106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:53.563106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:53.563106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:53.563106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:53.563106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:15:53.563106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:15:53.563106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:53.563998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:53.564978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:15:53.564978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:15:53.564978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:15:53.564978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:15:53.564978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:15:53.564978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:15:53.564978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:15:53.564978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:15:53.564978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 621/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:15:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:53.570352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90a96e-c477-4aaf-a262-06ffb93e54bc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:53.684430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90a96e-c477-4aaf-a262-06ffb93e54bc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:53.720528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82fdf4-6e2c-4df7-9b92-83f35b12acf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:53.721183 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82fdf4-6e2c-4df7-9b92-83f35b12acf0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:53.721485 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82fdf4-6e2c-4df7-9b92-83f35b12acf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:53.721755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82fdf4-6e2c-4df7-9b92-83f35b12acf0 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:53.722474 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82fdf4-6e2c-4df7-9b92-83f35b12acf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:53.722819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82fdf4-6e2c-4df7-9b92-83f35b12acf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:53.724236 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82fdf4-6e2c-4df7-9b92-83f35b12acf0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:53.740611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 638/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:15:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:53.745181 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce722c-3835-4cb6-a538-b793514d5702 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:53.772091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:53.851365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce722c-3835-4cb6-a538-b793514d5702 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:53.885766 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bec39d-917e-43b9-9cfe-a1b2214e34ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:53.886368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bec39d-917e-43b9-9cfe-a1b2214e34ad None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:53.886639 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bec39d-917e-43b9-9cfe-a1b2214e34ad None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:53.886905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bec39d-917e-43b9-9cfe-a1b2214e34ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:53.887621 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bec39d-917e-43b9-9cfe-a1b2214e34ad None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=64e1c7e6ee814b47912760cf7daf54c0) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:53.887952 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bec39d-917e-43b9-9cfe-a1b2214e34ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:53.889406 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bec39d-917e-43b9-9cfe-a1b2214e34ad None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:53.895316 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 622/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:15:53 2022] GET /identity/v3/role_assignments?user.id=64e1c7e6ee814b47912760cf7daf54c0&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:15:55.889929 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c9955-91e9-48a0-9575-23ddcf20e0a4 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:55.890438 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c9955-91e9-48a0-9575-23ddcf20e0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:55.890530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c9955-91e9-48a0-9575-23ddcf20e0a4 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:55.891796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 639/1261] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:15:55.896934 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba26e2b-0a10-4f85-bf8a-df3ffdc5d9c2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:55.897351 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba26e2b-0a10-4f85-bf8a-df3ffdc5d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:55.897481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba26e2b-0a10-4f85-bf8a-df3ffdc5d9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:55.915055 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-cba26e2b-0a10-4f85-bf8a-df3ffdc5d9c2 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:15:55.916492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cba26e2b-0a10-4f85-bf8a-df3ffdc5d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:15:55.980607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 623/1262] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:15:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:15:56.003046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c9955-91e9-48a0-9575-23ddcf20e0a4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:56.014376 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:56.101243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c9955-91e9-48a0-9575-23ddcf20e0a4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:56.133246 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f1b0e-8731-444d-9b83-5e79e90acc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:56.133849 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f1b0e-8731-444d-9b83-5e79e90acc6f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:56.134124 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f1b0e-8731-444d-9b83-5e79e90acc6f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:56.134391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f1b0e-8731-444d-9b83-5e79e90acc6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:56.146548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f1b0e-8731-444d-9b83-5e79e90acc6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-d85f1b0e-8731-444d-9b83-5e79e90acc6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:15:56.151084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:56.152181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:56.153734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:56.153734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:56.153734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:56.153734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:56.153734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:15:56.153734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:15:56.153734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:15:56.153734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:15:56.153734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:15:56.153734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:15:56.153734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:15:56.153734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:15:56.153734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 640/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:15:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:56.158540 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba26e2b-0a10-4f85-bf8a-df3ffdc5d9c2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:56.177750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:56.257822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba26e2b-0a10-4f85-bf8a-df3ffdc5d9c2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:56.292765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a08ab-57a4-4a68-9e7f-b0c77589d3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:56.293356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a08ab-57a4-4a68-9e7f-b0c77589d3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:56.293634 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a08ab-57a4-4a68-9e7f-b0c77589d3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:56.294438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a08ab-57a4-4a68-9e7f-b0c77589d3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:56.295094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a08ab-57a4-4a68-9e7f-b0c77589d3b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:56.295396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a08ab-57a4-4a68-9e7f-b0c77589d3b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:56.296779 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a08ab-57a4-4a68-9e7f-b0c77589d3b8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:56.304645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 624/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:15:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:15:56.311164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f1b0e-8731-444d-9b83-5e79e90acc6f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:56.374928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:56.407656 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f1b0e-8731-444d-9b83-5e79e90acc6f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:56.439448 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8aa7b-aaca-4a51-a9bd-f59208460a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:56.440047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8aa7b-aaca-4a51-a9bd-f59208460a07 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:56.440319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8aa7b-aaca-4a51-a9bd-f59208460a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:56.440608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8aa7b-aaca-4a51-a9bd-f59208460a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:56.450067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8aa7b-aaca-4a51-a9bd-f59208460a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:56.452016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8aa7b-aaca-4a51-a9bd-f59208460a07 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-62a8aa7b-aaca-4a51-a9bd-f59208460a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:15:56.466440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:56.467401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:15:56.468274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:15:56.468274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:56.468274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:15:56.468274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 641/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:56.473369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a08ab-57a4-4a68-9e7f-b0c77589d3b8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:56.551665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:56.570352 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a08ab-57a4-4a68-9e7f-b0c77589d3b8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:56.602497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01416da9-7352-4dff-b793-388ff90e9b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:56.603147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01416da9-7352-4dff-b793-388ff90e9b3f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:56.603424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01416da9-7352-4dff-b793-388ff90e9b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:56.603692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01416da9-7352-4dff-b793-388ff90e9b3f None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:56.604317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01416da9-7352-4dff-b793-388ff90e9b3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:56.604676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01416da9-7352-4dff-b793-388ff90e9b3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:56.606013 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01416da9-7352-4dff-b793-388ff90e9b3f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:56.617428 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 625/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:56.623608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8aa7b-aaca-4a51-a9bd-f59208460a07 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:56.720412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8aa7b-aaca-4a51-a9bd-f59208460a07 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:56.739224 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:56.753599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22718b41-fdfa-407b-9527-03df18bb54a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:56.754203 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22718b41-fdfa-407b-9527-03df18bb54a5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:56.754476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22718b41-fdfa-407b-9527-03df18bb54a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:56.754743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22718b41-fdfa-407b-9527-03df18bb54a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:56.763251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22718b41-fdfa-407b-9527-03df18bb54a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:56.764692 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22718b41-fdfa-407b-9527-03df18bb54a5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-22718b41-fdfa-407b-9527-03df18bb54a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:15:56.775232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:56.776326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:56.777491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:56.777491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:56.777491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:15:56.777491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:15:56.777491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:15:56.777491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:15:56.777491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:15:56.777491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:15:56.777491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 16:15:56.777491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:15:56.777491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 642/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:56.781992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01416da9-7352-4dff-b793-388ff90e9b3f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:56.877623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01416da9-7352-4dff-b793-388ff90e9b3f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:56.909812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae0105-dd59-4815-b3e5-3459044e3304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:56.910389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae0105-dd59-4815-b3e5-3459044e3304 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:56.910662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae0105-dd59-4815-b3e5-3459044e3304 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:56.910967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae0105-dd59-4815-b3e5-3459044e3304 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:56.911645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae0105-dd59-4815-b3e5-3459044e3304 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:56.911943 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae0105-dd59-4815-b3e5-3459044e3304 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:56.913365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae0105-dd59-4815-b3e5-3459044e3304 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:56.922400 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:56.930492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 626/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Aug 11 16:15:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:56.936574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22718b41-fdfa-407b-9527-03df18bb54a5 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:57.031537 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22718b41-fdfa-407b-9527-03df18bb54a5 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:57.064191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baefea-9a62-4f69-b321-b966f2a71653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:57.064818 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baefea-9a62-4f69-b321-b966f2a71653 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:57.065092 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baefea-9a62-4f69-b321-b966f2a71653 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:57.065359 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baefea-9a62-4f69-b321-b966f2a71653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:57.075366 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baefea-9a62-4f69-b321-b966f2a71653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:57.076807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baefea-9a62-4f69-b321-b966f2a71653 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-35baefea-9a62-4f69-b321-b966f2a71653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:15:57.090266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:57.091371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:15:57.092493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:15:57.092493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:15:57.092493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:15:57.092493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 643/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:57.096835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae0105-dd59-4815-b3e5-3459044e3304 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:57.199386 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae0105-dd59-4815-b3e5-3459044e3304 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:57.232576 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02baf-a1e8-42cb-9b2c-482f99923e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:57.233189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02baf-a1e8-42cb-9b2c-482f99923e85 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:57.233468 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02baf-a1e8-42cb-9b2c-482f99923e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:57.233735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02baf-a1e8-42cb-9b2c-482f99923e85 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:57.234359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef02baf-a1e8-42cb-9b2c-482f99923e85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:57.234651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef02baf-a1e8-42cb-9b2c-482f99923e85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:57.235998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef02baf-a1e8-42cb-9b2c-482f99923e85 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:57.246833 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 627/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:57.253070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baefea-9a62-4f69-b321-b966f2a71653 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:57.282966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:57.352178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baefea-9a62-4f69-b321-b966f2a71653 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:57.384160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248087f-9b64-4d2a-8441-4cc461802edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:57.384791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248087f-9b64-4d2a-8441-4cc461802edc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:57.385068 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248087f-9b64-4d2a-8441-4cc461802edc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:57.385336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248087f-9b64-4d2a-8441-4cc461802edc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:57.391666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248087f-9b64-4d2a-8441-4cc461802edc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:57.393127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248087f-9b64-4d2a-8441-4cc461802edc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:57.404316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f248087f-9b64-4d2a-8441-4cc461802edc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:15:57.404316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:57.404316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:57.404316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:57.404316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:57.404316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:57.404316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:57.404316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:57.404316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:57.404316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:57.404316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:57.404316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:57.404316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:15:57.404316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:15:57.404316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:57.405358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:57.406449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:15:57.406449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:15:57.406449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:15:57.406449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:15:57.406449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:15:57.406449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:15:57.406449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:15:57.406449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:15:57.406449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 644/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:15:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:57.411217 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02baf-a1e8-42cb-9b2c-482f99923e85 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:57.468003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:57.510051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02baf-a1e8-42cb-9b2c-482f99923e85 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:57.543140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b6928-86b3-418e-bb27-93253b0e97bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:57.543664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b6928-86b3-418e-bb27-93253b0e97bd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:57.544562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b6928-86b3-418e-bb27-93253b0e97bd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:57.544863 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b6928-86b3-418e-bb27-93253b0e97bd None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:57.545539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b6928-86b3-418e-bb27-93253b0e97bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:15:57.545839 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b6928-86b3-418e-bb27-93253b0e97bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:57.547231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b6928-86b3-418e-bb27-93253b0e97bd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:57.558633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 628/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:15:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:15:57.566401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248087f-9b64-4d2a-8441-4cc461802edc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:57.657173 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:57.666391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248087f-9b64-4d2a-8441-4cc461802edc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:57.698512 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9f5be-0290-400f-bc37-38889b181361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:57.699143 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f5be-0290-400f-bc37-38889b181361 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:57.699416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f5be-0290-400f-bc37-38889b181361 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:57.699682 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f5be-0290-400f-bc37-38889b181361 None admin] PATH_INFO: `/v3/projects/3b0514f7236d42d1955e895adaf41389/users/64e1c7e6ee814b47912760cf7daf54c0/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:57.702054 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9f5be-0290-400f-bc37-38889b181361 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0514f7236d42d1955e895adaf41389, user_id=64e1c7e6ee814b47912760cf7daf54c0, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:15:57.703466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9f5be-0290-400f-bc37-38889b181361 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:15:57.715060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 645/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Aug 11 16:15:57 2022] PUT /identity/v3/projects/3b0514f7236d42d1955e895adaf41389/users/64e1c7e6ee814b47912760cf7daf54c0/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:15:59.691079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315afaa-34b4-4c3e-b46c-464d36da5939 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:59.691627 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315afaa-34b4-4c3e-b46c-464d36da5939 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:59.691627 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315afaa-34b4-4c3e-b46c-464d36da5939 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:59.692975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 629/1274] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:15:59.697966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9805cf4-1a18-49cb-ae65-b7c10bacdb1e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:59.698324 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9805cf4-1a18-49cb-ae65-b7c10bacdb1e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:59.698529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9805cf4-1a18-49cb-ae65-b7c10bacdb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:59.716765 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c9805cf4-1a18-49cb-ae65-b7c10bacdb1e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:15:59.717945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c9805cf4-1a18-49cb-ae65-b7c10bacdb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:15:59.782791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 646/1275] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:15:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:15:59.805990 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315afaa-34b4-4c3e-b46c-464d36da5939 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:15:59.903564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315afaa-34b4-4c3e-b46c-464d36da5939 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:15:59.920808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:15:59.937529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb536-b178-4f12-b61e-e0e8c089314e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:15:59.938137 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb536-b178-4f12-b61e-e0e8c089314e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:15:59.938411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb536-b178-4f12-b61e-e0e8c089314e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:15:59.938680 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb536-b178-4f12-b61e-e0e8c089314e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:15:59.948308 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcb536-b178-4f12-b61e-e0e8c089314e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-84bcb536-b178-4f12-b61e-e0e8c089314e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 16:15:59.953503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:15:59.954574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:15:59.955606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:15:59.955606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:15:59.955606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:15:59.955606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:15:59.955606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 16:15:59.955606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 16:15:59.955606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 16:15:59.955606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 16:15:59.955606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 16:15:59.955606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 16:15:59.955606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 16:15:59.955606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:15:59.955606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 630/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Aug 11 16:15:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:15:59.960403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9805cf4-1a18-49cb-ae65-b7c10bacdb1e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:00.038253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:00.056823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9805cf4-1a18-49cb-ae65-b7c10bacdb1e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:00.089903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ddcd7-9fc2-47f6-9613-3a113fc66083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:00.090487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ddcd7-9fc2-47f6-9613-3a113fc66083 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:00.091288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ddcd7-9fc2-47f6-9613-3a113fc66083 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:00.091556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ddcd7-9fc2-47f6-9613-3a113fc66083 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:00.092215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ddcd7-9fc2-47f6-9613-3a113fc66083 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:16:00.092537 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ddcd7-9fc2-47f6-9613-3a113fc66083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:00.093919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ddcd7-9fc2-47f6-9613-3a113fc66083 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:00.101581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 647/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Aug 11 16:15:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:16:00.107060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb536-b178-4f12-b61e-e0e8c089314e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:00.210851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb536-b178-4f12-b61e-e0e8c089314e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:00.244251 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb47b8-2ce0-42e7-a859-6e1e65a38420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:00.244883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb47b8-2ce0-42e7-a859-6e1e65a38420 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:00.245157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb47b8-2ce0-42e7-a859-6e1e65a38420 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:00.245424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb47b8-2ce0-42e7-a859-6e1e65a38420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:00.255069 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb47b8-2ce0-42e7-a859-6e1e65a38420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:00.256481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb47b8-2ce0-42e7-a859-6e1e65a38420 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-89eb47b8-2ce0-42e7-a859-6e1e65a38420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:16:00.270699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:16:00.271790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:16:00.272902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:16:00.272902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:16:00.272902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:16:00.272902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 631/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:16:00.277654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ddcd7-9fc2-47f6-9613-3a113fc66083 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:00.374273 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ddcd7-9fc2-47f6-9613-3a113fc66083 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:00.406226 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e83acc-749d-4c7b-b912-7d906d0d93a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:00.406810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e83acc-749d-4c7b-b912-7d906d0d93a3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:00.407088 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e83acc-749d-4c7b-b912-7d906d0d93a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:00.407359 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e83acc-749d-4c7b-b912-7d906d0d93a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:00.407992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e83acc-749d-4c7b-b912-7d906d0d93a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:16:00.408291 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e83acc-749d-4c7b-b912-7d906d0d93a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:00.409670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e83acc-749d-4c7b-b912-7d906d0d93a3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:00.421108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 648/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:16:00.426574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb47b8-2ce0-42e7-a859-6e1e65a38420 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:00.457060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:00.527903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb47b8-2ce0-42e7-a859-6e1e65a38420 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:00.560937 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0707370-5ae2-4032-8cf3-2ec65bcdc280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:00.561547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0707370-5ae2-4032-8cf3-2ec65bcdc280 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:00.561821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0707370-5ae2-4032-8cf3-2ec65bcdc280 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:00.562088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0707370-5ae2-4032-8cf3-2ec65bcdc280 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:00.569215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0707370-5ae2-4032-8cf3-2ec65bcdc280 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:00.570629 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0707370-5ae2-4032-8cf3-2ec65bcdc280 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e0707370-5ae2-4032-8cf3-2ec65bcdc280 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 16:16:00.581931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:16:00.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:16:00.584261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:16:00.584261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:16:00.584261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 16:16:00.584261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 16:16:00.584261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 16:16:00.584261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 16:16:00.584261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 16:16:00.584261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 16:16:00.584261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 16:16:00.584261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:16:00.584261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 632/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:16:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:16:00.588692 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e83acc-749d-4c7b-b912-7d906d0d93a3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:00.592339 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:00.685414 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e83acc-749d-4c7b-b912-7d906d0d93a3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:00.717765 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd476b-c9b5-4cf4-a2b0-51e5eac2284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:00.718367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd476b-c9b5-4cf4-a2b0-51e5eac2284b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:00.718635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd476b-c9b5-4cf4-a2b0-51e5eac2284b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:00.718909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd476b-c9b5-4cf4-a2b0-51e5eac2284b None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:00.719635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd476b-c9b5-4cf4-a2b0-51e5eac2284b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:16:00.719941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd476b-c9b5-4cf4-a2b0-51e5eac2284b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:00.721389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd476b-c9b5-4cf4-a2b0-51e5eac2284b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:00.738492 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 649/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Aug 11 16:16:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:16:00.744143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0707370-5ae2-4032-8cf3-2ec65bcdc280 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:00.831682 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:00.841250 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0707370-5ae2-4032-8cf3-2ec65bcdc280 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:00.874173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620ccc-1e71-49a7-8468-9f25b1f58041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:00.874757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620ccc-1e71-49a7-8468-9f25b1f58041 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:00.875069 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620ccc-1e71-49a7-8468-9f25b1f58041 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:00.875331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620ccc-1e71-49a7-8468-9f25b1f58041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:00.940020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff620ccc-1e71-49a7-8468-9f25b1f58041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:00.941418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff620ccc-1e71-49a7-8468-9f25b1f58041 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:01.025679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:01.036049 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 633/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Aug 11 16:16:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 16:16:01.042063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd476b-c9b5-4cf4-a2b0-51e5eac2284b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:01.101668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:01.139267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd476b-c9b5-4cf4-a2b0-51e5eac2284b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:01.179363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b973c-70eb-463c-9ef3-78f594b5685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:01.179987 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b973c-70eb-463c-9ef3-78f594b5685f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:01.180268 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b973c-70eb-463c-9ef3-78f594b5685f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:01.180543 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b973c-70eb-463c-9ef3-78f594b5685f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:01.190488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b973c-70eb-463c-9ef3-78f594b5685f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:01.191870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b973c-70eb-463c-9ef3-78f594b5685f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-753b973c-70eb-463c-9ef3-78f594b5685f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 16:16:01.211046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:16:01.212898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 16:16:01.214928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 16:16:01.214928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 16:16:01.214928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:16:01.214928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 650/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:16:01.220146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620ccc-1e71-49a7-8468-9f25b1f58041 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:01.315409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620ccc-1e71-49a7-8468-9f25b1f58041 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:01.347613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea5916-10c0-49ff-a5fa-4d7acf476ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:01.348199 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea5916-10c0-49ff-a5fa-4d7acf476ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:01.348473 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea5916-10c0-49ff-a5fa-4d7acf476ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:01.348771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea5916-10c0-49ff-a5fa-4d7acf476ab4 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:01.349392 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea5916-10c0-49ff-a5fa-4d7acf476ab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:16:01.349689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea5916-10c0-49ff-a5fa-4d7acf476ab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:01.351031 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea5916-10c0-49ff-a5fa-4d7acf476ab4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:01.362246 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 634/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Aug 11 16:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:16:01.367854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b973c-70eb-463c-9ef3-78f594b5685f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:01.464737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b973c-70eb-463c-9ef3-78f594b5685f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:01.479020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:01.498413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a386b48-c8f3-4f97-aa20-a6eebb938618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:01.499021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a386b48-c8f3-4f97-aa20-a6eebb938618 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:01.499292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a386b48-c8f3-4f97-aa20-a6eebb938618 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:01.499556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a386b48-c8f3-4f97-aa20-a6eebb938618 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:01.505969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a386b48-c8f3-4f97-aa20-a6eebb938618 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:01.507383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a386b48-c8f3-4f97-aa20-a6eebb938618 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:01.519424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-1a386b48-c8f3-4f97-aa20-a6eebb938618 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:16:01.519424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:16:01.519424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:16:01.519424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:16:01.519424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:16:01.519424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:16:01.519424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:16:01.519424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:16:01.519424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:16:01.519424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:16:01.519424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:16:01.519424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:16:01.519424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 16:16:01.519424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 16:16:01.519424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:16:01.520452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:16:01.521639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 16:16:01.521639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 16:16:01.521639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 16:16:01.521639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 16:16:01.521639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 16:16:01.521639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 16:16:01.521639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 16:16:01.521639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Aug 11 16:16:01.521639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 651/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Aug 11 16:16:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:16:01.526418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea5916-10c0-49ff-a5fa-4d7acf476ab4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:01.577307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:01.625256 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea5916-10c0-49ff-a5fa-4d7acf476ab4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:01.657579 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60700b5-d95a-413f-b691-94f62cda287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:01.658166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60700b5-d95a-413f-b691-94f62cda287f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:01.658441 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60700b5-d95a-413f-b691-94f62cda287f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:01.658710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60700b5-d95a-413f-b691-94f62cda287f None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:01.659386 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60700b5-d95a-413f-b691-94f62cda287f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:16:01.659685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60700b5-d95a-413f-b691-94f62cda287f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:01.661124 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60700b5-d95a-413f-b691-94f62cda287f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:01.672734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 635/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Aug 11 16:16:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:16:01.678908 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a386b48-c8f3-4f97-aa20-a6eebb938618 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:01.780379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a386b48-c8f3-4f97-aa20-a6eebb938618 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:01.813256 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee3de9-fde2-4c9c-8287-ee40e115adeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:01.813839 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee3de9-fde2-4c9c-8287-ee40e115adeb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:01.814119 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee3de9-fde2-4c9c-8287-ee40e115adeb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:01.814391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee3de9-fde2-4c9c-8287-ee40e115adeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:01.815110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee3de9-fde2-4c9c-8287-ee40e115adeb None admin] RBAC: Adding query filter params (role.id=4a2cfbf9ab624a6699c018217006b8d8, scope.project.id=3b0514f7236d42d1955e895adaf41389, user.id=64e1c7e6ee814b47912760cf7daf54c0) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:16:01.815417 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee3de9-fde2-4c9c-8287-ee40e115adeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:01.816850 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee3de9-fde2-4c9c-8287-ee40e115adeb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:01.822712 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 652/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Aug 11 16:16:01 2022] GET /identity/v3/role_assignments?user.id=64e1c7e6ee814b47912760cf7daf54c0&scope.project.id=3b0514f7236d42d1955e895adaf41389&role.id=4a2cfbf9ab624a6699c018217006b8d8 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:16:03.829720 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbb3bf-f062-4f01-974e-97684c509217 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:03.830227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbb3bf-f062-4f01-974e-97684c509217 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:03.830227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbb3bf-f062-4f01-974e-97684c509217 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:03.831577 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 636/1288] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:16:03.836694 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30cc87-b643-4d60-99bc-9f0708d368ef None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:03.837112 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30cc87-b643-4d60-99bc-9f0708d368ef None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:03.837236 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30cc87-b643-4d60-99bc-9f0708d368ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:03.855324 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8d30cc87-b643-4d60-99bc-9f0708d368ef None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:16:03.856526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8d30cc87-b643-4d60-99bc-9f0708d368ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:16:03.884299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:03.921354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 653/1289] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:16:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:16:03.942879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbb3bf-f062-4f01-974e-97684c509217 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:04.041324 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbb3bf-f062-4f01-974e-97684c509217 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:04.051471 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:04.074405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d92ac8-4456-4fdf-8095-48c9aead5554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:04.075551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d92ac8-4456-4fdf-8095-48c9aead5554 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:04.075810 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d92ac8-4456-4fdf-8095-48c9aead5554 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:04.076073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d92ac8-4456-4fdf-8095-48c9aead5554 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:04.076669 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d92ac8-4456-4fdf-8095-48c9aead5554 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:04.078010 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d92ac8-4456-4fdf-8095-48c9aead5554 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-00d92ac8-4456-4fdf-8095-48c9aead5554 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:16:04.086364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:16:04.087613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:16:04.088667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:16:04.088667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:16:04.088667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:16:04.088667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:16:04.088667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:16:04.088667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:16:04.088667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:16:04.088667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:16:04.088667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:16:04.088667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:16:04.088667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:16:04.088667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:16:04.088667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 16:16:04.088667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:16:04.088667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 637/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Aug 11 16:16:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:16:04.093391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30cc87-b643-4d60-99bc-9f0708d368ef None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:04.191684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30cc87-b643-4d60-99bc-9f0708d368ef None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:04.228223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284f8e2-ca8b-47d5-8413-d2a52c293cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:04.228844 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284f8e2-ca8b-47d5-8413-d2a52c293cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:04.229119 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284f8e2-ca8b-47d5-8413-d2a52c293cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:04.229384 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284f8e2-ca8b-47d5-8413-d2a52c293cf0 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:04.230003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284f8e2-ca8b-47d5-8413-d2a52c293cf0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:16:04.230298 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284f8e2-ca8b-47d5-8413-d2a52c293cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:04.231670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284f8e2-ca8b-47d5-8413-d2a52c293cf0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:04.236387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 654/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Aug 11 16:16:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:16:04.242313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d92ac8-4456-4fdf-8095-48c9aead5554 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:04.346803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d92ac8-4456-4fdf-8095-48c9aead5554 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:04.378631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de725025-20a7-4caf-b041-e3241ada3327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:04.379210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de725025-20a7-4caf-b041-e3241ada3327 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:04.379483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de725025-20a7-4caf-b041-e3241ada3327 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:04.379751 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de725025-20a7-4caf-b041-e3241ada3327 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:04.380358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de725025-20a7-4caf-b041-e3241ada3327 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:16:04.380686 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de725025-20a7-4caf-b041-e3241ada3327 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:04.382033 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de725025-20a7-4caf-b041-e3241ada3327 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:04.386253 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 638/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Aug 11 16:16:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:16:06.342894 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e20a7-1ca6-4f43-bcef-8111b1c1f0d9 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:06.343423 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e20a7-1ca6-4f43-bcef-8111b1c1f0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:06.343423 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e20a7-1ca6-4f43-bcef-8111b1c1f0d9 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:06.344791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 655/1293] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:16:06.349993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35fd0e-4381-4a78-9517-4d4f2fb39fbe None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:06.350388 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35fd0e-4381-4a78-9517-4d4f2fb39fbe None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:06.350527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35fd0e-4381-4a78-9517-4d4f2fb39fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:06.368556 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5d35fd0e-4381-4a78-9517-4d4f2fb39fbe None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:16:06.369739 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5d35fd0e-4381-4a78-9517-4d4f2fb39fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:16:06.397943 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:06.435305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 639/1294] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:16:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:16:06.457686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e20a7-1ca6-4f43-bcef-8111b1c1f0d9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:06.488137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:06.556503 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e20a7-1ca6-4f43-bcef-8111b1c1f0d9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:06.589534 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18edb03-bc8f-4b34-b198-a9965feef882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:06.590127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18edb03-bc8f-4b34-b198-a9965feef882 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:06.590434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18edb03-bc8f-4b34-b198-a9965feef882 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:06.590707 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18edb03-bc8f-4b34-b198-a9965feef882 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:06.591350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18edb03-bc8f-4b34-b198-a9965feef882 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:06.592739 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18edb03-bc8f-4b34-b198-a9965feef882 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:06.606080 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 656/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Aug 11 16:16:06 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:16:08.598269 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed407e1-51f9-4d6f-8e60-dbe704567ffd None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:08.598842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed407e1-51f9-4d6f-8e60-dbe704567ffd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:08.598842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed407e1-51f9-4d6f-8e60-dbe704567ffd None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:08.600132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 640/1296] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:16:08.605358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefd724-3875-4130-84f2-257a8dbc635e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:08.605796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefd724-3875-4130-84f2-257a8dbc635e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:08.609545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefd724-3875-4130-84f2-257a8dbc635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:08.631675 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2fefd724-3875-4130-84f2-257a8dbc635e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:16:08.632894 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2fefd724-3875-4130-84f2-257a8dbc635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:16:08.703811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 657/1297] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:16:08 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:16:08.725973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed407e1-51f9-4d6f-8e60-dbe704567ffd None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:08.822801 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed407e1-51f9-4d6f-8e60-dbe704567ffd None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:08.855128 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb460893-6c34-4d90-a95c-8166afdf2251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:08.855724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb460893-6c34-4d90-a95c-8166afdf2251 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:08.856023 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb460893-6c34-4d90-a95c-8166afdf2251 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:08.856291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb460893-6c34-4d90-a95c-8166afdf2251 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:08.856888 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb460893-6c34-4d90-a95c-8166afdf2251 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:08.858217 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb460893-6c34-4d90-a95c-8166afdf2251 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-bb460893-6c34-4d90-a95c-8166afdf2251 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:16:08.866515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:16:08.867772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:16:08.868903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:16:08.868903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:16:08.868903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:16:08.868903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:16:08.868903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:16:08.868903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:16:08.868903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:16:08.868903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:16:08.868903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:16:08.868903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:16:08.868903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:16:08.868903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:16:08.868903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 16:16:08.868903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:16:08.868903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 641/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Aug 11 16:16:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:16:08.873956 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefd724-3875-4130-84f2-257a8dbc635e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:08.892271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:08.971634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefd724-3875-4130-84f2-257a8dbc635e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:09.005294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331960e-c420-49a6-9dd2-5dc2b7e1a118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:09.005828 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331960e-c420-49a6-9dd2-5dc2b7e1a118 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:09.006106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331960e-c420-49a6-9dd2-5dc2b7e1a118 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:09.006378 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331960e-c420-49a6-9dd2-5dc2b7e1a118 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:09.007002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331960e-c420-49a6-9dd2-5dc2b7e1a118 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:16:09.007300 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331960e-c420-49a6-9dd2-5dc2b7e1a118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:09.008683 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331960e-c420-49a6-9dd2-5dc2b7e1a118 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:09.013616 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 658/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Aug 11 16:16:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:16:09.019600 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb460893-6c34-4d90-a95c-8166afdf2251 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:09.050822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:09.116805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb460893-6c34-4d90-a95c-8166afdf2251 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:09.148741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dceee9-250b-480f-a6ef-23cd208e8d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:09.149447 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dceee9-250b-480f-a6ef-23cd208e8d3d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:09.149700 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dceee9-250b-480f-a6ef-23cd208e8d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:09.150024 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dceee9-250b-480f-a6ef-23cd208e8d3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:09.150746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dceee9-250b-480f-a6ef-23cd208e8d3d None admin] RBAC: Adding query filter params (interface=public, service_id=86fa348d8d5d4a92bd43b1aeb83e5b8b, region_id=RegionOne) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:16:09.151113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dceee9-250b-480f-a6ef-23cd208e8d3d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:09.152707 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dceee9-250b-480f-a6ef-23cd208e8d3d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:09.158471 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 642/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Aug 11 16:16:09 2022] GET /identity/v3/endpoints?service_id=86fa348d8d5d4a92bd43b1aeb83e5b8b&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:16:09.166808 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331960e-c420-49a6-9dd2-5dc2b7e1a118 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:09.263327 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:09.280819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331960e-c420-49a6-9dd2-5dc2b7e1a118 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:09.314221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b704d3-61a2-4b82-a389-334825bb0e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:09.314816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b704d3-61a2-4b82-a389-334825bb0e8f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:09.315094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b704d3-61a2-4b82-a389-334825bb0e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:09.315364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b704d3-61a2-4b82-a389-334825bb0e8f None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:09.315963 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b704d3-61a2-4b82-a389-334825bb0e8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:09.317343 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b704d3-61a2-4b82-a389-334825bb0e8f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:09.323860 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 659/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Aug 11 16:16:09 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:16:11.272725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02742c-ae89-447b-b6cd-fc8bb194d3a8 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:11.273294 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02742c-ae89-447b-b6cd-fc8bb194d3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:11.273294 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02742c-ae89-447b-b6cd-fc8bb194d3a8 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:11.274571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 643/1302] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:16:11.280295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfb119-cc25-4467-8ee9-62ec27ec562e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:11.280731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfb119-cc25-4467-8ee9-62ec27ec562e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:11.280882 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfb119-cc25-4467-8ee9-62ec27ec562e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:11.299711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9bbfb119-cc25-4467-8ee9-62ec27ec562e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:16:11.301372 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9bbfb119-cc25-4467-8ee9-62ec27ec562e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:16:11.365872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 660/1303] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:16:11 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 16:16:11.388394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02742c-ae89-447b-b6cd-fc8bb194d3a8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:11.482092 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:11.489195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02742c-ae89-447b-b6cd-fc8bb194d3a8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:11.521452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9874c-3f4e-4dbc-99ed-e0678ab7e37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:11.522067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9874c-3f4e-4dbc-99ed-e0678ab7e37d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:11.522345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9874c-3f4e-4dbc-99ed-e0678ab7e37d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:11.522615 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9874c-3f4e-4dbc-99ed-e0678ab7e37d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:11.523236 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9874c-3f4e-4dbc-99ed-e0678ab7e37d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:11.524532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9874c-3f4e-4dbc-99ed-e0678ab7e37d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-73c9874c-3f4e-4dbc-99ed-e0678ab7e37d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 16:16:11.533455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 16:16:11.534586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 16:16:11.535437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 16:16:11.535437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Aug 11 16:16:11.535437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 16:16:11.535437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Aug 11 16:16:11.535437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 16:16:11.535437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 16:16:11.535437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 16:16:11.535437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Aug 11 16:16:11.535437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 16:16:11.535437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Aug 11 16:16:11.535437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 16:16:11.535437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 16:16:11.535437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 16:16:11.535437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Aug 11 16:16:11.535437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 644/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Aug 11 16:16:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 16:16:11.540783 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfb119-cc25-4467-8ee9-62ec27ec562e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:11.615712 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:11.638917 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfb119-cc25-4467-8ee9-62ec27ec562e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:11.671232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c238af-5f12-460c-90a4-e9e782ee1b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:11.671823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c238af-5f12-460c-90a4-e9e782ee1b11 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:11.672101 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c238af-5f12-460c-90a4-e9e782ee1b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:11.672371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c238af-5f12-460c-90a4-e9e782ee1b11 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:11.673026 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c238af-5f12-460c-90a4-e9e782ee1b11 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:16:11.673332 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c238af-5f12-460c-90a4-e9e782ee1b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:11.674679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c238af-5f12-460c-90a4-e9e782ee1b11 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:11.679634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 661/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Aug 11 16:16:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:16:11.685833 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9874c-3f4e-4dbc-99ed-e0678ab7e37d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:16:11.782055 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9874c-3f4e-4dbc-99ed-e0678ab7e37d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:16:11.814613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ba4dc-9150-4a57-9ca4-a869deab383f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:16:11.815188 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ba4dc-9150-4a57-9ca4-a869deab383f None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:16:11.815466 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ba4dc-9150-4a57-9ca4-a869deab383f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:16:11.815738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ba4dc-9150-4a57-9ca4-a869deab383f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:16:11.816386 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ba4dc-9150-4a57-9ca4-a869deab383f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:16:11.817759 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ba4dc-9150-4a57-9ca4-a869deab383f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:16:11.836976 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 645/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:16:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:16:21.676710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=30 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:16:21.832882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:14.904526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c613354-7ffc-4b2d-834d-716a3b6a0086 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:14.905122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c613354-7ffc-4b2d-834d-716a3b6a0086 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:14.905122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c613354-7ffc-4b2d-834d-716a3b6a0086 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:14.910265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 662/1307] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:17:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:14.911788 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5eae5-a313-4fc6-94a9-eec2e6102038 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:14.912232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5eae5-a313-4fc6-94a9-eec2e6102038 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:14.912323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5eae5-a313-4fc6-94a9-eec2e6102038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:15.003558 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-04e5eae5-a313-4fc6-94a9-eec2e6102038 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:15.004966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-04e5eae5-a313-4fc6-94a9-eec2e6102038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:15.135661 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 646/1308] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:17:15.188049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636726c7-2124-4612-ac5f-fd12f4e09c19 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:15.188521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636726c7-2124-4612-ac5f-fd12f4e09c19 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:15.189068 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636726c7-2124-4612-ac5f-fd12f4e09c19 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:15.191109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 663/1309] 10.222.0.40 () {54 vars in 965 bytes} [Thu Aug 11 16:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:15.203689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a145e-670c-4782-8659-3eae3bb8c0eb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:15.203907 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a145e-670c-4782-8659-3eae3bb8c0eb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:15.204180 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a145e-670c-4782-8659-3eae3bb8c0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:15.292910 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-454a145e-670c-4782-8659-3eae3bb8c0eb None None] MFA Rules not processed for user `16d2570f97234d62948762562616000c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:15.294100 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-454a145e-670c-4782-8659-3eae3bb8c0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:15.316076 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:15.397523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 647/1310] 10.222.0.40 () {58 vars in 1062 bytes} [Thu Aug 11 16:17:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:17:15.406807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636726c7-2124-4612-ac5f-fd12f4e09c19 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:17:15.408707 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-636726c7-2124-4612-ac5f-fd12f4e09c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:15.522325 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636726c7-2124-4612-ac5f-fd12f4e09c19 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:17:15.601693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f43e41-05fc-46a5-ac93-769728bbc0a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:17:15.602555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f43e41-05fc-46a5-ac93-769728bbc0a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:15.603006 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f43e41-05fc-46a5-ac93-769728bbc0a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:15.603455 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f43e41-05fc-46a5-ac93-769728bbc0a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:15.605452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e2f43e41-05fc-46a5-ac93-769728bbc0a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:15.670855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:15.736514 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f43e41-05fc-46a5-ac93-769728bbc0a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:17:15.738100 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f43e41-05fc-46a5-ac93-769728bbc0a4 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:17:15.758362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 664/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:17:18.101459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac989-623b-4a58-ac73-078063b7725d None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:18.101972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac989-623b-4a58-ac73-078063b7725d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:18.102053 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac989-623b-4a58-ac73-078063b7725d None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:18.103474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 648/1312] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:18.108987 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe82613-d80b-409a-b8ea-9c78dff9580f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:18.109444 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe82613-d80b-409a-b8ea-9c78dff9580f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:18.109525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe82613-d80b-409a-b8ea-9c78dff9580f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:18.196211 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5fe82613-d80b-409a-b8ea-9c78dff9580f None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:18.197489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5fe82613-d80b-409a-b8ea-9c78dff9580f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:18.305840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 665/1313] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:17:18.361095 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bb097-a52f-4be6-86d7-8e458e9791cf None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:18.361381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bb097-a52f-4be6-86d7-8e458e9791cf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:18.361807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bb097-a52f-4be6-86d7-8e458e9791cf None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:18.363582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 649/1314] 10.222.0.40 () {54 vars in 965 bytes} [Thu Aug 11 16:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:18.369903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630596d-218f-48e3-8b7c-ced4b134832d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:18.370194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630596d-218f-48e3-8b7c-ced4b134832d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:18.370495 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630596d-218f-48e3-8b7c-ced4b134832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:18.383132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:18.453885 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3630596d-218f-48e3-8b7c-ced4b134832d None None] MFA Rules not processed for user `16d2570f97234d62948762562616000c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:18.455146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3630596d-218f-48e3-8b7c-ced4b134832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:18.535947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 666/1315] 10.222.0.40 () {58 vars in 1062 bytes} [Thu Aug 11 16:17:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:17:18.545985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bb097-a52f-4be6-86d7-8e458e9791cf None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:17:18.547492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4b1bb097-a52f-4be6-86d7-8e458e9791cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:18.648618 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bb097-a52f-4be6-86d7-8e458e9791cf None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:17:18.717991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:18.720560 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a8cdc-f050-4007-9987-3d84e233ca96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:17:18.721369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a8cdc-f050-4007-9987-3d84e233ca96 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:18.721812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a8cdc-f050-4007-9987-3d84e233ca96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:18.722268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a8cdc-f050-4007-9987-3d84e233ca96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:18.723850 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c85a8cdc-f050-4007-9987-3d84e233ca96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:18.829682 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a8cdc-f050-4007-9987-3d84e233ca96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:17:18.831105 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a8cdc-f050-4007-9987-3d84e233ca96 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:17:18.850140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 650/1316] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:17:21.364994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e50b8-5f21-483c-b1f0-88a69a235359 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:21.365571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e50b8-5f21-483c-b1f0-88a69a235359 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:21.365571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e50b8-5f21-483c-b1f0-88a69a235359 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:21.366884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 667/1317] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:21.372131 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24378d3-ce0e-48f7-a337-2e20e34d1192 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:21.372564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24378d3-ce0e-48f7-a337-2e20e34d1192 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:21.372724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24378d3-ce0e-48f7-a337-2e20e34d1192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:21.437080 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d24378d3-ce0e-48f7-a337-2e20e34d1192 None None] MFA Rules not processed for user `25ba51db172e4f3bba446da546398dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:21.438290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d24378d3-ce0e-48f7-a337-2e20e34d1192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:21.489732 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:21.534695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 651/1318] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:17:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:17:21.575089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e50b8-5f21-483c-b1f0-88a69a235359 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:17:21.576653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c05e50b8-5f21-483c-b1f0-88a69a235359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:21.681227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e50b8-5f21-483c-b1f0-88a69a235359 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:17:21.683911 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:21.753193 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683fa69-fd4d-4820-93b4-1de7cb4a2f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:17:21.753792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683fa69-fd4d-4820-93b4-1de7cb4a2f31 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:21.754070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683fa69-fd4d-4820-93b4-1de7cb4a2f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:21.754344 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683fa69-fd4d-4820-93b4-1de7cb4a2f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:21.755937 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3683fa69-fd4d-4820-93b4-1de7cb4a2f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:21.863191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683fa69-fd4d-4820-93b4-1de7cb4a2f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:17:21.864651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683fa69-fd4d-4820-93b4-1de7cb4a2f31 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:17:21.884006 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 668/1319] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:17:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:17:24.443890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471dd59-1319-4c77-b4a8-eb7e2ac91c49 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:24.444426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471dd59-1319-4c77-b4a8-eb7e2ac91c49 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:24.444426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471dd59-1319-4c77-b4a8-eb7e2ac91c49 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:24.445802 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 652/1320] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:24.450763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f7dcd-23f9-4c40-a5cf-f0105688857a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:24.451164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f7dcd-23f9-4c40-a5cf-f0105688857a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:24.451304 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f7dcd-23f9-4c40-a5cf-f0105688857a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:24.493596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:24.518182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-542f7dcd-23f9-4c40-a5cf-f0105688857a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:24.519367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-542f7dcd-23f9-4c40-a5cf-f0105688857a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:24.619329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 669/1321] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:17:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:17:24.658293 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471dd59-1319-4c77-b4a8-eb7e2ac91c49 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:17:24.659966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8471dd59-1319-4c77-b4a8-eb7e2ac91c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:24.760856 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471dd59-1319-4c77-b4a8-eb7e2ac91c49 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:17:24.832726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a3766-709d-43e6-8231-3ac617a9d0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:17:24.833312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a3766-709d-43e6-8231-3ac617a9d0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:24.833586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a3766-709d-43e6-8231-3ac617a9d0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:24.833852 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a3766-709d-43e6-8231-3ac617a9d0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:24.835443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f81a3766-709d-43e6-8231-3ac617a9d0a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:24.843273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:24.953972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a3766-709d-43e6-8231-3ac617a9d0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:17:24.955482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a3766-709d-43e6-8231-3ac617a9d0a6 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:17:24.973884 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 653/1322] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:17:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:17:27.607041 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346d22d-12ba-428b-aaaf-15467eb4c33e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:27.607591 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346d22d-12ba-428b-aaaf-15467eb4c33e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:27.607591 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346d22d-12ba-428b-aaaf-15467eb4c33e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:27.608981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 670/1323] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:27.614221 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3d83b-e794-4d14-88fc-03eb4d99894d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:27.614620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3d83b-e794-4d14-88fc-03eb4d99894d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:27.614777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3d83b-e794-4d14-88fc-03eb4d99894d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:27.682697 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-19a3d83b-e794-4d14-88fc-03eb4d99894d None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:27.684518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-19a3d83b-e794-4d14-88fc-03eb4d99894d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:27.748752 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:27.801532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 654/1324] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:17:27.837944 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346d22d-12ba-428b-aaaf-15467eb4c33e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:17:27.839522 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d346d22d-12ba-428b-aaaf-15467eb4c33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:27.950476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346d22d-12ba-428b-aaaf-15467eb4c33e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:17:27.962901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:28.025087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75105fa-241b-4b7b-8207-b1fb52b4c6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:17:28.025711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75105fa-241b-4b7b-8207-b1fb52b4c6ec service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:28.025996 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75105fa-241b-4b7b-8207-b1fb52b4c6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:28.026270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75105fa-241b-4b7b-8207-b1fb52b4c6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:28.028411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f75105fa-241b-4b7b-8207-b1fb52b4c6ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:28.136774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75105fa-241b-4b7b-8207-b1fb52b4c6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:17:28.138289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75105fa-241b-4b7b-8207-b1fb52b4c6ec service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:17:28.156216 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 671/1325] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:17:30.220332 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9aac9-3832-4f5f-bcba-b089bf0054a7 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:30.220871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9aac9-3832-4f5f-bcba-b089bf0054a7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:30.220871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9aac9-3832-4f5f-bcba-b089bf0054a7 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:30.222157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 655/1326] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:30.227406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207a6dc-e5a3-4ae8-80ba-363daa27a85e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:30.227846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207a6dc-e5a3-4ae8-80ba-363daa27a85e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:30.227936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207a6dc-e5a3-4ae8-80ba-363daa27a85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:30.275605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:30.294159 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0207a6dc-e5a3-4ae8-80ba-363daa27a85e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:30.295361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0207a6dc-e5a3-4ae8-80ba-363daa27a85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:30.391065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 672/1327] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:17:30.429003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9aac9-3832-4f5f-bcba-b089bf0054a7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:17:30.430593 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-67a9aac9-3832-4f5f-bcba-b089bf0054a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:30.535622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9aac9-3832-4f5f-bcba-b089bf0054a7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:17:30.612419 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a36d3b-0eb0-453d-9db4-a961cd8af917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:17:30.613119 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a36d3b-0eb0-453d-9db4-a961cd8af917 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:30.613397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a36d3b-0eb0-453d-9db4-a961cd8af917 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:30.613687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a36d3b-0eb0-453d-9db4-a961cd8af917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:30.615391 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c9a36d3b-0eb0-453d-9db4-a961cd8af917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:30.634761 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:30.727606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a36d3b-0eb0-453d-9db4-a961cd8af917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:17:30.729002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a36d3b-0eb0-453d-9db4-a961cd8af917 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:17:30.748070 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 656/1328] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:17:32.802206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75ed61-a604-4ca1-987d-b9e63eaf3afe None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:32.802733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75ed61-a604-4ca1-987d-b9e63eaf3afe None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:32.802733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75ed61-a604-4ca1-987d-b9e63eaf3afe None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:32.804020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 673/1329] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:32.809834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5b0c4-b0db-4841-9eea-343cf6c8c0fa None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:32.810249 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5b0c4-b0db-4841-9eea-343cf6c8c0fa None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:32.810365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5b0c4-b0db-4841-9eea-343cf6c8c0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:32.876971 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a8f5b0c4-b0db-4841-9eea-343cf6c8c0fa None None] MFA Rules not processed for user `25ba51db172e4f3bba446da546398dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:32.878165 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a8f5b0c4-b0db-4841-9eea-343cf6c8c0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:32.945006 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:32.977867 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 657/1330] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:17:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:17:33.016314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75ed61-a604-4ca1-987d-b9e63eaf3afe None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:17:33.017891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9a75ed61-a604-4ca1-987d-b9e63eaf3afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:33.125831 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75ed61-a604-4ca1-987d-b9e63eaf3afe None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:17:33.144896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:33.198038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd62c76-0038-4179-be34-82f21e08d177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:17:33.198633 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd62c76-0038-4179-be34-82f21e08d177 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:33.198935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd62c76-0038-4179-be34-82f21e08d177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:33.199200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd62c76-0038-4179-be34-82f21e08d177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:33.201088 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8fd62c76-0038-4179-be34-82f21e08d177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:33.313036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd62c76-0038-4179-be34-82f21e08d177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:17:33.314638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd62c76-0038-4179-be34-82f21e08d177 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:17:33.332503 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 674/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:17:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:17:35.615035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774454b-efd4-46dc-89cf-7cfe4944038e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:35.615560 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774454b-efd4-46dc-89cf-7cfe4944038e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:35.615560 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774454b-efd4-46dc-89cf-7cfe4944038e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:35.616943 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 658/1332] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:35.622095 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629ad31-17da-438b-be89-a77a6f0b13a2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:35.622486 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629ad31-17da-438b-be89-a77a6f0b13a2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:35.622645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629ad31-17da-438b-be89-a77a6f0b13a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:35.684475 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:35.687119 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d629ad31-17da-438b-be89-a77a6f0b13a2 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:35.688942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d629ad31-17da-438b-be89-a77a6f0b13a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:35.786032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 675/1333] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:17:35.822044 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774454b-efd4-46dc-89cf-7cfe4944038e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:17:35.823564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b774454b-efd4-46dc-89cf-7cfe4944038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:35.925938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774454b-efd4-46dc-89cf-7cfe4944038e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:17:36.000197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67f467-83b0-4fe2-9343-681b18e997a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:17:36.000818 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67f467-83b0-4fe2-9343-681b18e997a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:36.001096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67f467-83b0-4fe2-9343-681b18e997a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:36.001374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67f467-83b0-4fe2-9343-681b18e997a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:36.002959 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ab67f467-83b0-4fe2-9343-681b18e997a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:36.030622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:36.110371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67f467-83b0-4fe2-9343-681b18e997a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:17:36.111793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67f467-83b0-4fe2-9343-681b18e997a8 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:17:36.129339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 659/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:17:38.178164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd92872-a1af-4e18-8068-546f28bb113e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:38.178718 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd92872-a1af-4e18-8068-546f28bb113e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:38.178718 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd92872-a1af-4e18-8068-546f28bb113e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:38.180053 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 676/1335] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:38.185857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7b178-90f5-4aba-9537-eef46c367577 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:38.186234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7b178-90f5-4aba-9537-eef46c367577 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:38.186398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7b178-90f5-4aba-9537-eef46c367577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:38.250631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a5d7b178-90f5-4aba-9537-eef46c367577 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:38.251830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a5d7b178-90f5-4aba-9537-eef46c367577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:38.324481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:38.346743 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 660/1336] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:17:38.387658 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd92872-a1af-4e18-8068-546f28bb113e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:17:38.389217 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1fd92872-a1af-4e18-8068-546f28bb113e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:38.491283 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd92872-a1af-4e18-8068-546f28bb113e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:17:38.526169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:38.574659 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d5d8a-9b0b-4e60-bf80-038cafecfe16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:17:38.575261 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d5d8a-9b0b-4e60-bf80-038cafecfe16 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:38.575531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d5d8a-9b0b-4e60-bf80-038cafecfe16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:38.575794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d5d8a-9b0b-4e60-bf80-038cafecfe16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:38.577397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-244d5d8a-9b0b-4e60-bf80-038cafecfe16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:38.681260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d5d8a-9b0b-4e60-bf80-038cafecfe16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:17:38.682671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d5d8a-9b0b-4e60-bf80-038cafecfe16 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:17:38.701835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 677/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:17:41.055845 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f76f5-9bc9-4b25-aeb0-c3d6315f8094 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:41.056431 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f76f5-9bc9-4b25-aeb0-c3d6315f8094 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:41.056431 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f76f5-9bc9-4b25-aeb0-c3d6315f8094 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:41.058266 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 661/1338] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:41.063466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac645c75-1c09-4485-97cc-b760491bf27c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:41.063861 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac645c75-1c09-4485-97cc-b760491bf27c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:41.064023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac645c75-1c09-4485-97cc-b760491bf27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:41.130806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ac645c75-1c09-4485-97cc-b760491bf27c None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:41.132004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ac645c75-1c09-4485-97cc-b760491bf27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:41.140310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:41.227673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 678/1339] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:17:41.264178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f76f5-9bc9-4b25-aeb0-c3d6315f8094 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:17:41.265729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ea3f76f5-9bc9-4b25-aeb0-c3d6315f8094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:41.365647 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f76f5-9bc9-4b25-aeb0-c3d6315f8094 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:17:41.437919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fb72f-d3e3-457c-a66f-56f1a61e773d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:17:41.438510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fb72f-d3e3-457c-a66f-56f1a61e773d service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:41.438787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fb72f-d3e3-457c-a66f-56f1a61e773d service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:41.439058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fb72f-d3e3-457c-a66f-56f1a61e773d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:41.440656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b94fb72f-d3e3-457c-a66f-56f1a61e773d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:41.476182 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:41.549666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fb72f-d3e3-457c-a66f-56f1a61e773d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:17:41.551148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fb72f-d3e3-457c-a66f-56f1a61e773d service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:17:41.569164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 662/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:17:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:17:45.776182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe1110-ca94-4fbb-bedd-3dbc0574a71f None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:45.776758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe1110-ca94-4fbb-bedd-3dbc0574a71f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:45.776758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe1110-ca94-4fbb-bedd-3dbc0574a71f None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:45.778184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 679/1341] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:45.783620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb590fe-8a1a-4054-83e7-02d2472b9d37 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:45.784064 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb590fe-8a1a-4054-83e7-02d2472b9d37 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:45.784316 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb590fe-8a1a-4054-83e7-02d2472b9d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:45.849922 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9bb590fe-8a1a-4054-83e7-02d2472b9d37 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:45.851118 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9bb590fe-8a1a-4054-83e7-02d2472b9d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:45.939714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:45.952110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 663/1342] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:17:45.991756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe1110-ca94-4fbb-bedd-3dbc0574a71f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:17:45.993331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-33fe1110-ca94-4fbb-bedd-3dbc0574a71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:46.098413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe1110-ca94-4fbb-bedd-3dbc0574a71f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:17:46.135722 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:46.176563 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702acd3-8db7-4a1a-9155-5ab9a5dbf11d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:17:46.177199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702acd3-8db7-4a1a-9155-5ab9a5dbf11d service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:46.177485 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702acd3-8db7-4a1a-9155-5ab9a5dbf11d service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:46.177754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702acd3-8db7-4a1a-9155-5ab9a5dbf11d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:46.179354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6702acd3-8db7-4a1a-9155-5ab9a5dbf11d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:46.290519 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702acd3-8db7-4a1a-9155-5ab9a5dbf11d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:17:46.292451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702acd3-8db7-4a1a-9155-5ab9a5dbf11d service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:17:46.310909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 680/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:17:48.943561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a00f50-9d8c-41b7-8f81-20235495ad52 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:48.944114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a00f50-9d8c-41b7-8f81-20235495ad52 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:48.944114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a00f50-9d8c-41b7-8f81-20235495ad52 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:48.945685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 664/1344] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:48.951117 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00b198-0703-4b63-8b37-20606f540b82 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:48.951661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00b198-0703-4b63-8b37-20606f540b82 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:48.951661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00b198-0703-4b63-8b37-20606f540b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:49.025367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6e00b198-0703-4b63-8b37-20606f540b82 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:49.027325 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6e00b198-0703-4b63-8b37-20606f540b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:49.049716 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:49.131522 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 681/1345] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:17:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:17:49.172841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a00f50-9d8c-41b7-8f81-20235495ad52 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:17:49.174663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-96a00f50-9d8c-41b7-8f81-20235495ad52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:49.280071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a00f50-9d8c-41b7-8f81-20235495ad52 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:17:49.355452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef064bd3-2afb-4e7d-83e3-c305cc78f484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:17:49.356052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef064bd3-2afb-4e7d-83e3-c305cc78f484 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:49.356327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef064bd3-2afb-4e7d-83e3-c305cc78f484 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:49.356630 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef064bd3-2afb-4e7d-83e3-c305cc78f484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:49.358211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ef064bd3-2afb-4e7d-83e3-c305cc78f484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:49.402807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:49.473843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef064bd3-2afb-4e7d-83e3-c305cc78f484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:17:49.475282 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef064bd3-2afb-4e7d-83e3-c305cc78f484 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:17:49.495261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 665/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:17:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:17:53.477759 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f7ca4-e2dc-4b9c-bc12-fbddc6ad4af8 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:53.478243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f7ca4-e2dc-4b9c-bc12-fbddc6ad4af8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:53.478340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f7ca4-e2dc-4b9c-bc12-fbddc6ad4af8 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:53.479732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 682/1347] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:53.485195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db136de-c8ea-4f09-ae13-bac39c0fd504 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:53.485694 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db136de-c8ea-4f09-ae13-bac39c0fd504 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:53.485858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db136de-c8ea-4f09-ae13-bac39c0fd504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:53.553340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4db136de-c8ea-4f09-ae13-bac39c0fd504 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:53.554567 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4db136de-c8ea-4f09-ae13-bac39c0fd504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:53.649765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:53.652619 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 666/1348] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:17:53.691691 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f7ca4-e2dc-4b9c-bc12-fbddc6ad4af8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:17:53.693349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-901f7ca4-e2dc-4b9c-bc12-fbddc6ad4af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:53.816995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f7ca4-e2dc-4b9c-bc12-fbddc6ad4af8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:17:53.870778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:53.898327 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7f531-a3e8-4a8b-a3a7-cd45fba4a24a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:17:53.898951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7f531-a3e8-4a8b-a3a7-cd45fba4a24a service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:53.899230 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7f531-a3e8-4a8b-a3a7-cd45fba4a24a service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:53.899502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7f531-a3e8-4a8b-a3a7-cd45fba4a24a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:53.901222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f1e7f531-a3e8-4a8b-a3a7-cd45fba4a24a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:54.019150 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7f531-a3e8-4a8b-a3a7-cd45fba4a24a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:17:54.020676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7f531-a3e8-4a8b-a3a7-cd45fba4a24a service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:17:54.039803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 683/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:17:58.991002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92203559-cebe-4bee-b65b-51fd8cf626d8 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:58.991447 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92203559-cebe-4bee-b65b-51fd8cf626d8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:58.991753 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92203559-cebe-4bee-b65b-51fd8cf626d8 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:58.993599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 667/1350] 10.222.0.40 () {54 vars in 921 bytes} [Thu Aug 11 16:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:17:58.999234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0d88d-9803-4a70-8abf-0bcb4bdaa40c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:17:58.999629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0d88d-9803-4a70-8abf-0bcb4bdaa40c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:17:58.999793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0d88d-9803-4a70-8abf-0bcb4bdaa40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:17:59.134669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-77b0d88d-9803-4a70-8abf-0bcb4bdaa40c None None] MFA Rules not processed for user `64e1c7e6ee814b47912760cf7daf54c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:17:59.136006 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-77b0d88d-9803-4a70-8abf-0bcb4bdaa40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:17:59.154978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:17:59.259536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 684/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Aug 11 16:17:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:03.354374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708aad4-6e5e-4ead-91e4-5110afc2624a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:03.354927 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708aad4-6e5e-4ead-91e4-5110afc2624a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:03.355303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708aad4-6e5e-4ead-91e4-5110afc2624a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:03.357038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 668/1352] 10.222.0.40 () {54 vars in 921 bytes} [Thu Aug 11 16:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:03.362097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec669123-3c58-48d3-9a78-7b5353600520 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:03.362495 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec669123-3c58-48d3-9a78-7b5353600520 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:03.362658 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec669123-3c58-48d3-9a78-7b5353600520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:03.442105 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ec669123-3c58-48d3-9a78-7b5353600520 None None] MFA Rules not processed for user `64e1c7e6ee814b47912760cf7daf54c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:03.443318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ec669123-3c58-48d3-9a78-7b5353600520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:03.527497 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:03.565521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 685/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Aug 11 16:18:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:04.968671 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453b8b8-a518-4efa-a8ff-b01d96050435 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:04.969203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453b8b8-a518-4efa-a8ff-b01d96050435 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:04.969285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453b8b8-a518-4efa-a8ff-b01d96050435 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:04.970931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 669/1354] 10.222.0.40 () {54 vars in 921 bytes} [Thu Aug 11 16:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:04.975835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed5177-5733-4d77-a27b-d5c1284ab436 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:04.976248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed5177-5733-4d77-a27b-d5c1284ab436 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:04.976387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed5177-5733-4d77-a27b-d5c1284ab436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:05.051617 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8aed5177-5733-4d77-a27b-d5c1284ab436 None None] MFA Rules not processed for user `64e1c7e6ee814b47912760cf7daf54c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:05.052844 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8aed5177-5733-4d77-a27b-d5c1284ab436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:05.157441 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 686/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Aug 11 16:18:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:08.565713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582047b-2f71-4b4c-a371-9debae0e57a1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:08.566181 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582047b-2f71-4b4c-a371-9debae0e57a1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:08.566276 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582047b-2f71-4b4c-a371-9debae0e57a1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:08.567548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 670/1356] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:08.575119 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df71f48-13a5-438e-a440-b96cea7e750e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:08.575990 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df71f48-13a5-438e-a440-b96cea7e750e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:08.576283 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df71f48-13a5-438e-a440-b96cea7e750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:08.621945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:08.660618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5df71f48-13a5-438e-a440-b96cea7e750e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:08.661768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5df71f48-13a5-438e-a440-b96cea7e750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:08.771429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 687/1357] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:08.825949 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de66772-eaf6-44c5-ae4d-3808b97746b5 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:08.826599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de66772-eaf6-44c5-ae4d-3808b97746b5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:08.827109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de66772-eaf6-44c5-ae4d-3808b97746b5 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:08.829226 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 671/1358] 10.222.0.40 () {54 vars in 962 bytes} [Thu Aug 11 16:18:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:08.838488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef681a52-4d97-41b3-8b30-f3986a2f1842 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:08.839283 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef681a52-4d97-41b3-8b30-f3986a2f1842 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:08.839779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef681a52-4d97-41b3-8b30-f3986a2f1842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:08.927329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ef681a52-4d97-41b3-8b30-f3986a2f1842 None None] MFA Rules not processed for user `4e91f3fbe098459dba0acf8ec1fb7098`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:08.929016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ef681a52-4d97-41b3-8b30-f3986a2f1842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:08.984143 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:09.057602 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 688/1359] 10.222.0.40 () {58 vars in 1059 bytes} [Thu Aug 11 16:18:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:09.065129 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de66772-eaf6-44c5-ae4d-3808b97746b5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:18:09.066630 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3de66772-eaf6-44c5-ae4d-3808b97746b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:09.221147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de66772-eaf6-44c5-ae4d-3808b97746b5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:18:09.297173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:09.341741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810c687-0557-4e08-82e0-c142860b3918 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:18:09.342343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810c687-0557-4e08-82e0-c142860b3918 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:09.342620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810c687-0557-4e08-82e0-c142860b3918 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:09.342890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810c687-0557-4e08-82e0-c142860b3918 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:09.344491 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0810c687-0557-4e08-82e0-c142860b3918 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:09.442007 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810c687-0557-4e08-82e0-c142860b3918 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:18:09.443984 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810c687-0557-4e08-82e0-c142860b3918 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:18:09.463930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 672/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:18:11.701921 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278dd99-77a4-4667-bbb8-945d3e4fca05 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:11.702381 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278dd99-77a4-4667-bbb8-945d3e4fca05 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:11.702474 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278dd99-77a4-4667-bbb8-945d3e4fca05 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:11.709178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18964a99-b2b3-468a-a7e5-dbcba3ef5d26 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:11.709668 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18964a99-b2b3-468a-a7e5-dbcba3ef5d26 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:11.709762 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18964a99-b2b3-468a-a7e5-dbcba3ef5d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:11.710937 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 689/1361] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:18:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:11.794699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-18964a99-b2b3-468a-a7e5-dbcba3ef5d26 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:11.796132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-18964a99-b2b3-468a-a7e5-dbcba3ef5d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:11.835624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:11.902908 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 673/1362] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:18:11.946786 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278dd99-77a4-4667-bbb8-945d3e4fca05 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:18:11.949783 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6278dd99-77a4-4667-bbb8-945d3e4fca05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:12.125610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278dd99-77a4-4667-bbb8-945d3e4fca05 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:18:12.136211 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:12.290885 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fb3d7-da5d-4672-8351-f1793a0e8442 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:18:12.291496 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fb3d7-da5d-4672-8351-f1793a0e8442 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:12.291779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fb3d7-da5d-4672-8351-f1793a0e8442 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:12.292044 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fb3d7-da5d-4672-8351-f1793a0e8442 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:12.293666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d04fb3d7-da5d-4672-8351-f1793a0e8442 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:12.394308 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fb3d7-da5d-4672-8351-f1793a0e8442 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:18:12.395937 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fb3d7-da5d-4672-8351-f1793a0e8442 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:18:12.414647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 690/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:18:14.790593 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390d7d6-be6b-47a1-8326-daf481f6923c None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:14.791611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390d7d6-be6b-47a1-8326-daf481f6923c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:14.791611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390d7d6-be6b-47a1-8326-daf481f6923c None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:14.793232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 674/1364] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:14.798853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a1ea2-06d1-47f4-9388-5eed50c57d26 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:14.799287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a1ea2-06d1-47f4-9388-5eed50c57d26 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:14.799463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a1ea2-06d1-47f4-9388-5eed50c57d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:14.820767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:14.890727 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-362a1ea2-06d1-47f4-9388-5eed50c57d26 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:14.892207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-362a1ea2-06d1-47f4-9388-5eed50c57d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:14.996506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 691/1365] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:15.042924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d550d-6ece-4849-bd10-b9d1c69e08c1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:15.043166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d550d-6ece-4849-bd10-b9d1c69e08c1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:15.043702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d550d-6ece-4849-bd10-b9d1c69e08c1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:15.045436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 675/1366] 10.222.0.40 () {54 vars in 962 bytes} [Thu Aug 11 16:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:15.050625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45267c2-58c9-4f45-aff5-60eb66c37809 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:15.050918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45267c2-58c9-4f45-aff5-60eb66c37809 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:15.051198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45267c2-58c9-4f45-aff5-60eb66c37809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:15.129487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d45267c2-58c9-4f45-aff5-60eb66c37809 None None] MFA Rules not processed for user `4e91f3fbe098459dba0acf8ec1fb7098`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:15.130672 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d45267c2-58c9-4f45-aff5-60eb66c37809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:15.172928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:15.261285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 692/1367] 10.222.0.40 () {58 vars in 1059 bytes} [Thu Aug 11 16:18:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:15.269268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d550d-6ece-4849-bd10-b9d1c69e08c1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:18:15.270753 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0e3d550d-6ece-4849-bd10-b9d1c69e08c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:15.440870 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d550d-6ece-4849-bd10-b9d1c69e08c1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:18:15.462266 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:15.565533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f6dcf-79a0-4b8e-aa69-88bdee5d93e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:18:15.566138 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f6dcf-79a0-4b8e-aa69-88bdee5d93e1 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:15.566416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f6dcf-79a0-4b8e-aa69-88bdee5d93e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:15.566684 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f6dcf-79a0-4b8e-aa69-88bdee5d93e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:15.568892 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ad3f6dcf-79a0-4b8e-aa69-88bdee5d93e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:15.664761 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f6dcf-79a0-4b8e-aa69-88bdee5d93e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:18:15.666840 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f6dcf-79a0-4b8e-aa69-88bdee5d93e1 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:18:15.687945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 676/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:18:16.727307 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8365b3d-3590-402e-8e4a-019fe84a2cc0 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:16.727823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8365b3d-3590-402e-8e4a-019fe84a2cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:16.727823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8365b3d-3590-402e-8e4a-019fe84a2cc0 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:16.733428 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 693/1369] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:16.735559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fd446-1947-4420-822c-ea739fbbeaae None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:16.735972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fd446-1947-4420-822c-ea739fbbeaae None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:16.736151 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fd446-1947-4420-822c-ea739fbbeaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:16.773141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:16.814294 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-346fd446-1947-4420-822c-ea739fbbeaae None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:16.815499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-346fd446-1947-4420-822c-ea739fbbeaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:16.927403 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 677/1370] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:17.273966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4a5a5-6c78-4739-a9fe-b4ac62072b09 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:17.273966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4a5a5-6c78-4739-a9fe-b4ac62072b09 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:17.273966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4a5a5-6c78-4739-a9fe-b4ac62072b09 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:17.277434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 694/1371] 10.222.0.40 () {54 vars in 964 bytes} [Thu Aug 11 16:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:17.280513 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b54779-7547-48a8-9e35-adf9d29e6500 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:17.280836 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b54779-7547-48a8-9e35-adf9d29e6500 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:17.281114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b54779-7547-48a8-9e35-adf9d29e6500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:17.364504 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-24b54779-7547-48a8-9e35-adf9d29e6500 None None] MFA Rules not processed for user `1e52aae602104cc2b48354b2d75d359c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:17.365995 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-24b54779-7547-48a8-9e35-adf9d29e6500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:17.417685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:17.454158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 678/1372] 10.222.0.40 () {58 vars in 1061 bytes} [Thu Aug 11 16:18:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:18:17.462229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4a5a5-6c78-4739-a9fe-b4ac62072b09 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:18:17.464318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3ac4a5a5-6c78-4739-a9fe-b4ac62072b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:17.585460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4a5a5-6c78-4739-a9fe-b4ac62072b09 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:18:17.628048 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:17.664018 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204a8d4-a7f8-4a99-94e0-2ec8cfcd2e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:18:17.664648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204a8d4-a7f8-4a99-94e0-2ec8cfcd2e0f service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:17.664933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204a8d4-a7f8-4a99-94e0-2ec8cfcd2e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:17.665203 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204a8d4-a7f8-4a99-94e0-2ec8cfcd2e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:17.667329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1204a8d4-a7f8-4a99-94e0-2ec8cfcd2e0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:17.791420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204a8d4-a7f8-4a99-94e0-2ec8cfcd2e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:18:17.792951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204a8d4-a7f8-4a99-94e0-2ec8cfcd2e0f service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:18:17.811941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 695/1373] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:18:17.837234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd572c-79c6-42c3-8201-0977e2a01584 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:17.838412 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd572c-79c6-42c3-8201-0977e2a01584 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:17.838412 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd572c-79c6-42c3-8201-0977e2a01584 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:17.843177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 679/1374] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:18:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:17.844660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9b643-6888-4b23-8c7d-8abcd3bf50c6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:17.845089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9b643-6888-4b23-8c7d-8abcd3bf50c6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:17.845250 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9b643-6888-4b23-8c7d-8abcd3bf50c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:17.914655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-68b9b643-6888-4b23-8c7d-8abcd3bf50c6 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:17.915874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-68b9b643-6888-4b23-8c7d-8abcd3bf50c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:17.938509 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:18.025664 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 696/1375] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:18.069201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd572c-79c6-42c3-8201-0977e2a01584 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:18:18.069201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-85fd572c-79c6-42c3-8201-0977e2a01584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:18.229008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd572c-79c6-42c3-8201-0977e2a01584 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:18:18.281760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:18.346026 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043df63-b830-4496-8a0c-72192a716086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:18:18.346631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043df63-b830-4496-8a0c-72192a716086 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:18.346904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043df63-b830-4496-8a0c-72192a716086 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:18.347171 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043df63-b830-4496-8a0c-72192a716086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:18.348783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0043df63-b830-4496-8a0c-72192a716086 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:18.446240 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043df63-b830-4496-8a0c-72192a716086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:18:18.448424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043df63-b830-4496-8a0c-72192a716086 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:18:18.467584 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 680/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:18:20.502389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55deab94-f830-415d-8348-ecc042392b50 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:20.502896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55deab94-f830-415d-8348-ecc042392b50 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:20.502992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55deab94-f830-415d-8348-ecc042392b50 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:20.504284 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 697/1377] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:20.509965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c684f5-57ea-4666-9e1c-9d8a707fc3b3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:20.510715 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c684f5-57ea-4666-9e1c-9d8a707fc3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:20.511177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c684f5-57ea-4666-9e1c-9d8a707fc3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:20.580173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e4c684f5-57ea-4666-9e1c-9d8a707fc3b3 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:20.581417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e4c684f5-57ea-4666-9e1c-9d8a707fc3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:20.588233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:20.677662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 681/1378] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:20.722462 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55deab94-f830-415d-8348-ecc042392b50 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:18:20.723973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-55deab94-f830-415d-8348-ecc042392b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:20.910447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55deab94-f830-415d-8348-ecc042392b50 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:18:20.914303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:21.023114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8e741-8f9c-47b6-b317-f3e262a677d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:18:21.023709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8e741-8f9c-47b6-b317-f3e262a677d9 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:21.023978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8e741-8f9c-47b6-b317-f3e262a677d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:21.024240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8e741-8f9c-47b6-b317-f3e262a677d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:21.025840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-86b8e741-8f9c-47b6-b317-f3e262a677d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:21.124125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8e741-8f9c-47b6-b317-f3e262a677d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:18:21.125774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8e741-8f9c-47b6-b317-f3e262a677d9 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:18:21.148948 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 698/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:18:23.237726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50922c90-570f-4b66-80b5-b705a2651447 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:23.238342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50922c90-570f-4b66-80b5-b705a2651447 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:23.238508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50922c90-570f-4b66-80b5-b705a2651447 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:23.240403 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 682/1380] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:18:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:23.245493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd2cc0-0b46-46aa-a7a9-357eb4ebaa92 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:23.245928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd2cc0-0b46-46aa-a7a9-357eb4ebaa92 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:23.246028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd2cc0-0b46-46aa-a7a9-357eb4ebaa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:23.257717 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:23.316003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-94fd2cc0-0b46-46aa-a7a9-357eb4ebaa92 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:23.317237 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-94fd2cc0-0b46-46aa-a7a9-357eb4ebaa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:23.428252 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 699/1381] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:23.472930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50922c90-570f-4b66-80b5-b705a2651447 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:18:23.474962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-50922c90-570f-4b66-80b5-b705a2651447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:23.619081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:23.631928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50922c90-570f-4b66-80b5-b705a2651447 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:18:23.763383 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2375840-1b16-4b63-bab2-a016ebf41ef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:18:23.764003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2375840-1b16-4b63-bab2-a016ebf41ef2 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:23.764282 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2375840-1b16-4b63-bab2-a016ebf41ef2 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:23.764552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2375840-1b16-4b63-bab2-a016ebf41ef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:23.766189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c2375840-1b16-4b63-bab2-a016ebf41ef2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:23.862512 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2375840-1b16-4b63-bab2-a016ebf41ef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:18:23.864118 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2375840-1b16-4b63-bab2-a016ebf41ef2 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:18:23.876460 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:23.886617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 683/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:18:26.197461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23955cbc-160f-447f-9179-8b7963788196 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:26.198169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23955cbc-160f-447f-9179-8b7963788196 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:26.198169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23955cbc-160f-447f-9179-8b7963788196 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:26.199373 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 700/1383] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:26.204845 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4e067-d394-40b7-819b-13a0d5b14d80 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:26.205394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4e067-d394-40b7-819b-13a0d5b14d80 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:26.205394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4e067-d394-40b7-819b-13a0d5b14d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:26.278043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fbe4e067-d394-40b7-819b-13a0d5b14d80 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:26.279284 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fbe4e067-d394-40b7-819b-13a0d5b14d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:26.379233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 684/1384] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:26.422667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23955cbc-160f-447f-9179-8b7963788196 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:18:26.424187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-23955cbc-160f-447f-9179-8b7963788196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:26.513062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:26.578442 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23955cbc-160f-447f-9179-8b7963788196 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:18:26.707652 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa244b44-cdba-4833-b22a-4081b48691b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:18:26.708463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa244b44-cdba-4833-b22a-4081b48691b0 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:26.708856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa244b44-cdba-4833-b22a-4081b48691b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:26.709202 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa244b44-cdba-4833-b22a-4081b48691b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:26.711261 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-aa244b44-cdba-4833-b22a-4081b48691b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:26.774711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:26.825128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa244b44-cdba-4833-b22a-4081b48691b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:18:26.827188 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa244b44-cdba-4833-b22a-4081b48691b0 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:18:26.849519 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 701/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:18:28.870301 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc31312-38f5-41bf-899c-dbfdb8a96e44 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:28.871013 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc31312-38f5-41bf-899c-dbfdb8a96e44 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:28.871013 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc31312-38f5-41bf-899c-dbfdb8a96e44 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:28.872181 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 685/1386] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:18:28.877551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ec2f6-b02b-4420-987b-f87f8a30f744 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:28.878145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ec2f6-b02b-4420-987b-f87f8a30f744 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:28.878145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ec2f6-b02b-4420-987b-f87f8a30f744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:28.945222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9d1ec2f6-b02b-4420-987b-f87f8a30f744 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:28.947049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9d1ec2f6-b02b-4420-987b-f87f8a30f744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:29.061119 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 702/1387] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:29.116801 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc31312-38f5-41bf-899c-dbfdb8a96e44 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:18:29.118947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9bc31312-38f5-41bf-899c-dbfdb8a96e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:29.199178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:29.270461 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc31312-38f5-41bf-899c-dbfdb8a96e44 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:18:29.387063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be78939-d3b9-448a-8d2e-6e726e1d2a14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:18:29.387671 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78939-d3b9-448a-8d2e-6e726e1d2a14 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:29.387952 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78939-d3b9-448a-8d2e-6e726e1d2a14 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:29.388371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78939-d3b9-448a-8d2e-6e726e1d2a14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:29.389861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3be78939-d3b9-448a-8d2e-6e726e1d2a14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:29.431730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:29.487331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be78939-d3b9-448a-8d2e-6e726e1d2a14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:18:29.489443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be78939-d3b9-448a-8d2e-6e726e1d2a14 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:18:29.512524 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 686/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:18:31.551980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c14de-5762-4f67-9098-c49f434f88b1 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:31.552539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c14de-5762-4f67-9098-c49f434f88b1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:31.552539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c14de-5762-4f67-9098-c49f434f88b1 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:31.553938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 703/1389] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:31.559941 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cadea3-6ce0-4281-8403-09ab8de399a7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:31.560524 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cadea3-6ce0-4281-8403-09ab8de399a7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:31.560524 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cadea3-6ce0-4281-8403-09ab8de399a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:31.630041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e0cadea3-6ce0-4281-8403-09ab8de399a7 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:31.631235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e0cadea3-6ce0-4281-8403-09ab8de399a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:31.726622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 687/1390] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:31.771059 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c14de-5762-4f67-9098-c49f434f88b1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:18:31.772557 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-909c14de-5762-4f67-9098-c49f434f88b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:31.802978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:31.921963 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c14de-5762-4f67-9098-c49f434f88b1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:18:32.026153 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:32.038051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969cb94-5669-4088-9c9b-de5a1b7e06c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:18:32.038908 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969cb94-5669-4088-9c9b-de5a1b7e06c5 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:32.039183 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969cb94-5669-4088-9c9b-de5a1b7e06c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:32.039453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969cb94-5669-4088-9c9b-de5a1b7e06c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:32.041116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d969cb94-5669-4088-9c9b-de5a1b7e06c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:32.129437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969cb94-5669-4088-9c9b-de5a1b7e06c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:18:32.131073 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969cb94-5669-4088-9c9b-de5a1b7e06c5 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:18:32.148647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 704/1391] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:18:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:18:33.224318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eefaed-37e2-42a0-ae8e-b297b929ed16 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:33.224934 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eefaed-37e2-42a0-ae8e-b297b929ed16 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:33.224934 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eefaed-37e2-42a0-ae8e-b297b929ed16 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:33.226240 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 688/1392] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:33.231781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0280c-8caa-43a3-9dc7-682493275fa9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:33.232251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0280c-8caa-43a3-9dc7-682493275fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:33.232459 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0280c-8caa-43a3-9dc7-682493275fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:33.303948 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8be0280c-8caa-43a3-9dc7-682493275fa9 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:33.305193 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8be0280c-8caa-43a3-9dc7-682493275fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:33.363319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:33.402018 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 705/1393] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:33.458138 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741030a7-dc67-4215-959c-1a79de0d73ac None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:33.458424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741030a7-dc67-4215-959c-1a79de0d73ac None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:33.458700 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741030a7-dc67-4215-959c-1a79de0d73ac None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:33.460027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 689/1394] 10.222.0.40 () {54 vars in 967 bytes} [Thu Aug 11 16:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:33.465016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41508f-6648-43d9-8731-03cbbd20c5fe None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:33.465306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41508f-6648-43d9-8731-03cbbd20c5fe None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:33.465582 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41508f-6648-43d9-8731-03cbbd20c5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:33.544541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2b41508f-6648-43d9-8731-03cbbd20c5fe None None] MFA Rules not processed for user `2c9158ce9d8a4aadbf86405657958c48`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:33.545779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2b41508f-6648-43d9-8731-03cbbd20c5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:33.622764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 706/1395] 10.222.0.40 () {58 vars in 1064 bytes} [Thu Aug 11 16:18:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:33.630257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741030a7-dc67-4215-959c-1a79de0d73ac None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:18:33.631845 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-741030a7-dc67-4215-959c-1a79de0d73ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:33.645349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:33.735886 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741030a7-dc67-4215-959c-1a79de0d73ac None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:18:33.809546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbf2dc-d68d-46ad-9c48-97fffd9b2f69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9158ce9d8a4aadbf86405657958c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:18:33.810146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbf2dc-d68d-46ad-9c48-97fffd9b2f69 service glance] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:33.810423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbf2dc-d68d-46ad-9c48-97fffd9b2f69 service glance] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:33.810699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbf2dc-d68d-46ad-9c48-97fffd9b2f69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:33.812266 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c1cbf2dc-d68d-46ad-9c48-97fffd9b2f69 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:33.889239 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:33.932086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbf2dc-d68d-46ad-9c48-97fffd9b2f69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:18:33.933551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbf2dc-d68d-46ad-9c48-97fffd9b2f69 service glance] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:18:33.951767 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 690/1396] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:18:34.207824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4695ba-0dd7-4b32-9bc1-cc99215df99c None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:34.208232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4695ba-0dd7-4b32-9bc1-cc99215df99c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:34.208611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4695ba-0dd7-4b32-9bc1-cc99215df99c None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:34.210089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 707/1397] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:34.216334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580851e3-0ae3-4a1b-b7c6-b23b1bf2083a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:34.216654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580851e3-0ae3-4a1b-b7c6-b23b1bf2083a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:34.216936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580851e3-0ae3-4a1b-b7c6-b23b1bf2083a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:34.285796 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-580851e3-0ae3-4a1b-b7c6-b23b1bf2083a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:34.287012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-580851e3-0ae3-4a1b-b7c6-b23b1bf2083a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:34.392696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 691/1398] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:34.435947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4695ba-0dd7-4b32-9bc1-cc99215df99c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:18:34.437458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dc4695ba-0dd7-4b32-9bc1-cc99215df99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:34.503317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:34.598735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4695ba-0dd7-4b32-9bc1-cc99215df99c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:18:34.686361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72820dcc-90ea-4482-a472-61bb277fa1ae None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:34.686989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72820dcc-90ea-4482-a472-61bb277fa1ae None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:34.686989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72820dcc-90ea-4482-a472-61bb277fa1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:34.713683 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:34.717862 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bafac-8a3f-477e-9309-9695e9019d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:18:34.718473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bafac-8a3f-477e-9309-9695e9019d10 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:34.718750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bafac-8a3f-477e-9309-9695e9019d10 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:34.719022 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bafac-8a3f-477e-9309-9695e9019d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:34.720647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-032bafac-8a3f-477e-9309-9695e9019d10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:34.742811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:34.754671 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-72820dcc-90ea-4482-a472-61bb277fa1ae None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:34.755873 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-72820dcc-90ea-4482-a472-61bb277fa1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:34.816266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bafac-8a3f-477e-9309-9695e9019d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:18:34.818165 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bafac-8a3f-477e-9309-9695e9019d10 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:18:34.836202 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 708/1399] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:18:34.849973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 692/1400] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Aug 11 16:18:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:18:34.899696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f295555-4ace-4a9c-9f9d-29f63eee2503 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:34.899988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f295555-4ace-4a9c-9f9d-29f63eee2503 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:34.900264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f295555-4ace-4a9c-9f9d-29f63eee2503 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:34.901662 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 709/1401] 10.222.0.40 () {54 vars in 943 bytes} [Thu Aug 11 16:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:34.907981 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e135a15-d511-45d1-b12f-74de298f140a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:34.908329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e135a15-d511-45d1-b12f-74de298f140a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:34.908638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e135a15-d511-45d1-b12f-74de298f140a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:34.994805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2e135a15-d511-45d1-b12f-74de298f140a None None] MFA Rules not processed for user `2b629970ca1a4d7fa4c4f2365e671a80`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:34.995938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2e135a15-d511-45d1-b12f-74de298f140a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:35.053187 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:35.107642 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 693/1402] 10.222.0.40 () {58 vars in 1040 bytes} [Thu Aug 11 16:18:34 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:35.117277 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f295555-4ace-4a9c-9f9d-29f63eee2503 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:18:35.118785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9f295555-4ace-4a9c-9f9d-29f63eee2503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:35.257603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f295555-4ace-4a9c-9f9d-29f63eee2503 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:18:35.270318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:35.364007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef20cd3-0c81-48d5-a16c-e9e7d5b1e5d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:18:35.364643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef20cd3-0c81-48d5-a16c-e9e7d5b1e5d0 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:35.364927 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef20cd3-0c81-48d5-a16c-e9e7d5b1e5d0 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:35.365199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef20cd3-0c81-48d5-a16c-e9e7d5b1e5d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:35.366824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-eef20cd3-0c81-48d5-a16c-e9e7d5b1e5d0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:35.450001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef20cd3-0c81-48d5-a16c-e9e7d5b1e5d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:18:35.451597 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef20cd3-0c81-48d5-a16c-e9e7d5b1e5d0 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:18:35.459626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 710/1403] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:18:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:18:36.916402 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be0c73-35b7-4ccb-bfc3-64efe8755e3f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:36.917054 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be0c73-35b7-4ccb-bfc3-64efe8755e3f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:36.917222 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be0c73-35b7-4ccb-bfc3-64efe8755e3f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:36.922764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 694/1404] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:18:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:36.924136 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eaef5-82ca-4742-bd85-1d9701469766 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:36.924631 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eaef5-82ca-4742-bd85-1d9701469766 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:36.924738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eaef5-82ca-4742-bd85-1d9701469766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:37.005327 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:37.022872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a56eaef5-82ca-4742-bd85-1d9701469766 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:37.024127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a56eaef5-82ca-4742-bd85-1d9701469766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:37.131489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 711/1405] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:18:37.180918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be0c73-35b7-4ccb-bfc3-64efe8755e3f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:18:37.182630 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-30be0c73-35b7-4ccb-bfc3-64efe8755e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:37.345658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be0c73-35b7-4ccb-bfc3-64efe8755e3f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:18:37.376543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:37.477857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa98d2-3e2c-4592-8fcc-09798e374cb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:18:37.478467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa98d2-3e2c-4592-8fcc-09798e374cb9 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:37.478747 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa98d2-3e2c-4592-8fcc-09798e374cb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:37.479020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa98d2-3e2c-4592-8fcc-09798e374cb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:37.480650 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6daa98d2-3e2c-4592-8fcc-09798e374cb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:37.578832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa98d2-3e2c-4592-8fcc-09798e374cb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:18:37.580609 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa98d2-3e2c-4592-8fcc-09798e374cb9 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:18:37.603050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 695/1406] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:18:39.649731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c8f15-1a66-4c08-9bcc-72533a733c93 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:39.650261 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c8f15-1a66-4c08-9bcc-72533a733c93 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:39.650261 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c8f15-1a66-4c08-9bcc-72533a733c93 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:39.651620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 712/1407] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:18:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:39.656951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef42a8-ab15-4073-a68f-912c3c38c508 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:39.657349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef42a8-ab15-4073-a68f-912c3c38c508 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:39.657516 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef42a8-ab15-4073-a68f-912c3c38c508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:39.704376 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:39.732941 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-60ef42a8-ab15-4073-a68f-912c3c38c508 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:39.734175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-60ef42a8-ab15-4073-a68f-912c3c38c508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:39.844612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 696/1408] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:18:39.889030 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c8f15-1a66-4c08-9bcc-72533a733c93 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:18:39.890551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1e7c8f15-1a66-4c08-9bcc-72533a733c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:40.023249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:40.054208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c8f15-1a66-4c08-9bcc-72533a733c93 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:18:40.189872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3688fe2-fb21-4ca3-93fd-eb2cbcbdcaa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:18:40.190501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3688fe2-fb21-4ca3-93fd-eb2cbcbdcaa9 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:40.190774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3688fe2-fb21-4ca3-93fd-eb2cbcbdcaa9 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:40.191039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3688fe2-fb21-4ca3-93fd-eb2cbcbdcaa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:40.192637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b3688fe2-fb21-4ca3-93fd-eb2cbcbdcaa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:40.285272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:40.296615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3688fe2-fb21-4ca3-93fd-eb2cbcbdcaa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:18:40.298841 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3688fe2-fb21-4ca3-93fd-eb2cbcbdcaa9 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:18:40.318917 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 713/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:18:49.842665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=51 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:50.316405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=8 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:57.714070 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008dcda-2a04-4019-86fc-f6bb74fca363 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:57.714645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008dcda-2a04-4019-86fc-f6bb74fca363 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:57.714645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008dcda-2a04-4019-86fc-f6bb74fca363 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:57.715930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 697/1410] 10.222.0.40 () {54 vars in 918 bytes} [Thu Aug 11 16:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:57.721039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368882b9-e323-4a81-8578-6ee867cec05c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:57.721491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368882b9-e323-4a81-8578-6ee867cec05c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:57.721601 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368882b9-e323-4a81-8578-6ee867cec05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:57.801415 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-368882b9-e323-4a81-8578-6ee867cec05c None None] MFA Rules not processed for user `64e1c7e6ee814b47912760cf7daf54c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:57.802589 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-368882b9-e323-4a81-8578-6ee867cec05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:57.905480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 714/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Aug 11 16:18:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:18:57.921286 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f5173-1a0c-42eb-93a9-16f06bd46301 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:57.921564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f5173-1a0c-42eb-93a9-16f06bd46301 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:57.921836 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f5173-1a0c-42eb-93a9-16f06bd46301 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:57.923155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 698/1412] 10.222.0.40 () {54 vars in 918 bytes} [Thu Aug 11 16:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:18:57.927967 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dfc34-19e9-442a-87a0-0a3a6aab88b9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:18:57.928256 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dfc34-19e9-442a-87a0-0a3a6aab88b9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:18:57.928558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dfc34-19e9-442a-87a0-0a3a6aab88b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:18:58.000959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:18:58.004281 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9e4dfc34-19e9-442a-87a0-0a3a6aab88b9 None None] MFA Rules not processed for user `4e91f3fbe098459dba0acf8ec1fb7098`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:18:58.005987 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9e4dfc34-19e9-442a-87a0-0a3a6aab88b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:18:58.123611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 715/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Aug 11 16:18:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:00.577675 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def38845-305f-472c-8501-26b2e0174280 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:00.578180 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def38845-305f-472c-8501-26b2e0174280 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:00.578180 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def38845-305f-472c-8501-26b2e0174280 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:00.579517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 16:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:00.584756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b8011-5f9e-49b7-997a-9b35d35a9276 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:00.585184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b8011-5f9e-49b7-997a-9b35d35a9276 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:00.585314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b8011-5f9e-49b7-997a-9b35d35a9276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:00.649186 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ef8b8011-5f9e-49b7-997a-9b35d35a9276 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:00.650370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ef8b8011-5f9e-49b7-997a-9b35d35a9276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:00.705083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:00.746981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 16:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:00.789716 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def38845-305f-472c-8501-26b2e0174280 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:00.791215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-def38845-305f-472c-8501-26b2e0174280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:00.935786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def38845-305f-472c-8501-26b2e0174280 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:01.007959 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:01.050920 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b1200-faf6-4a71-afaa-9fb979e95491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:01.051515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b1200-faf6-4a71-afaa-9fb979e95491 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:01.051789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b1200-faf6-4a71-afaa-9fb979e95491 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:01.052055 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b1200-faf6-4a71-afaa-9fb979e95491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:01.053807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7b2b1200-faf6-4a71-afaa-9fb979e95491 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:01.141101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b1200-faf6-4a71-afaa-9fb979e95491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:01.142697 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b1200-faf6-4a71-afaa-9fb979e95491 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:01.160818 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 700/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:02.050168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4ed6d-d6ff-475d-bc56-7181c143bead None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:02.050755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4ed6d-d6ff-475d-bc56-7181c143bead None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:02.050755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4ed6d-d6ff-475d-bc56-7181c143bead None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:02.052050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 16:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:02.057562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1095f2-9c7b-4cde-981d-d426bb9d0659 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:02.057986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1095f2-9c7b-4cde-981d-d426bb9d0659 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:02.058091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1095f2-9c7b-4cde-981d-d426bb9d0659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:02.135255 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1d1095f2-9c7b-4cde-981d-d426bb9d0659 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:02.136461 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1d1095f2-9c7b-4cde-981d-d426bb9d0659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:02.162786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:02.236115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 16:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:02.387346 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4ed6d-d6ff-475d-bc56-7181c143bead None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:02.388908 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4aa4ed6d-d6ff-475d-bc56-7181c143bead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:02.537639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4ed6d-d6ff-475d-bc56-7181c143bead None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:02.577515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:02.651214 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43e4e1-6aa1-43e5-8ed7-8f4ed11f6243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:02.651751 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43e4e1-6aa1-43e5-8ed7-8f4ed11f6243 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:02.652031 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43e4e1-6aa1-43e5-8ed7-8f4ed11f6243 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:02.652301 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43e4e1-6aa1-43e5-8ed7-8f4ed11f6243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:02.653917 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bd43e4e1-6aa1-43e5-8ed7-8f4ed11f6243 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:02.740778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43e4e1-6aa1-43e5-8ed7-8f4ed11f6243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:02.742396 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43e4e1-6aa1-43e5-8ed7-8f4ed11f6243 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:02.761961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 718/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:03.647157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d04c6-f671-4eac-b8fd-827d2dbd4bc1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:03.647724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d04c6-f671-4eac-b8fd-827d2dbd4bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:03.647724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d04c6-f671-4eac-b8fd-827d2dbd4bc1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:03.649623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 16:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:03.654394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109e6b7-8337-4ff8-bae3-785f36195efc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:03.654833 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109e6b7-8337-4ff8-bae3-785f36195efc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:03.654944 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109e6b7-8337-4ff8-bae3-785f36195efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:03.707493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:03.730111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3109e6b7-8337-4ff8-bae3-785f36195efc None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:03.731228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3109e6b7-8337-4ff8-bae3-785f36195efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:03.824995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 16:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:03.977341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d04c6-f671-4eac-b8fd-827d2dbd4bc1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:03.978839 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-151d04c6-f671-4eac-b8fd-827d2dbd4bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:04.126088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d04c6-f671-4eac-b8fd-827d2dbd4bc1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:04.138608 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:04.237234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e94bca-7196-4115-9d5b-f7c98f94ec03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:04.237832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e94bca-7196-4115-9d5b-f7c98f94ec03 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:04.238109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e94bca-7196-4115-9d5b-f7c98f94ec03 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:04.238382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e94bca-7196-4115-9d5b-f7c98f94ec03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:04.239960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-07e94bca-7196-4115-9d5b-f7c98f94ec03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:04.330258 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e94bca-7196-4115-9d5b-f7c98f94ec03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:04.331847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e94bca-7196-4115-9d5b-f7c98f94ec03 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:04.349363 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 703/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:05.217358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a74db-4e75-432b-abd2-eb96fd157d25 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:05.217904 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a74db-4e75-432b-abd2-eb96fd157d25 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:05.217904 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a74db-4e75-432b-abd2-eb96fd157d25 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:05.219236 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 16:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:19:05.224113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f00a8c-49bd-4f98-9cc1-f5ff1064fd76 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:05.224519 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f00a8c-49bd-4f98-9cc1-f5ff1064fd76 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:05.224690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f00a8c-49bd-4f98-9cc1-f5ff1064fd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:05.245220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:05.300869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d5f00a8c-49bd-4f98-9cc1-f5ff1064fd76 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:05.302063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d5f00a8c-49bd-4f98-9cc1-f5ff1064fd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:05.396716 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 16:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:05.547490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a74db-4e75-432b-abd2-eb96fd157d25 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:05.549052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9c0a74db-4e75-432b-abd2-eb96fd157d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:05.658614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:05.694196 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a74db-4e75-432b-abd2-eb96fd157d25 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:05.802404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9a4f3-ce51-43d4-b6f2-065110e4374c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:05.802927 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9a4f3-ce51-43d4-b6f2-065110e4374c service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:05.803204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9a4f3-ce51-43d4-b6f2-065110e4374c service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:05.803469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9a4f3-ce51-43d4-b6f2-065110e4374c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:05.805595 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-33d9a4f3-ce51-43d4-b6f2-065110e4374c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:05.879655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:05.893222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9a4f3-ce51-43d4-b6f2-065110e4374c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:05.894813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9a4f3-ce51-43d4-b6f2-065110e4374c service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:05.912548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 721/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:06.764340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e082ec-7e16-46d7-ae93-8ef67140075d None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:06.764928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e082ec-7e16-46d7-ae93-8ef67140075d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:06.764928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e082ec-7e16-46d7-ae93-8ef67140075d None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:06.766172 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 16:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:06.770962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f30a1-67d0-4b9f-9adf-14f91a143e80 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:06.771348 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f30a1-67d0-4b9f-9adf-14f91a143e80 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:06.771547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f30a1-67d0-4b9f-9adf-14f91a143e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:06.846369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e34f30a1-67d0-4b9f-9adf-14f91a143e80 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:06.847570 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e34f30a1-67d0-4b9f-9adf-14f91a143e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:06.945653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 16:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:07.094675 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e082ec-7e16-46d7-ae93-8ef67140075d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:07.096329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-99e082ec-7e16-46d7-ae93-8ef67140075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:07.183520 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:07.246449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e082ec-7e16-46d7-ae93-8ef67140075d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:07.356677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff77511-462d-4c04-abfc-1051f67b2d94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:07.357205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff77511-462d-4c04-abfc-1051f67b2d94 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:07.357483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff77511-462d-4c04-abfc-1051f67b2d94 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:07.357751 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff77511-462d-4c04-abfc-1051f67b2d94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:07.359335 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cff77511-462d-4c04-abfc-1051f67b2d94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:07.406233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:07.447604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff77511-462d-4c04-abfc-1051f67b2d94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:07.449235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff77511-462d-4c04-abfc-1051f67b2d94 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:07.467024 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 706/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:08.284007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebb751-1368-4197-8276-e1e0592c0d05 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:08.284612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebb751-1368-4197-8276-e1e0592c0d05 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:08.284737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebb751-1368-4197-8276-e1e0592c0d05 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:08.286210 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 16:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:08.292025 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3379c-3d7d-40e2-8fdc-7a38db644fa2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:08.292488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3379c-3d7d-40e2-8fdc-7a38db644fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:08.292607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3379c-3d7d-40e2-8fdc-7a38db644fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:08.365732 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-87d3379c-3d7d-40e2-8fdc-7a38db644fa2 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:08.367450 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-87d3379c-3d7d-40e2-8fdc-7a38db644fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:08.461325 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 16:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:08.611455 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebb751-1368-4197-8276-e1e0592c0d05 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:08.613005 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-88ebb751-1368-4197-8276-e1e0592c0d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:08.661780 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:08.759550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebb751-1368-4197-8276-e1e0592c0d05 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:08.870724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4524875-04b2-4477-aa95-0d4ce4161f1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:08.871244 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4524875-04b2-4477-aa95-0d4ce4161f1c service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:08.871521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4524875-04b2-4477-aa95-0d4ce4161f1c service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:08.871789 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4524875-04b2-4477-aa95-0d4ce4161f1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:08.873393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b4524875-04b2-4477-aa95-0d4ce4161f1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:08.880085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:08.960066 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4524875-04b2-4477-aa95-0d4ce4161f1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:08.961700 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4524875-04b2-4477-aa95-0d4ce4161f1c service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:08.979936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 724/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:09.771688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0c571-a95f-4724-a4c7-160cb38b26db None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:09.772215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0c571-a95f-4724-a4c7-160cb38b26db None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:09.772215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0c571-a95f-4724-a4c7-160cb38b26db None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:09.773550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 16:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:09.778565 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89a8dd-5cb8-4555-b0f2-7da095374602 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:09.778994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89a8dd-5cb8-4555-b0f2-7da095374602 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:09.779108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89a8dd-5cb8-4555-b0f2-7da095374602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:09.855526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8e89a8dd-5cb8-4555-b0f2-7da095374602 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:09.856766 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8e89a8dd-5cb8-4555-b0f2-7da095374602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:10.043457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:10.071591 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 16:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:10.221600 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0c571-a95f-4724-a4c7-160cb38b26db None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:10.223137 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-51b0c571-a95f-4724-a4c7-160cb38b26db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:10.241166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:10.369010 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0c571-a95f-4724-a4c7-160cb38b26db None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:10.456794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:10.483307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767e959-46a8-45cb-89e5-ae05ea9a9839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:10.483911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767e959-46a8-45cb-89e5-ae05ea9a9839 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:10.484188 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767e959-46a8-45cb-89e5-ae05ea9a9839 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:10.484463 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767e959-46a8-45cb-89e5-ae05ea9a9839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:10.486089 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0767e959-46a8-45cb-89e5-ae05ea9a9839 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:10.575835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767e959-46a8-45cb-89e5-ae05ea9a9839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:10.577581 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767e959-46a8-45cb-89e5-ae05ea9a9839 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:10.596490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 709/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:11.398902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa55524-d466-4db7-8037-f7b4c168ce94 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:11.399478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa55524-d466-4db7-8037-f7b4c168ce94 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:11.399478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa55524-d466-4db7-8037-f7b4c168ce94 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:11.400820 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 16:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:11.405731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3c278-d06d-442c-8b4f-037fb1f341e1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:11.406123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3c278-d06d-442c-8b4f-037fb1f341e1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:11.406277 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3c278-d06d-442c-8b4f-037fb1f341e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:11.481648 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f0f3c278-d06d-442c-8b4f-037fb1f341e1 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:11.482842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f0f3c278-d06d-442c-8b4f-037fb1f341e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:11.533256 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:11.590959 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 16:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:11.742282 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa55524-d466-4db7-8037-f7b4c168ce94 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:11.743788 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-caa55524-d466-4db7-8037-f7b4c168ce94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:11.887727 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa55524-d466-4db7-8037-f7b4c168ce94 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:11.940972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:11.998939 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89713a7e-7940-4b9b-b466-0f8da7a9fa04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:11.999474 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89713a7e-7940-4b9b-b466-0f8da7a9fa04 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:11.999750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89713a7e-7940-4b9b-b466-0f8da7a9fa04 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:12.000016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89713a7e-7940-4b9b-b466-0f8da7a9fa04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:12.001651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-89713a7e-7940-4b9b-b466-0f8da7a9fa04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:12.089436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89713a7e-7940-4b9b-b466-0f8da7a9fa04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:12.091034 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89713a7e-7940-4b9b-b466-0f8da7a9fa04 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:12.108499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 727/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:12.908788 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d6e1f-5803-4dc4-82bf-dcdbc13d8e00 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:12.909387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d6e1f-5803-4dc4-82bf-dcdbc13d8e00 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:12.909387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d6e1f-5803-4dc4-82bf-dcdbc13d8e00 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:12.910660 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 16:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:12.916370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d445d25-efee-4cd7-a377-8a7a1499fc6e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:12.916829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d445d25-efee-4cd7-a377-8a7a1499fc6e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:12.916924 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d445d25-efee-4cd7-a377-8a7a1499fc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:12.992813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4d445d25-efee-4cd7-a377-8a7a1499fc6e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:12.994033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4d445d25-efee-4cd7-a377-8a7a1499fc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:12.996019 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:13.088125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 16:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:13.242388 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d6e1f-5803-4dc4-82bf-dcdbc13d8e00 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:13.243812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ea6d6e1f-5803-4dc4-82bf-dcdbc13d8e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:13.388950 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d6e1f-5803-4dc4-82bf-dcdbc13d8e00 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:13.415159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:13.507063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f18f32-a83d-4018-8cde-ab8ee5d6697d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:13.508104 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f18f32-a83d-4018-8cde-ab8ee5d6697d service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:13.508378 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f18f32-a83d-4018-8cde-ab8ee5d6697d service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:13.508686 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f18f32-a83d-4018-8cde-ab8ee5d6697d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:13.510487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-61f18f32-a83d-4018-8cde-ab8ee5d6697d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:13.597809 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f18f32-a83d-4018-8cde-ab8ee5d6697d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:13.599391 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f18f32-a83d-4018-8cde-ab8ee5d6697d service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:13.617115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 712/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:15.511695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324edca-87c8-4197-b0de-2d11448f76c1 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:15.512162 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324edca-87c8-4197-b0de-2d11448f76c1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:15.512288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324edca-87c8-4197-b0de-2d11448f76c1 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:15.513631 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 16:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:15.518697 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c048b-9d21-4839-87b3-b5da9fd67f30 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:15.519116 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c048b-9d21-4839-87b3-b5da9fd67f30 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:15.519249 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c048b-9d21-4839-87b3-b5da9fd67f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:15.560578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:15.585861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-762c048b-9d21-4839-87b3-b5da9fd67f30 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:15.586987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-762c048b-9d21-4839-87b3-b5da9fd67f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:15.681796 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 16:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:15.720088 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324edca-87c8-4197-b0de-2d11448f76c1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:15.721611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3324edca-87c8-4197-b0de-2d11448f76c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:15.822334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324edca-87c8-4197-b0de-2d11448f76c1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:15.853378 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:15.892970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd271889-170f-49ae-965d-8022dbd0a6c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:15.893558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd271889-170f-49ae-965d-8022dbd0a6c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:15.893828 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd271889-170f-49ae-965d-8022dbd0a6c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:15.894093 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd271889-170f-49ae-965d-8022dbd0a6c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:15.895650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dd271889-170f-49ae-965d-8022dbd0a6c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:16.000339 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd271889-170f-49ae-965d-8022dbd0a6c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:16.001799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd271889-170f-49ae-965d-8022dbd0a6c6 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:16.018955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 730/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:19:18.169080 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdca87-3a11-4397-bdb8-aaeb7b38b70f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:18.169654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdca87-3a11-4397-bdb8-aaeb7b38b70f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:18.169654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdca87-3a11-4397-bdb8-aaeb7b38b70f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:18.170974 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 16:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:18.177172 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95680-0219-4a8c-9ae1-7b6ae8b965f0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:18.177172 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95680-0219-4a8c-9ae1-7b6ae8b965f0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:18.177172 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95680-0219-4a8c-9ae1-7b6ae8b965f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:18.249713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6ae95680-0219-4a8c-9ae1-7b6ae8b965f0 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:18.250901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6ae95680-0219-4a8c-9ae1-7b6ae8b965f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:18.263158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:18.345753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 16:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:18.383418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdca87-3a11-4397-bdb8-aaeb7b38b70f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:18.384978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-39bdca87-3a11-4397-bdb8-aaeb7b38b70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:18.489874 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdca87-3a11-4397-bdb8-aaeb7b38b70f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:18.501776 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:18.570271 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e0c31-49f2-4911-9e70-13262f1736eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:18.570867 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e0c31-49f2-4911-9e70-13262f1736eb service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:18.571144 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e0c31-49f2-4911-9e70-13262f1736eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:18.571415 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e0c31-49f2-4911-9e70-13262f1736eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:18.573037 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-209e0c31-49f2-4911-9e70-13262f1736eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:18.800537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e0c31-49f2-4911-9e70-13262f1736eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:18.801919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e0c31-49f2-4911-9e70-13262f1736eb service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:18.820321 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 715/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:21.197038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1329-0fdf-45e0-9148-8d1ba984f8db None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:21.197625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1329-0fdf-45e0-9148-8d1ba984f8db None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:21.197625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1329-0fdf-45e0-9148-8d1ba984f8db None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:21.198911 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 16:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:19:21.204197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c067e-729d-4c8a-8cac-52e24d3a7ff8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:21.204663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c067e-729d-4c8a-8cac-52e24d3a7ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:21.204760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c067e-729d-4c8a-8cac-52e24d3a7ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:21.251625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:21.269032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fb2c067e-729d-4c8a-8cac-52e24d3a7ff8 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:21.270230 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fb2c067e-729d-4c8a-8cac-52e24d3a7ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:21.364607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 16:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:21.403512 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e1329-0fdf-45e0-9148-8d1ba984f8db None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:21.405091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7d2e1329-0fdf-45e0-9148-8d1ba984f8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:21.506273 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e1329-0fdf-45e0-9148-8d1ba984f8db None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:21.551797 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:21.585734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef816012-396c-4674-8dfb-35424b3c8e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:21.586331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef816012-396c-4674-8dfb-35424b3c8e7a service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:21.586605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef816012-396c-4674-8dfb-35424b3c8e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:21.586873 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef816012-396c-4674-8dfb-35424b3c8e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:21.588461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ef816012-396c-4674-8dfb-35424b3c8e7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:21.692424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef816012-396c-4674-8dfb-35424b3c8e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:21.693942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef816012-396c-4674-8dfb-35424b3c8e7a service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:21.712421 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 733/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:19:23.828974 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42429a-dc98-4509-806b-ed70f68993fc None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:23.829520 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42429a-dc98-4509-806b-ed70f68993fc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:23.829520 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42429a-dc98-4509-806b-ed70f68993fc None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:23.830867 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 16:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:23.836537 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07a1b9-96af-4bee-9e05-59961d4778b4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:23.836985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07a1b9-96af-4bee-9e05-59961d4778b4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:23.837100 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07a1b9-96af-4bee-9e05-59961d4778b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:23.901154 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8a07a1b9-96af-4bee-9e05-59961d4778b4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:23.902356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8a07a1b9-96af-4bee-9e05-59961d4778b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:23.922157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:23.996219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 16:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:24.036103 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42429a-dc98-4509-806b-ed70f68993fc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:24.037883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6d42429a-dc98-4509-806b-ed70f68993fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:24.139163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42429a-dc98-4509-806b-ed70f68993fc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:24.159154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:24.212173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9f250-7f35-43a1-85ac-3b74b2d8830c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:24.212795 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9f250-7f35-43a1-85ac-3b74b2d8830c service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:24.213070 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9f250-7f35-43a1-85ac-3b74b2d8830c service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:24.213338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9f250-7f35-43a1-85ac-3b74b2d8830c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:24.214905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-eeb9f250-7f35-43a1-85ac-3b74b2d8830c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:24.322169 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9f250-7f35-43a1-85ac-3b74b2d8830c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:24.323590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9f250-7f35-43a1-85ac-3b74b2d8830c service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:24.341695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 718/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:26.457579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61076dca-e89c-4f8f-824f-ad47efcf448e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:26.458162 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61076dca-e89c-4f8f-824f-ad47efcf448e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:26.458162 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61076dca-e89c-4f8f-824f-ad47efcf448e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:26.459457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 16:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:26.465252 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa78e3b-7d88-48af-947c-fa5a3f076a16 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:26.465669 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa78e3b-7d88-48af-947c-fa5a3f076a16 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:26.465832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa78e3b-7d88-48af-947c-fa5a3f076a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:26.530783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:26.533437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-bfa78e3b-7d88-48af-947c-fa5a3f076a16 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:26.535207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bfa78e3b-7d88-48af-947c-fa5a3f076a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:26.640958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 16:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:26.679500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61076dca-e89c-4f8f-824f-ad47efcf448e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:26.681104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-61076dca-e89c-4f8f-824f-ad47efcf448e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:26.783822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61076dca-e89c-4f8f-824f-ad47efcf448e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:26.832473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:26.857276 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e248cb-8fc9-4a71-98ee-6942fb4ec7fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:26.857871 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e248cb-8fc9-4a71-98ee-6942fb4ec7fb service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:26.858201 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e248cb-8fc9-4a71-98ee-6942fb4ec7fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:26.858474 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e248cb-8fc9-4a71-98ee-6942fb4ec7fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:26.860054 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-33e248cb-8fc9-4a71-98ee-6942fb4ec7fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:26.970083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e248cb-8fc9-4a71-98ee-6942fb4ec7fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:26.971519 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e248cb-8fc9-4a71-98ee-6942fb4ec7fb service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:26.989108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 736/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:29.077663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c76e6-7c3c-42af-a8ca-602fac8f1169 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:29.078283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c76e6-7c3c-42af-a8ca-602fac8f1169 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:29.078283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c76e6-7c3c-42af-a8ca-602fac8f1169 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:29.079709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 16:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:29.085003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd3a0f-46a2-40ea-850c-53c8ab4c679c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:29.085423 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd3a0f-46a2-40ea-850c-53c8ab4c679c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:29.085536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd3a0f-46a2-40ea-850c-53c8ab4c679c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:29.151767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-11dd3a0f-46a2-40ea-850c-53c8ab4c679c None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:29.153005 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-11dd3a0f-46a2-40ea-850c-53c8ab4c679c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:29.183557 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:29.254571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 16:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:29.294358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c76e6-7c3c-42af-a8ca-602fac8f1169 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:29.295913 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a42c76e6-7c3c-42af-a8ca-602fac8f1169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:29.396762 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c76e6-7c3c-42af-a8ca-602fac8f1169 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:29.425122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:29.471077 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663f29d-a478-42fd-8493-1f5959c15918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:29.471677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663f29d-a478-42fd-8493-1f5959c15918 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:29.471960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663f29d-a478-42fd-8493-1f5959c15918 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:29.472222 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663f29d-a478-42fd-8493-1f5959c15918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:29.473833 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7663f29d-a478-42fd-8493-1f5959c15918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:29.580770 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663f29d-a478-42fd-8493-1f5959c15918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:29.582185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663f29d-a478-42fd-8493-1f5959c15918 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:29.601455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 721/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:31.640205 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2c397-4464-4581-ae7a-9e299a23809a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:31.640767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2c397-4464-4581-ae7a-9e299a23809a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:31.640767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2c397-4464-4581-ae7a-9e299a23809a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:31.642128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 16:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:31.647998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f942a-b9b9-407a-b368-a7d0240c3bc3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:31.648426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f942a-b9b9-407a-b368-a7d0240c3bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:31.648538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f942a-b9b9-407a-b368-a7d0240c3bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:31.717038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3f5f942a-b9b9-407a-b368-a7d0240c3bc3 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:31.718261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3f5f942a-b9b9-407a-b368-a7d0240c3bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:31.726520 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:31.814194 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 16:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:31.853211 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2c397-4464-4581-ae7a-9e299a23809a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:31.854740 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4de2c397-4464-4581-ae7a-9e299a23809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:31.956832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2c397-4464-4581-ae7a-9e299a23809a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:32.010792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:32.028244 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56461a2e-4561-459b-a17a-1bcbe31ed9cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:32.028857 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56461a2e-4561-459b-a17a-1bcbe31ed9cf service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:32.029129 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56461a2e-4561-459b-a17a-1bcbe31ed9cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:32.029393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56461a2e-4561-459b-a17a-1bcbe31ed9cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:32.030947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-56461a2e-4561-459b-a17a-1bcbe31ed9cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:32.138258 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56461a2e-4561-459b-a17a-1bcbe31ed9cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:32.139695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56461a2e-4561-459b-a17a-1bcbe31ed9cf service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:32.157361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 739/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:34.195463 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ea95d-64ce-48ca-a184-4f888b75df96 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:34.195999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ea95d-64ce-48ca-a184-4f888b75df96 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:34.195999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ea95d-64ce-48ca-a184-4f888b75df96 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:34.197369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 16:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:34.202593 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491be51d-e9f2-48a1-b139-bdb1a04a3593 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:34.202998 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491be51d-e9f2-48a1-b139-bdb1a04a3593 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:34.203134 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491be51d-e9f2-48a1-b139-bdb1a04a3593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:34.274680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-491be51d-e9f2-48a1-b139-bdb1a04a3593 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:34.275888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-491be51d-e9f2-48a1-b139-bdb1a04a3593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:34.314505 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:34.371980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 16:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:34.409913 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ea95d-64ce-48ca-a184-4f888b75df96 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:34.411428 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cd4ea95d-64ce-48ca-a184-4f888b75df96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:34.517095 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ea95d-64ce-48ca-a184-4f888b75df96 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:34.556459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:34.594854 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b5133-fc31-4fd7-99a9-b021ccdb57ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:34.595452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5133-fc31-4fd7-99a9-b021ccdb57ca service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:34.595727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5133-fc31-4fd7-99a9-b021ccdb57ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:34.595993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5133-fc31-4fd7-99a9-b021ccdb57ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:34.597613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f43b5133-fc31-4fd7-99a9-b021ccdb57ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:34.705038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b5133-fc31-4fd7-99a9-b021ccdb57ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:34.706453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b5133-fc31-4fd7-99a9-b021ccdb57ca service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:34.724518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 724/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:36.723216 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a44b76-089c-462c-a0e4-62231d2ddfc8 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:36.723773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a44b76-089c-462c-a0e4-62231d2ddfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:36.723773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a44b76-089c-462c-a0e4-62231d2ddfc8 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:36.725199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 16:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:36.730300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf34aa6-7da0-4f13-b709-2ab457bf630b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:36.730756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf34aa6-7da0-4f13-b709-2ab457bf630b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:36.730864 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf34aa6-7da0-4f13-b709-2ab457bf630b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:36.795657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fdf34aa6-7da0-4f13-b709-2ab457bf630b None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:36.796874 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fdf34aa6-7da0-4f13-b709-2ab457bf630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:36.814489 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:36.893130 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 16:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:36.929796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a44b76-089c-462c-a0e4-62231d2ddfc8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:36.931318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-73a44b76-089c-462c-a0e4-62231d2ddfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:37.038266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a44b76-089c-462c-a0e4-62231d2ddfc8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:37.109321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:37.117428 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bface7-1975-476b-a60d-b1d3907db177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:37.118038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bface7-1975-476b-a60d-b1d3907db177 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:37.118317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bface7-1975-476b-a60d-b1d3907db177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:37.118588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bface7-1975-476b-a60d-b1d3907db177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:37.120182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-32bface7-1975-476b-a60d-b1d3907db177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:37.232526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bface7-1975-476b-a60d-b1d3907db177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:37.234139 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bface7-1975-476b-a60d-b1d3907db177 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:37.255258 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 742/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:19:39.287154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee16cc2-199f-425a-adfd-f49430ad78bc None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:39.288039 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee16cc2-199f-425a-adfd-f49430ad78bc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:39.288039 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee16cc2-199f-425a-adfd-f49430ad78bc None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:39.289321 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 16:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:39.294565 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791e42e-3fa2-4219-ad7c-e57858a06b1d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:39.295015 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791e42e-3fa2-4219-ad7c-e57858a06b1d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:39.295122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791e42e-3fa2-4219-ad7c-e57858a06b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:39.359251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c791e42e-3fa2-4219-ad7c-e57858a06b1d None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:39.360434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c791e42e-3fa2-4219-ad7c-e57858a06b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:39.408160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:39.455714 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 16:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:39.493912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee16cc2-199f-425a-adfd-f49430ad78bc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:39.495419 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1ee16cc2-199f-425a-adfd-f49430ad78bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:39.597452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee16cc2-199f-425a-adfd-f49430ad78bc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:39.643027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:39.670054 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e57713-4df7-4d21-9ce1-ecaf9f5ed5aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:39.670624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e57713-4df7-4d21-9ce1-ecaf9f5ed5aa service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:39.670895 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e57713-4df7-4d21-9ce1-ecaf9f5ed5aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:39.671160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e57713-4df7-4d21-9ce1-ecaf9f5ed5aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:39.672748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f5e57713-4df7-4d21-9ce1-ecaf9f5ed5aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:39.778283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e57713-4df7-4d21-9ce1-ecaf9f5ed5aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:39.779688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e57713-4df7-4d21-9ce1-ecaf9f5ed5aa service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:39.797710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 727/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:19:49.453800 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=22 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:49.795533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=66 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:59.165776 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82514c-2cad-4a20-88ea-35cfebc9a513 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:59.166316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82514c-2cad-4a20-88ea-35cfebc9a513 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:59.166316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82514c-2cad-4a20-88ea-35cfebc9a513 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:59.167710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 744/1471] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:59.173853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e126f34-ce4d-4e30-b326-a372eb843a13 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:59.174319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e126f34-ce4d-4e30-b326-a372eb843a13 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:59.174457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e126f34-ce4d-4e30-b326-a372eb843a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:59.239856 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8e126f34-ce4d-4e30-b326-a372eb843a13 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:59.241082 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8e126f34-ce4d-4e30-b326-a372eb843a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:59.335654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 728/1472] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:59.418006 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8135f-8014-43b3-b6ec-0a758f065fea None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:59.418291 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8135f-8014-43b3-b6ec-0a758f065fea None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:59.418567 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8135f-8014-43b3-b6ec-0a758f065fea None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:59.419897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 745/1473] 10.222.0.40 () {54 vars in 967 bytes} [Thu Aug 11 16:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:19:59.424911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeeba0-048e-4c40-81ed-a7aa58923984 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:59.425195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeeba0-048e-4c40-81ed-a7aa58923984 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:59.425465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeeba0-048e-4c40-81ed-a7aa58923984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:59.500794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8aaeeba0-048e-4c40-81ed-a7aa58923984 None None] MFA Rules not processed for user `2c9158ce9d8a4aadbf86405657958c48`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:19:59.501978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8aaeeba0-048e-4c40-81ed-a7aa58923984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:59.522462 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:59.578366 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 729/1474] 10.222.0.40 () {58 vars in 1064 bytes} [Thu Aug 11 16:19:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:19:59.585844 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8135f-8014-43b3-b6ec-0a758f065fea None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:19:59.587357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5cc8135f-8014-43b3-b6ec-0a758f065fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:59.688259 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8135f-8014-43b3-b6ec-0a758f065fea None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:19:59.764896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d28c48-273b-4c71-b63d-4e0c04c3a8fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9158ce9d8a4aadbf86405657958c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:19:59.765497 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d28c48-273b-4c71-b63d-4e0c04c3a8fc service glance] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:19:59.765775 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d28c48-273b-4c71-b63d-4e0c04c3a8fc service glance] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:19:59.766043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d28c48-273b-4c71-b63d-4e0c04c3a8fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:19:59.767621 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-48d28c48-273b-4c71-b63d-4e0c04c3a8fc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:19:59.820525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:19:59.874524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d28c48-273b-4c71-b63d-4e0c04c3a8fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:19:59.875962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d28c48-273b-4c71-b63d-4e0c04c3a8fc service glance] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:19:59.894921 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 746/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:20:01.956572 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641eacf-43f2-4149-946a-60bb05bcfb69 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:01.957150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641eacf-43f2-4149-946a-60bb05bcfb69 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:01.957150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641eacf-43f2-4149-946a-60bb05bcfb69 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:01.958521 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 730/1476] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:20:01.963776 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13614634-4f13-4208-ad8f-90d5cc5ba605 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:01.964221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13614634-4f13-4208-ad8f-90d5cc5ba605 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:01.964326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13614634-4f13-4208-ad8f-90d5cc5ba605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:02.029080 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-13614634-4f13-4208-ad8f-90d5cc5ba605 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:20:02.030278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-13614634-4f13-4208-ad8f-90d5cc5ba605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:02.127654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 747/1477] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:20:02.149750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641eacf-43f2-4149-946a-60bb05bcfb69 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:20:02.151260 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0641eacf-43f2-4149-946a-60bb05bcfb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:02.273540 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641eacf-43f2-4149-946a-60bb05bcfb69 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:20:02.321809 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:20:02.368778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473541c7-4b36-4fb4-a29e-d98f33da8e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:20:02.369379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473541c7-4b36-4fb4-a29e-d98f33da8e18 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:02.369649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473541c7-4b36-4fb4-a29e-d98f33da8e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:02.369913 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473541c7-4b36-4fb4-a29e-d98f33da8e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:02.370538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473541c7-4b36-4fb4-a29e-d98f33da8e18 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:20:02.372241 dv-cinder-852208-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-473541c7-4b36-4fb4-a29e-d98f33da8e18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:20:02.372241 dv-cinder-852208-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Aug 11 16:20:02.372241 dv-cinder-852208-4-smb devstack@keystone.service[81409]: Aug 11 16:20:02.373414 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473541c7-4b36-4fb4-a29e-d98f33da8e18 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:20:02.391633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 731/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Aug 11 16:20:02 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:20:04.394012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaac64-b7ab-43dd-8740-127613df06df None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:04.394595 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaac64-b7ab-43dd-8740-127613df06df None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:04.394595 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaac64-b7ab-43dd-8740-127613df06df None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:04.396530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 748/1479] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:20:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:20:04.401745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b761694-114b-46ac-a791-1dd903142c5c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:04.402154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b761694-114b-46ac-a791-1dd903142c5c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:04.402295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b761694-114b-46ac-a791-1dd903142c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:04.467320 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2b761694-114b-46ac-a791-1dd903142c5c None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:20:04.468548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2b761694-114b-46ac-a791-1dd903142c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:04.564222 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 732/1480] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:20:04.606901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaac64-b7ab-43dd-8740-127613df06df None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:20:04.608599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1ccaac64-b7ab-43dd-8740-127613df06df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:04.618310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:20:04.761645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaac64-b7ab-43dd-8740-127613df06df None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:20:04.842618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:20:04.874909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96eb5a-8b7b-4e6f-b9e8-8eed11de8316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:20:04.875513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96eb5a-8b7b-4e6f-b9e8-8eed11de8316 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:04.875791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96eb5a-8b7b-4e6f-b9e8-8eed11de8316 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:04.876062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96eb5a-8b7b-4e6f-b9e8-8eed11de8316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:04.877685 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9c96eb5a-8b7b-4e6f-b9e8-8eed11de8316 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:04.965688 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96eb5a-8b7b-4e6f-b9e8-8eed11de8316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:20:04.967276 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96eb5a-8b7b-4e6f-b9e8-8eed11de8316 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:20:04.984800 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 749/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:20:07.167570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd96eb2-3bb5-406a-a69d-66d120e5bada None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:07.168142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd96eb2-3bb5-406a-a69d-66d120e5bada None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:07.168142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd96eb2-3bb5-406a-a69d-66d120e5bada None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:07.169574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 733/1482] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:20:07.175050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009e583-c816-4cc5-9e98-c728f3e9a686 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:07.175446 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009e583-c816-4cc5-9e98-c728f3e9a686 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:07.175589 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009e583-c816-4cc5-9e98-c728f3e9a686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:07.241216 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c009e583-c816-4cc5-9e98-c728f3e9a686 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:20:07.242417 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c009e583-c816-4cc5-9e98-c728f3e9a686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:07.287560 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:20:07.337374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 750/1483] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:20:07.376289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd96eb2-3bb5-406a-a69d-66d120e5bada None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:20:07.377837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1dd96eb2-3bb5-406a-a69d-66d120e5bada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:07.402631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:20:07.481626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd96eb2-3bb5-406a-a69d-66d120e5bada None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:20:07.554551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b42e7f-76fa-4c97-af1c-00cdfcca598a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:20:07.555150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b42e7f-76fa-4c97-af1c-00cdfcca598a service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:07.555427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b42e7f-76fa-4c97-af1c-00cdfcca598a service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:07.555700 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b42e7f-76fa-4c97-af1c-00cdfcca598a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:07.557314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-40b42e7f-76fa-4c97-af1c-00cdfcca598a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:07.629372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:20:07.664001 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b42e7f-76fa-4c97-af1c-00cdfcca598a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:20:07.665469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b42e7f-76fa-4c97-af1c-00cdfcca598a service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:20:07.683460 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 734/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:20:09.704147 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e722-1bc6-4314-9258-46831bf7b35a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:09.704724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e722-1bc6-4314-9258-46831bf7b35a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:09.704724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e722-1bc6-4314-9258-46831bf7b35a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:09.706860 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 751/1485] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:20:09.714294 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba6fdd-863d-480b-a67e-f9e5aaac2282 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:09.714763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba6fdd-863d-480b-a67e-f9e5aaac2282 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:09.714872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba6fdd-863d-480b-a67e-f9e5aaac2282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:09.783067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ffba6fdd-863d-480b-a67e-f9e5aaac2282 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:20:09.784196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ffba6fdd-863d-480b-a67e-f9e5aaac2282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:09.880042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 735/1486] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:20:09.918390 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35e722-1bc6-4314-9258-46831bf7b35a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:20:09.919943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cf35e722-1bc6-4314-9258-46831bf7b35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:10.022379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35e722-1bc6-4314-9258-46831bf7b35a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:20:10.093954 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:20:10.095933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a7cf6-9735-40fc-abc5-ab376ebd67f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:20:10.096625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a7cf6-9735-40fc-abc5-ab376ebd67f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:10.097146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a7cf6-9735-40fc-abc5-ab376ebd67f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:10.097497 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a7cf6-9735-40fc-abc5-ab376ebd67f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:10.100051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fb0a7cf6-9735-40fc-abc5-ab376ebd67f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:10.209086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a7cf6-9735-40fc-abc5-ab376ebd67f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:20:10.210543 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a7cf6-9735-40fc-abc5-ab376ebd67f8 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:20:10.228853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 752/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:20:12.280231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87772ba-2aad-4256-ba64-e10378e97cc0 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:12.280849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87772ba-2aad-4256-ba64-e10378e97cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:12.280849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87772ba-2aad-4256-ba64-e10378e97cc0 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:12.282076 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 736/1488] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:20:12.287564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b58564-e654-4f16-8796-ccb3e3ab5ed8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:12.287998 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b58564-e654-4f16-8796-ccb3e3ab5ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:12.288102 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b58564-e654-4f16-8796-ccb3e3ab5ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:12.352835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-83b58564-e654-4f16-8796-ccb3e3ab5ed8 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:20:12.354026 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-83b58564-e654-4f16-8796-ccb3e3ab5ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:12.406166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:20:12.450110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 753/1489] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:20:12.498989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87772ba-2aad-4256-ba64-e10378e97cc0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:20:12.500624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e87772ba-2aad-4256-ba64-e10378e97cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:12.537825 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:20:12.605440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87772ba-2aad-4256-ba64-e10378e97cc0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:20:12.678416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744ef3c-2dc3-4e35-bf02-8ea5437eb2af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:20:12.679019 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744ef3c-2dc3-4e35-bf02-8ea5437eb2af service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:12.679297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744ef3c-2dc3-4e35-bf02-8ea5437eb2af service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:12.679577 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744ef3c-2dc3-4e35-bf02-8ea5437eb2af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:12.681180 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2744ef3c-2dc3-4e35-bf02-8ea5437eb2af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:12.759068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:20:12.788810 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744ef3c-2dc3-4e35-bf02-8ea5437eb2af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:20:12.790161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744ef3c-2dc3-4e35-bf02-8ea5437eb2af service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:20:12.808369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 737/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:20:15.044338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff46767-8309-4413-9003-ae24629a7848 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:15.044979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff46767-8309-4413-9003-ae24629a7848 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:15.044979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff46767-8309-4413-9003-ae24629a7848 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:15.046232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 754/1491] 10.222.0.40 () {54 vars in 927 bytes} [Thu Aug 11 16:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:20:15.051917 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e993a2-a83f-4d38-a10b-a34d0d8e6b91 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:15.052416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e993a2-a83f-4d38-a10b-a34d0d8e6b91 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:15.052507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e993a2-a83f-4d38-a10b-a34d0d8e6b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:15.116928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-60e993a2-a83f-4d38-a10b-a34d0d8e6b91 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:20:15.118119 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-60e993a2-a83f-4d38-a10b-a34d0d8e6b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:15.219812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 738/1492] 10.222.0.40 () {58 vars in 1024 bytes} [Thu Aug 11 16:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:20:15.259213 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff46767-8309-4413-9003-ae24629a7848 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:20:15.260799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9ff46767-8309-4413-9003-ae24629a7848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:15.363061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff46767-8309-4413-9003-ae24629a7848 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:20:15.434880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5ce9f-2e1c-449b-867e-24e4632f0dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:20:15.435471 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5ce9f-2e1c-449b-867e-24e4632f0dac service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:20:15.435743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5ce9f-2e1c-449b-867e-24e4632f0dac service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:20:15.436004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5ce9f-2e1c-449b-867e-24e4632f0dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:20:15.437603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-38b5ce9f-2e1c-449b-867e-24e4632f0dac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:20:15.446957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:20:15.546226 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5ce9f-2e1c-449b-867e-24e4632f0dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:20:15.547645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5ce9f-2e1c-449b-867e-24e4632f0dac service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:20:15.570795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 755/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:20:25.218011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=82 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:20:25.568479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=50 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:31.967714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327b9e-f31f-4dcc-84f1-461fd5193478 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:31.968308 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327b9e-f31f-4dcc-84f1-461fd5193478 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:31.968308 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327b9e-f31f-4dcc-84f1-461fd5193478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:32.044284 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4e327b9e-f31f-4dcc-84f1-461fd5193478 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:21:32.045523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4e327b9e-f31f-4dcc-84f1-461fd5193478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:32.142094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 739/1494] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:21:32.150235 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68442d98-45a9-4ce0-95bc-00dcb3398c1a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:32.150741 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68442d98-45a9-4ce0-95bc-00dcb3398c1a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:32.150845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68442d98-45a9-4ce0-95bc-00dcb3398c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:32.225548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-68442d98-45a9-4ce0-95bc-00dcb3398c1a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:21:32.226666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-68442d98-45a9-4ce0-95bc-00dcb3398c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:32.326499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 756/1495] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:21:32.331207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e327b9e-f31f-4dcc-84f1-461fd5193478 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:21:32.332429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4e327b9e-f31f-4dcc-84f1-461fd5193478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:32.343577 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e327b9e-f31f-4dcc-84f1-461fd5193478 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:21:32.403778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:32.437458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efd85e-45bc-430d-9704-adcabfba5cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:21:32.438051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efd85e-45bc-430d-9704-adcabfba5cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:32.438327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efd85e-45bc-430d-9704-adcabfba5cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:32.438595 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efd85e-45bc-430d-9704-adcabfba5cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:32.439230 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efd85e-45bc-430d-9704-adcabfba5cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:21:32.439528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efd85e-45bc-430d-9704-adcabfba5cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:21:32.440547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-d2efd85e-45bc-430d-9704-adcabfba5cd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:21:32.440547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Aug 11 16:21:32.440547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: Aug 11 16:21:32.441460 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efd85e-45bc-430d-9704-adcabfba5cd9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:21:32.452384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 740/1496] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:21:32.461902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68442d98-45a9-4ce0-95bc-00dcb3398c1a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:21:32.470939 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68442d98-45a9-4ce0-95bc-00dcb3398c1a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:21:32.533115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:32.567254 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec65f2-6efb-4536-8174-45217dc10ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:21:32.567844 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec65f2-6efb-4536-8174-45217dc10ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:32.568120 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec65f2-6efb-4536-8174-45217dc10ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:32.568382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec65f2-6efb-4536-8174-45217dc10ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:32.569030 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec65f2-6efb-4536-8174-45217dc10ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:21:32.570764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-87ec65f2-6efb-4536-8174-45217dc10ec9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:21:32.570764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: warnings.warn(msg) Aug 11 16:21:32.570764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: Aug 11 16:21:32.571963 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec65f2-6efb-4536-8174-45217dc10ec9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:21:32.626426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 757/1497] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:21:32 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:21:32.630638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efd85e-45bc-430d-9704-adcabfba5cd9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:21:32.632168 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d2efd85e-45bc-430d-9704-adcabfba5cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:32.665730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efd85e-45bc-430d-9704-adcabfba5cd9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:21:32.759306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85584230-a990-4227-b1c5-b9d2e896bd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:21:32.759829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85584230-a990-4227-b1c5-b9d2e896bd92 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:32.760105 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85584230-a990-4227-b1c5-b9d2e896bd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:32.760374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85584230-a990-4227-b1c5-b9d2e896bd92 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:32.761018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85584230-a990-4227-b1c5-b9d2e896bd92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:21:32.762012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-85584230-a990-4227-b1c5-b9d2e896bd92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:21:32.762012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Aug 11 16:21:32.762012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: Aug 11 16:21:32.763215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85584230-a990-4227-b1c5-b9d2e896bd92 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:21:32.804345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 741/1498] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:21:32 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:21:32.808458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec65f2-6efb-4536-8174-45217dc10ec9 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:21:32.809980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-87ec65f2-6efb-4536-8174-45217dc10ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:32.870220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec65f2-6efb-4536-8174-45217dc10ec9 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:21:32.951476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:32.963471 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b08405-dd23-4b8a-99ba-26c3990ddf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:21:32.964063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b08405-dd23-4b8a-99ba-26c3990ddf71 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:32.964364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b08405-dd23-4b8a-99ba-26c3990ddf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:32.964682 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b08405-dd23-4b8a-99ba-26c3990ddf71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:32.965317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b08405-dd23-4b8a-99ba-26c3990ddf71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:21:32.966316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-13b08405-dd23-4b8a-99ba-26c3990ddf71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:21:32.966316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: warnings.warn(msg) Aug 11 16:21:32.966316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: Aug 11 16:21:32.967223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b08405-dd23-4b8a-99ba-26c3990ddf71 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:21:32.979258 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 758/1499] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:21:32.983494 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85584230-a990-4227-b1c5-b9d2e896bd92 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:21:32.985075 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-85584230-a990-4227-b1c5-b9d2e896bd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:32.996480 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85584230-a990-4227-b1c5-b9d2e896bd92 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:21:33.022158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:33.091025 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a76f9-7908-45c7-968a-dcca24dbeb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:21:33.091620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a76f9-7908-45c7-968a-dcca24dbeb8c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:33.091896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a76f9-7908-45c7-968a-dcca24dbeb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:33.092166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a76f9-7908-45c7-968a-dcca24dbeb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:33.092830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a76f9-7908-45c7-968a-dcca24dbeb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:21:33.093832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-cf2a76f9-7908-45c7-968a-dcca24dbeb8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:21:33.093832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Aug 11 16:21:33.093832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: Aug 11 16:21:33.094723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a76f9-7908-45c7-968a-dcca24dbeb8c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:21:33.106808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 742/1500] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:21:33.111103 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b08405-dd23-4b8a-99ba-26c3990ddf71 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:21:33.112667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-13b08405-dd23-4b8a-99ba-26c3990ddf71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:33.147278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b08405-dd23-4b8a-99ba-26c3990ddf71 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:21:33.241078 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2f7de-ec20-4006-9965-330136d84759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:21:33.241753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2f7de-ec20-4006-9965-330136d84759 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:33.241985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2f7de-ec20-4006-9965-330136d84759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:33.242251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2f7de-ec20-4006-9965-330136d84759 admin admin] PATH_INFO: `/v3/projects/e8c4ed03efa343969e9afa2276786e07/users/dd51d42d9c6d4b74a6671971afece603/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:33.263512 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2f7de-ec20-4006-9965-330136d84759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c4ed03efa343969e9afa2276786e07, user_id=dd51d42d9c6d4b74a6671971afece603, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:21:33.264520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-fab2f7de-ec20-4006-9965-330136d84759 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:21:33.264520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: warnings.warn(msg) Aug 11 16:21:33.264520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: Aug 11 16:21:33.266477 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2f7de-ec20-4006-9965-330136d84759 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:21:33.290170 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 759/1501] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:21:33 2022] PUT /identity/v3/projects/e8c4ed03efa343969e9afa2276786e07/users/dd51d42d9c6d4b74a6671971afece603/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:21:33.302720 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f309c-582e-40b5-9af1-a5880962436f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:33.303006 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f309c-582e-40b5-9af1-a5880962436f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:33.303278 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f309c-582e-40b5-9af1-a5880962436f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:33.359237 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-921f309c-582e-40b5-9af1-a5880962436f None None] MFA Rules not processed for user `dd51d42d9c6d4b74a6671971afece603`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:21:33.360469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-921f309c-582e-40b5-9af1-a5880962436f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:33.435769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 743/1502] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:21:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:21:33.449337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e264de-bdd1-461e-a6b3-671a50b2aa5c None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:33.449619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e264de-bdd1-461e-a6b3-671a50b2aa5c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:33.449890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e264de-bdd1-461e-a6b3-671a50b2aa5c None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:33.451229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 760/1503] 10.222.0.40 () {54 vars in 964 bytes} [Thu Aug 11 16:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:21:33.455983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ae8b1-38b8-4b56-bb79-89fb32788fe5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:33.456269 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ae8b1-38b8-4b56-bb79-89fb32788fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:33.456545 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ae8b1-38b8-4b56-bb79-89fb32788fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:33.488050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:33.531636 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e76ae8b1-38b8-4b56-bb79-89fb32788fe5 None None] MFA Rules not processed for user `1e52aae602104cc2b48354b2d75d359c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:21:33.532857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e76ae8b1-38b8-4b56-bb79-89fb32788fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:33.618651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 744/1504] 10.222.0.40 () {58 vars in 1061 bytes} [Thu Aug 11 16:21:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:21:33.626392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e264de-bdd1-461e-a6b3-671a50b2aa5c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:21:33.627886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-23e264de-bdd1-461e-a6b3-671a50b2aa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:33.677810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:33.729989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e264de-bdd1-461e-a6b3-671a50b2aa5c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:21:33.801107 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980cc97-92de-4efa-8b1a-079cbf9b624f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:21:33.801709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980cc97-92de-4efa-8b1a-079cbf9b624f service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:33.801985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980cc97-92de-4efa-8b1a-079cbf9b624f service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:33.802253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980cc97-92de-4efa-8b1a-079cbf9b624f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:33.803837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7980cc97-92de-4efa-8b1a-079cbf9b624f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:33.899145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980cc97-92de-4efa-8b1a-079cbf9b624f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:21:33.900495 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980cc97-92de-4efa-8b1a-079cbf9b624f service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:21:33.903983 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:33.923365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 761/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:21:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:21:33.969953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e963373-ff14-4805-a05a-bde78e5f6bc6 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:33.970264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e963373-ff14-4805-a05a-bde78e5f6bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:33.970546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e963373-ff14-4805-a05a-bde78e5f6bc6 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:33.972459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 745/1506] 10.222.0.40 () {52 vars in 830 bytes} [Thu Aug 11 16:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:21:33.975992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980cc97-92de-4efa-8b1a-079cbf9b624f service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:21:33.977228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7980cc97-92de-4efa-8b1a-079cbf9b624f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:34.074144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980cc97-92de-4efa-8b1a-079cbf9b624f service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:21:34.166189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad102191-6438-4ecb-bd18-66dc09e65185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:21:34.166739 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad102191-6438-4ecb-bd18-66dc09e65185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:34.167021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad102191-6438-4ecb-bd18-66dc09e65185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:34.167292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad102191-6438-4ecb-bd18-66dc09e65185 admin admin] PATH_INFO: `/v3/users/dd51d42d9c6d4b74a6671971afece603` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:34.180034 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad102191-6438-4ecb-bd18-66dc09e65185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd51d42d9c6d4b74a6671971afece603)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:21:34.181112 dv-cinder-852208-4-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-ad102191-6438-4ecb-bd18-66dc09e65185 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:21:34.181112 dv-cinder-852208-4-smb devstack@keystone.service[81408]: warnings.warn(msg) Aug 11 16:21:34.181112 dv-cinder-852208-4-smb devstack@keystone.service[81408]: Aug 11 16:21:34.182329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad102191-6438-4ecb-bd18-66dc09e65185 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:21:34.191916 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:34.250541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ad102191-6438-4ecb-bd18-66dc09e65185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd51d42d9c6d4b74a6671971afece603'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:21:34.274731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ad102191-6438-4ecb-bd18-66dc09e65185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd51d42d9c6d4b74a6671971afece603'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:21:34.284430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ad102191-6438-4ecb-bd18-66dc09e65185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd51d42d9c6d4b74a6671971afece603'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:21:34.298280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ad102191-6438-4ecb-bd18-66dc09e65185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd51d42d9c6d4b74a6671971afece603'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:21:34.298790 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ad102191-6438-4ecb-bd18-66dc09e65185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd51d42d9c6d4b74a6671971afece603'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:21:34.304155 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 762/1507] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:21:33 2022] DELETE /identity/v3/users/dd51d42d9c6d4b74a6671971afece603 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:21:34.308522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4160c-8a81-4286-9543-7aeefc5f2cc6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:34.309033 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4160c-8a81-4286-9543-7aeefc5f2cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:34.309140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4160c-8a81-4286-9543-7aeefc5f2cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:34.364573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1fc4160c-8a81-4286-9543-7aeefc5f2cc6 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:21:34.365820 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1fc4160c-8a81-4286-9543-7aeefc5f2cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:34.442063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:34.455096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 746/1508] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:21:34.465129 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad102191-6438-4ecb-bd18-66dc09e65185 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:21:34.466346 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ad102191-6438-4ecb-bd18-66dc09e65185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:34.565517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad102191-6438-4ecb-bd18-66dc09e65185 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:21:34.624960 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:34.645587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d9758-b2d4-4982-9d62-73f5a41906e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:21:34.646194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d9758-b2d4-4982-9d62-73f5a41906e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:34.646471 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d9758-b2d4-4982-9d62-73f5a41906e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:34.646738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d9758-b2d4-4982-9d62-73f5a41906e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:34.648319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-316d9758-b2d4-4982-9d62-73f5a41906e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:34.756253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d9758-b2d4-4982-9d62-73f5a41906e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:21:34.757647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d9758-b2d4-4982-9d62-73f5a41906e1 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:21:34.775246 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 763/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:21:35.124317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4160c-8a81-4286-9543-7aeefc5f2cc6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:21:35.125668 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1fc4160c-8a81-4286-9543-7aeefc5f2cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:21:35.137526 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4160c-8a81-4286-9543-7aeefc5f2cc6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:21:35.235348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053b097-9574-475c-9be0-8b34471fb09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:21:35.235965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053b097-9574-475c-9be0-8b34471fb09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:21:35.236238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053b097-9574-475c-9be0-8b34471fb09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:21:35.237154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053b097-9574-475c-9be0-8b34471fb09e admin admin] PATH_INFO: `/v3/projects/e8c4ed03efa343969e9afa2276786e07` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:21:35.246722 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053b097-9574-475c-9be0-8b34471fb09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c4ed03efa343969e9afa2276786e07)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:21:35.247731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-1053b097-9574-475c-9be0-8b34471fb09e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:21:35.247731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Aug 11 16:21:35.247731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: Aug 11 16:21:35.248970 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053b097-9574-475c-9be0-8b34471fb09e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:21:35.306551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1053b097-9574-475c-9be0-8b34471fb09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c4ed03efa343969e9afa2276786e07', 'request_id': 'req-1053b097-9574-475c-9be0-8b34471fb09e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:21:35.315400 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1053b097-9574-475c-9be0-8b34471fb09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c4ed03efa343969e9afa2276786e07', 'request_id': 'req-1053b097-9574-475c-9be0-8b34471fb09e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:21:35.328281 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1053b097-9574-475c-9be0-8b34471fb09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c4ed03efa343969e9afa2276786e07', 'request_id': 'req-1053b097-9574-475c-9be0-8b34471fb09e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:21:35.352260 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1053b097-9574-475c-9be0-8b34471fb09e admin admin] The token cache is being invalidate because project e8c4ed03efa343969e9afa2276786e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:21:35.352552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1053b097-9574-475c-9be0-8b34471fb09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:21:35.353102 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1053b097-9574-475c-9be0-8b34471fb09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:21:35.354407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 747/1510] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:21:35 2022] DELETE /identity/v3/projects/e8c4ed03efa343969e9afa2276786e07 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:21:44.773077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=62 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:45.350295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:23:08.086171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c96cee-51e6-4082-abc0-c023b8c1f5ac None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:08.086810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c96cee-51e6-4082-abc0-c023b8c1f5ac None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:08.086810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c96cee-51e6-4082-abc0-c023b8c1f5ac None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:08.088194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 764/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 16:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:23:08.092944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479b68a-797a-4c27-ac21-10645da2ddbc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:08.093425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479b68a-797a-4c27-ac21-10645da2ddbc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:08.093537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479b68a-797a-4c27-ac21-10645da2ddbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:08.174016 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e479b68a-797a-4c27-ac21-10645da2ddbc None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:23:08.175214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e479b68a-797a-4c27-ac21-10645da2ddbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:23:08.276871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 748/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:23:08.435537 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c96cee-51e6-4082-abc0-c023b8c1f5ac None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:23:08.437683 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f7c96cee-51e6-4082-abc0-c023b8c1f5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:23:08.553825 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c96cee-51e6-4082-abc0-c023b8c1f5ac None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:23:08.559186 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0f876-28f6-4f14-b7c1-f544ac7dee6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:23:08.559776 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0f876-28f6-4f14-b7c1-f544ac7dee6a service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:08.560051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0f876-28f6-4f14-b7c1-f544ac7dee6a service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:08.560318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0f876-28f6-4f14-b7c1-f544ac7dee6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:08.569325 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0f876-28f6-4f14-b7c1-f544ac7dee6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:23:08.570890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0f876-28f6-4f14-b7c1-f544ac7dee6a service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:23:08.580158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 765/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:23:09.415419 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c90e56-80b0-40da-b89e-0977e97b64bf None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:09.415984 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c90e56-80b0-40da-b89e-0977e97b64bf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:09.415984 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c90e56-80b0-40da-b89e-0977e97b64bf None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:09.417347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 749/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 16:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:23:09.422927 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24c6e8-887d-4573-a6dc-db3eeb405901 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:09.423362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24c6e8-887d-4573-a6dc-db3eeb405901 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:09.423456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24c6e8-887d-4573-a6dc-db3eeb405901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:09.443972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1b24c6e8-887d-4573-a6dc-db3eeb405901 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:23:09.445184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1b24c6e8-887d-4573-a6dc-db3eeb405901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:23:09.452892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 766/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 16:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:23:09.605270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c90e56-80b0-40da-b89e-0977e97b64bf None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:23:09.620246 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c90e56-80b0-40da-b89e-0977e97b64bf None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:23:09.625474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bc39f-b9e6-46ee-8d0e-3e416b378188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:23:09.626175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bc39f-b9e6-46ee-8d0e-3e416b378188 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:09.626375 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bc39f-b9e6-46ee-8d0e-3e416b378188 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:09.626651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bc39f-b9e6-46ee-8d0e-3e416b378188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:09.635420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bc39f-b9e6-46ee-8d0e-3e416b378188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:23:09.637021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bc39f-b9e6-46ee-8d0e-3e416b378188 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:23:09.646951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 750/1516] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:23:09.998673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c507bb-d630-4475-a670-1b64e8af3466 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:09.998898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c507bb-d630-4475-a670-1b64e8af3466 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:09.999130 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c507bb-d630-4475-a670-1b64e8af3466 None None] PATH_INFO: `/v3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:10.000981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 767/1517] 10.222.0.47 () {54 vars in 925 bytes} [Thu Aug 11 16:23:09 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:23:10.029465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2be5e9-1b65-49bc-bd62-cb095d93a2ae None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:10.029745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2be5e9-1b65-49bc-bd62-cb095d93a2ae None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:10.030017 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2be5e9-1b65-49bc-bd62-cb095d93a2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:10.090842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6a2be5e9-1b65-49bc-bd62-cb095d93a2ae None None] MFA Rules not processed for user `64e1c7e6ee814b47912760cf7daf54c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:23:10.092055 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6a2be5e9-1b65-49bc-bd62-cb095d93a2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:23:10.108468 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:23:10.161893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 751/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Aug 11 16:23:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:23:14.010762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc6ae3-8160-4ea8-8a67-f84cef0526a7 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:14.011238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc6ae3-8160-4ea8-8a67-f84cef0526a7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:14.011341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc6ae3-8160-4ea8-8a67-f84cef0526a7 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:14.012665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 768/1519] 10.222.0.40 () {54 vars in 961 bytes} [Thu Aug 11 16:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:23:14.018171 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf107-6afa-4102-96bd-33fd7baa0881 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:14.018609 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf107-6afa-4102-96bd-33fd7baa0881 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:14.018714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf107-6afa-4102-96bd-33fd7baa0881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:14.044747 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d14cf107-6afa-4102-96bd-33fd7baa0881 None None] MFA Rules not processed for user `64e1c7e6ee814b47912760cf7daf54c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:23:14.046105 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d14cf107-6afa-4102-96bd-33fd7baa0881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:23:14.055294 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 752/1520] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Aug 11 16:23:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:23:14.062806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc6ae3-8160-4ea8-8a67-f84cef0526a7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:23:14.075979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc6ae3-8160-4ea8-8a67-f84cef0526a7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:23:14.081416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf0e27-8d61-47bc-b400-3741b6bf0b6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e1c7e6ee814b47912760cf7daf54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:23:14.081999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf0e27-8d61-47bc-b400-3741b6bf0b6e service placement] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:14.082276 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf0e27-8d61-47bc-b400-3741b6bf0b6e service placement] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:14.082548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf0e27-8d61-47bc-b400-3741b6bf0b6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:14.090544 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf0e27-8d61-47bc-b400-3741b6bf0b6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:23:14.092120 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf0e27-8d61-47bc-b400-3741b6bf0b6e service placement] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:23:14.102132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 769/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:23:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:23:20.866584 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeebd8c-d6d2-4b85-b290-b234013a3f36 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:20.867166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeebd8c-d6d2-4b85-b290-b234013a3f36 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:20.867166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeebd8c-d6d2-4b85-b290-b234013a3f36 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:20.868487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 753/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 16:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:23:20.873157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083c6b5-c9ae-4eca-ac0b-51fd36db4f86 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:20.873572 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083c6b5-c9ae-4eca-ac0b-51fd36db4f86 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:20.873702 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083c6b5-c9ae-4eca-ac0b-51fd36db4f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:20.892869 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4083c6b5-c9ae-4eca-ac0b-51fd36db4f86 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:23:20.894086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4083c6b5-c9ae-4eca-ac0b-51fd36db4f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:23:20.901803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 770/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 16:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:23:21.053148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeebd8c-d6d2-4b85-b290-b234013a3f36 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:23:21.067963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeebd8c-d6d2-4b85-b290-b234013a3f36 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:23:21.073324 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004470e5-55de-4f1e-8f18-1f4a70737ac2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:23:21.073899 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004470e5-55de-4f1e-8f18-1f4a70737ac2 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:21.074169 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004470e5-55de-4f1e-8f18-1f4a70737ac2 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:21.074435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004470e5-55de-4f1e-8f18-1f4a70737ac2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:21.082329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004470e5-55de-4f1e-8f18-1f4a70737ac2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:23:21.083911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004470e5-55de-4f1e-8f18-1f4a70737ac2 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:23:21.093317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 754/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:23:21.908413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e420cd-bdd8-4297-9ad5-69bb58bb8c2e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:21.909002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e420cd-bdd8-4297-9ad5-69bb58bb8c2e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:21.909002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e420cd-bdd8-4297-9ad5-69bb58bb8c2e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:21.911121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 771/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 16:23:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:23:21.915778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c610b8-2b03-4663-9e3c-53535b1a6a93 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:21.916201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c610b8-2b03-4663-9e3c-53535b1a6a93 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:21.916316 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c610b8-2b03-4663-9e3c-53535b1a6a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:21.935534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-98c610b8-2b03-4663-9e3c-53535b1a6a93 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:23:21.936740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-98c610b8-2b03-4663-9e3c-53535b1a6a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:23:21.944390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 755/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 16:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:23:22.093168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e420cd-bdd8-4297-9ad5-69bb58bb8c2e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:23:22.107907 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e420cd-bdd8-4297-9ad5-69bb58bb8c2e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:23:22.113918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385305c-5497-47b1-a3bc-a94f666afdc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:23:22.114504 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385305c-5497-47b1-a3bc-a94f666afdc2 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:22.114783 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385305c-5497-47b1-a3bc-a94f666afdc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:22.115050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385305c-5497-47b1-a3bc-a94f666afdc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:22.122813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385305c-5497-47b1-a3bc-a94f666afdc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:23:22.124375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385305c-5497-47b1-a3bc-a94f666afdc2 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:23:22.133478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 772/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:23:26.180131 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149fa44-1343-4231-afa2-9e6eb061b31e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:26.180750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149fa44-1343-4231-afa2-9e6eb061b31e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:26.180750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149fa44-1343-4231-afa2-9e6eb061b31e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:26.182080 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 756/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 16:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:23:26.187389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4861d8b-618a-4b62-b256-f134853a5a56 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:26.187838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4861d8b-618a-4b62-b256-f134853a5a56 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:26.187952 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4861d8b-618a-4b62-b256-f134853a5a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:26.207978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b4861d8b-618a-4b62-b256-f134853a5a56 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:23:26.209209 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b4861d8b-618a-4b62-b256-f134853a5a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:23:26.216974 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 773/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 16:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:23:26.289509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149fa44-1343-4231-afa2-9e6eb061b31e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:23:26.291211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b149fa44-1343-4231-afa2-9e6eb061b31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:23:26.368408 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149fa44-1343-4231-afa2-9e6eb061b31e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:23:26.371994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9b3e9-e325-45c3-a8ff-918781e89ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:23:26.372602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b3e9-e325-45c3-a8ff-918781e89ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:26.372890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b3e9-e325-45c3-a8ff-918781e89ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:26.373160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b3e9-e325-45c3-a8ff-918781e89ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:26.382556 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9b3e9-e325-45c3-a8ff-918781e89ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:23:26.383966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9b3e9-e325-45c3-a8ff-918781e89ae7 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:23:26.393222 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 757/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:23:28.404897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebeaf0-fd5d-4e46-8512-2f087de38323 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:28.405435 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebeaf0-fd5d-4e46-8512-2f087de38323 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:28.405435 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebeaf0-fd5d-4e46-8512-2f087de38323 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:28.406848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 774/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 16:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:23:28.412920 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a46439-bca2-4549-9cb4-b0f190159949 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:28.413359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a46439-bca2-4549-9cb4-b0f190159949 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:28.413469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a46439-bca2-4549-9cb4-b0f190159949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:28.432932 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a1a46439-bca2-4549-9cb4-b0f190159949 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:23:28.434114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a1a46439-bca2-4549-9cb4-b0f190159949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:23:28.441836 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 758/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 16:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:23:28.477785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebeaf0-fd5d-4e46-8512-2f087de38323 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:23:28.488625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebeaf0-fd5d-4e46-8512-2f087de38323 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:23:28.492056 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1668b6-ff49-43a6-a4d7-fd0b21303963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:23:28.492665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1668b6-ff49-43a6-a4d7-fd0b21303963 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:28.492940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1668b6-ff49-43a6-a4d7-fd0b21303963 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:28.493206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1668b6-ff49-43a6-a4d7-fd0b21303963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:28.501703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1668b6-ff49-43a6-a4d7-fd0b21303963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:23:28.503109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1668b6-ff49-43a6-a4d7-fd0b21303963 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:23:28.512155 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 775/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:23:32.228389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85c940-dfbd-4784-8256-db79fd066c82 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:32.228984 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85c940-dfbd-4784-8256-db79fd066c82 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:32.228984 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85c940-dfbd-4784-8256-db79fd066c82 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:32.230291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 759/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 16:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:23:32.235371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1d477-c2e0-4a62-99a0-397b5399edd4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:32.235837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1d477-c2e0-4a62-99a0-397b5399edd4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:32.235934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1d477-c2e0-4a62-99a0-397b5399edd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:32.255251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8de1d477-c2e0-4a62-99a0-397b5399edd4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:23:32.256456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8de1d477-c2e0-4a62-99a0-397b5399edd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:23:32.264111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 776/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 16:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:23:32.565714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85c940-dfbd-4784-8256-db79fd066c82 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:23:32.567379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-de85c940-dfbd-4784-8256-db79fd066c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:23:32.631002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:23:32.644828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85c940-dfbd-4784-8256-db79fd066c82 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:23:32.648377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e85b5-b423-47e1-9b56-f9079febd9bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:23:32.649000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e85b5-b423-47e1-9b56-f9079febd9bf service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:32.649280 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e85b5-b423-47e1-9b56-f9079febd9bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:32.649549 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e85b5-b423-47e1-9b56-f9079febd9bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:32.658291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e85b5-b423-47e1-9b56-f9079febd9bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:23:32.660571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e85b5-b423-47e1-9b56-f9079febd9bf service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:23:32.669807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 760/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:23:34.687659 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67c7f2-becb-44fc-8d8e-0a7dc4b2abf8 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:34.688223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67c7f2-becb-44fc-8d8e-0a7dc4b2abf8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:34.688223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67c7f2-becb-44fc-8d8e-0a7dc4b2abf8 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:34.689586 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 777/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 16:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:23:34.695567 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c56d6-4d34-427d-ad6a-0cf8bdfe3da6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:34.695992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c56d6-4d34-427d-ad6a-0cf8bdfe3da6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:34.696104 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c56d6-4d34-427d-ad6a-0cf8bdfe3da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:34.715113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-514c56d6-4d34-427d-ad6a-0cf8bdfe3da6 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:23:34.716293 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-514c56d6-4d34-427d-ad6a-0cf8bdfe3da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:23:34.724125 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 761/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 16:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:23:35.026838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67c7f2-becb-44fc-8d8e-0a7dc4b2abf8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:23:35.028540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1c67c7f2-becb-44fc-8d8e-0a7dc4b2abf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:23:35.037208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=84 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:23:35.043645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67c7f2-becb-44fc-8d8e-0a7dc4b2abf8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:23:35.047121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a895d4-1f80-4bbe-8d58-c20c0e06b522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:23:35.047710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a895d4-1f80-4bbe-8d58-c20c0e06b522 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:23:35.047992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a895d4-1f80-4bbe-8d58-c20c0e06b522 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:23:35.048264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a895d4-1f80-4bbe-8d58-c20c0e06b522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:23:35.057494 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a895d4-1f80-4bbe-8d58-c20c0e06b522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:23:35.058914 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a895d4-1f80-4bbe-8d58-c20c0e06b522 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:23:35.068139 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 778/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:23:44.710454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=11 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:23:45.064023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:04.101123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348129e-d6a2-4900-b6c7-ef3f547e7165 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.104329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348129e-d6a2-4900-b6c7-ef3f547e7165 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.104329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348129e-d6a2-4900-b6c7-ef3f547e7165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.129902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c348129e-d6a2-4900-b6c7-ef3f547e7165 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.131458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c348129e-d6a2-4900-b6c7-ef3f547e7165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.144643 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 762/1540] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:04.154097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec84554-0eb8-4e17-860c-f72871343b17 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.155172 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec84554-0eb8-4e17-860c-f72871343b17 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.155676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec84554-0eb8-4e17-860c-f72871343b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.188710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cec84554-0eb8-4e17-860c-f72871343b17 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.190355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cec84554-0eb8-4e17-860c-f72871343b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.205774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 779/1541] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:04.210767 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348129e-d6a2-4900-b6c7-ef3f547e7165 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:04.228652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348129e-d6a2-4900-b6c7-ef3f547e7165 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:04.239731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3c4f6-e0e8-4617-b6bf-3c7fb30fbf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:04.240354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3c4f6-e0e8-4617-b6bf-3c7fb30fbf0d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.240805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3c4f6-e0e8-4617-b6bf-3c7fb30fbf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.241254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3c4f6-e0e8-4617-b6bf-3c7fb30fbf0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.241911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3c4f6-e0e8-4617-b6bf-3c7fb30fbf0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:04.242210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3c4f6-e0e8-4617-b6bf-3c7fb30fbf0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:04.243810 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3c4f6-e0e8-4617-b6bf-3c7fb30fbf0d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:04.260517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 763/1542] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:04.268754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec84554-0eb8-4e17-860c-f72871343b17 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:04.279187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec84554-0eb8-4e17-860c-f72871343b17 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:04.287090 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c859bfc-d357-45b3-8a39-a9597b616a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:04.287976 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c859bfc-d357-45b3-8a39-a9597b616a65 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.288496 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c859bfc-d357-45b3-8a39-a9597b616a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.289020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c859bfc-d357-45b3-8a39-a9597b616a65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.289870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c859bfc-d357-45b3-8a39-a9597b616a65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:04.291994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c859bfc-d357-45b3-8a39-a9597b616a65 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:04.352281 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 780/1543] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:04.356217 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3c4f6-e0e8-4617-b6bf-3c7fb30fbf0d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:04.369020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3c4f6-e0e8-4617-b6bf-3c7fb30fbf0d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:04.388375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4e51a-148c-448a-a3fc-f1589253c762 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.389047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4e51a-148c-448a-a3fc-f1589253c762 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.389565 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4e51a-148c-448a-a3fc-f1589253c762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.419986 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-75f4e51a-148c-448a-a3fc-f1589253c762 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.421648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-75f4e51a-148c-448a-a3fc-f1589253c762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.475338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c16f53-5341-484e-aa4d-6dfc91c36c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:04.475965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c16f53-5341-484e-aa4d-6dfc91c36c84 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.476244 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c16f53-5341-484e-aa4d-6dfc91c36c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.476517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c16f53-5341-484e-aa4d-6dfc91c36c84 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.477192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c16f53-5341-484e-aa4d-6dfc91c36c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:04.479114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c16f53-5341-484e-aa4d-6dfc91c36c84 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:04.506099 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 781/1544] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:25:04.508070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec466d-38c4-4bb3-b3ae-f3522a732569 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.508361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec466d-38c4-4bb3-b3ae-f3522a732569 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.508721 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec466d-38c4-4bb3-b3ae-f3522a732569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.517461 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 764/1545] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:04.520521 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a3968-23fd-4a55-ac75-ead6079fc03b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.520856 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a3968-23fd-4a55-ac75-ead6079fc03b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.521135 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a3968-23fd-4a55-ac75-ead6079fc03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.529541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cfec466d-38c4-4bb3-b3ae-f3522a732569 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.530736 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cfec466d-38c4-4bb3-b3ae-f3522a732569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.539646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 782/1546] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:04.542188 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1f8a3968-23fd-4a55-ac75-ead6079fc03b None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.543397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1f8a3968-23fd-4a55-ac75-ead6079fc03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.545803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f272d12-2d3b-4500-9faa-47cd1eb902cc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.546085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f272d12-2d3b-4500-9faa-47cd1eb902cc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.546356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f272d12-2d3b-4500-9faa-47cd1eb902cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.555718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 765/1547] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:04.555718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebe63d-ce27-4b40-bf57-8a4a1d4f3e98 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.555718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebe63d-ce27-4b40-bf57-8a4a1d4f3e98 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.555718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebe63d-ce27-4b40-bf57-8a4a1d4f3e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.572411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0f272d12-2d3b-4500-9faa-47cd1eb902cc None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.574198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0f272d12-2d3b-4500-9faa-47cd1eb902cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.579338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8cebe63d-ce27-4b40-bf57-8a4a1d4f3e98 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.580476 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8cebe63d-ce27-4b40-bf57-8a4a1d4f3e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.582669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 783/1548] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:04.583917 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ccf63-d749-4882-b656-85763825df7b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.584204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ccf63-d749-4882-b656-85763825df7b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.584517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ccf63-d749-4882-b656-85763825df7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.588699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 766/1549] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:04.589989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dd4e9-87bd-4b22-b724-40a07c984f9f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.590427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dd4e9-87bd-4b22-b724-40a07c984f9f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.590911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dd4e9-87bd-4b22-b724-40a07c984f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.608412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-878ccf63-d749-4882-b656-85763825df7b None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.609591 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-878ccf63-d749-4882-b656-85763825df7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.609962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-729dd4e9-87bd-4b22-b724-40a07c984f9f None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.611150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-729dd4e9-87bd-4b22-b724-40a07c984f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.617428 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 784/1550] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:04.618196 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ccf63-d749-4882-b656-85763825df7b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:04.619184 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 767/1551] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:04.620323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b763ba0-7e3b-4737-b31e-91394a46d7b7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.620628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b763ba0-7e3b-4737-b31e-91394a46d7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.620908 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b763ba0-7e3b-4737-b31e-91394a46d7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.631014 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ccf63-d749-4882-b656-85763825df7b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:04.635558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad84025-4d6e-4004-a873-d16e54f945ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:04.636145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad84025-4d6e-4004-a873-d16e54f945ce admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.636422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad84025-4d6e-4004-a873-d16e54f945ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.636735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad84025-4d6e-4004-a873-d16e54f945ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.637376 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad84025-4d6e-4004-a873-d16e54f945ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:04.638966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad84025-4d6e-4004-a873-d16e54f945ce admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:04.641231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7b763ba0-7e3b-4737-b31e-91394a46d7b7 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.642393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7b763ba0-7e3b-4737-b31e-91394a46d7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.649759 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 785/1552] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:04.653644 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 768/1553] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:04.653794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f356cdc-45c9-4361-8d3a-3c3867dabf36 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.653794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f356cdc-45c9-4361-8d3a-3c3867dabf36 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.653794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f356cdc-45c9-4361-8d3a-3c3867dabf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.654027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d3d06-b6e2-49e9-98b5-be70a943a9c1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.654027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d3d06-b6e2-49e9-98b5-be70a943a9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.654027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d3d06-b6e2-49e9-98b5-be70a943a9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.671705 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8f356cdc-45c9-4361-8d3a-3c3867dabf36 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.672146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f11d3d06-b6e2-49e9-98b5-be70a943a9c1 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.673028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8f356cdc-45c9-4361-8d3a-3c3867dabf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.673314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f11d3d06-b6e2-49e9-98b5-be70a943a9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.684945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 769/1555] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:04.685136 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 786/1555] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:04.685224 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb1d5b-7de3-4f71-a5ea-4232055ad0ea None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.685224 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb1d5b-7de3-4f71-a5ea-4232055ad0ea None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.685224 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb1d5b-7de3-4f71-a5ea-4232055ad0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.685852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61fc95-dfb4-4101-bddf-0dccad7b7bd2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.686139 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61fc95-dfb4-4101-bddf-0dccad7b7bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.686423 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61fc95-dfb4-4101-bddf-0dccad7b7bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.702740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-52bb1d5b-7de3-4f71-a5ea-4232055ad0ea None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.704527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-52bb1d5b-7de3-4f71-a5ea-4232055ad0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.707432 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1c61fc95-dfb4-4101-bddf-0dccad7b7bd2 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.708697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1c61fc95-dfb4-4101-bddf-0dccad7b7bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.712364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 770/1556] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:04.713211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb1d5b-7de3-4f71-a5ea-4232055ad0ea None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:04.720620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 787/1557] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:04.721870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557b7ea-3ed8-4179-aee7-5d6857b444cc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.722210 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557b7ea-3ed8-4179-aee7-5d6857b444cc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.722544 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557b7ea-3ed8-4179-aee7-5d6857b444cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.723179 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb1d5b-7de3-4f71-a5ea-4232055ad0ea None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:04.727986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc14839-ba25-41b7-9f8c-a15515f21314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:04.728555 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc14839-ba25-41b7-9f8c-a15515f21314 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.728856 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc14839-ba25-41b7-9f8c-a15515f21314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.729124 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc14839-ba25-41b7-9f8c-a15515f21314 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.729750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc14839-ba25-41b7-9f8c-a15515f21314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:04.730042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc14839-ba25-41b7-9f8c-a15515f21314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:04.731606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc14839-ba25-41b7-9f8c-a15515f21314 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:04.742653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5557b7ea-3ed8-4179-aee7-5d6857b444cc None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.743143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 771/1558] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:04.743884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5557b7ea-3ed8-4179-aee7-5d6857b444cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.743999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc14839-ba25-41b7-9f8c-a15515f21314 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:04.751805 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 788/1559] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:04.752609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557b7ea-3ed8-4179-aee7-5d6857b444cc None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:04.755313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc14839-ba25-41b7-9f8c-a15515f21314 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:04.762306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e5b47-6b90-4cdc-a393-9c01ad8a068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:04.763269 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557b7ea-3ed8-4179-aee7-5d6857b444cc None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:04.764975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e5b47-6b90-4cdc-a393-9c01ad8a068f admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.765471 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e5b47-6b90-4cdc-a393-9c01ad8a068f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.766286 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e5b47-6b90-4cdc-a393-9c01ad8a068f admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.766942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e5b47-6b90-4cdc-a393-9c01ad8a068f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:04.768536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e5b47-6b90-4cdc-a393-9c01ad8a068f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:04.770345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e13994-5743-424b-8c70-4433ffd5b176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:04.770945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e13994-5743-424b-8c70-4433ffd5b176 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.771220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e13994-5743-424b-8c70-4433ffd5b176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.771488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e13994-5743-424b-8c70-4433ffd5b176 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.772136 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e13994-5743-424b-8c70-4433ffd5b176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:04.772436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e13994-5743-424b-8c70-4433ffd5b176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:04.773717 dv-cinder-852208-4-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-e0e13994-5743-424b-8c70-4433ffd5b176 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:25:04.773717 dv-cinder-852208-4-smb devstack@keystone.service[81408]: warnings.warn(msg) Aug 11 16:25:04.773717 dv-cinder-852208-4-smb devstack@keystone.service[81408]: Aug 11 16:25:04.774357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e13994-5743-424b-8c70-4433ffd5b176 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:04.782885 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 772/1560] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:04.783826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e5b47-6b90-4cdc-a393-9c01ad8a068f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:04.788079 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 789/1561] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:04.789529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604662a-b69b-4f7c-9006-41dc5332235c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.789871 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604662a-b69b-4f7c-9006-41dc5332235c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.790942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604662a-b69b-4f7c-9006-41dc5332235c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.794176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e5b47-6b90-4cdc-a393-9c01ad8a068f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:04.800565 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57070cf5-f9ec-4c14-bda3-0e3415217b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:04.801220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57070cf5-f9ec-4c14-bda3-0e3415217b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.801496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57070cf5-f9ec-4c14-bda3-0e3415217b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.801768 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57070cf5-f9ec-4c14-bda3-0e3415217b65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.802399 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57070cf5-f9ec-4c14-bda3-0e3415217b65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:04.802688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57070cf5-f9ec-4c14-bda3-0e3415217b65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:04.804274 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57070cf5-f9ec-4c14-bda3-0e3415217b65 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:04.811592 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6604662a-b69b-4f7c-9006-41dc5332235c None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:04.813394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6604662a-b69b-4f7c-9006-41dc5332235c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:04.816304 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 773/1562] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:04.817207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57070cf5-f9ec-4c14-bda3-0e3415217b65 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:04.824887 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 790/1563] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:04.825490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604662a-b69b-4f7c-9006-41dc5332235c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:04.830176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57070cf5-f9ec-4c14-bda3-0e3415217b65 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:04.834990 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b5ad1-9e0e-4849-a2d5-f44f696bd541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:04.835589 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b5ad1-9e0e-4849-a2d5-f44f696bd541 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.835865 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b5ad1-9e0e-4849-a2d5-f44f696bd541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.836136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b5ad1-9e0e-4849-a2d5-f44f696bd541 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.836514 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604662a-b69b-4f7c-9006-41dc5332235c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:04.836809 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b5ad1-9e0e-4849-a2d5-f44f696bd541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:04.837108 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b5ad1-9e0e-4849-a2d5-f44f696bd541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:04.838688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b5ad1-9e0e-4849-a2d5-f44f696bd541 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:04.841114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a40d0-d49f-4331-8332-9325d02a32a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:04.841709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a40d0-d49f-4331-8332-9325d02a32a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.841991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a40d0-d49f-4331-8332-9325d02a32a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.842262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a40d0-d49f-4331-8332-9325d02a32a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.842903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a40d0-d49f-4331-8332-9325d02a32a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:04.843204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a40d0-d49f-4331-8332-9325d02a32a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:04.845391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a40d0-d49f-4331-8332-9325d02a32a5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:04.851484 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 774/1564] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:04.852330 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b5ad1-9e0e-4849-a2d5-f44f696bd541 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:04.861722 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b5ad1-9e0e-4849-a2d5-f44f696bd541 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:04.870629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 791/1565] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:04.870629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a40d0-d49f-4331-8332-9325d02a32a5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:04.873527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33a93e-4fa8-4e4a-9fd2-b2ed6001ee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:04.873875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a40d0-d49f-4331-8332-9325d02a32a5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:04.874107 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33a93e-4fa8-4e4a-9fd2-b2ed6001ee2b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.874379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33a93e-4fa8-4e4a-9fd2-b2ed6001ee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.874748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33a93e-4fa8-4e4a-9fd2-b2ed6001ee2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.875387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33a93e-4fa8-4e4a-9fd2-b2ed6001ee2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:04.876381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-0a33a93e-4fa8-4e4a-9fd2-b2ed6001ee2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:25:04.876381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Aug 11 16:25:04.876381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: Aug 11 16:25:04.877591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33a93e-4fa8-4e4a-9fd2-b2ed6001ee2b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:04.878654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ceb8b-1e83-46d3-9885-3961712dd127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:04.879234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ceb8b-1e83-46d3-9885-3961712dd127 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.879517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ceb8b-1e83-46d3-9885-3961712dd127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.879792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ceb8b-1e83-46d3-9885-3961712dd127 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.880458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ceb8b-1e83-46d3-9885-3961712dd127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:04.880800 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ceb8b-1e83-46d3-9885-3961712dd127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:04.882396 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ceb8b-1e83-46d3-9885-3961712dd127 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:04.894824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 792/1566] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:04.895594 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ceb8b-1e83-46d3-9885-3961712dd127 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:04.906067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ceb8b-1e83-46d3-9885-3961712dd127 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:04.911488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38391a4b-bf98-4271-8f92-a3d25fe6afce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:04.912118 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38391a4b-bf98-4271-8f92-a3d25fe6afce admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:04.912398 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38391a4b-bf98-4271-8f92-a3d25fe6afce admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:04.915641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 775/1567] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:04.915791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38391a4b-bf98-4271-8f92-a3d25fe6afce admin admin] PATH_INFO: `/v3/projects/846b4191b3c04d3e9af6bb24abc6f270/users/acf2c8c1c26a4e069ec29aaaa90d9264/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:04.915901 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33a93e-4fa8-4e4a-9fd2-b2ed6001ee2b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:04.929970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38391a4b-bf98-4271-8f92-a3d25fe6afce admin admin] RBAC: Authorizing `identity:create_grant(project_id=846b4191b3c04d3e9af6bb24abc6f270, user_id=acf2c8c1c26a4e069ec29aaaa90d9264, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:04.932652 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38391a4b-bf98-4271-8f92-a3d25fe6afce admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:04.934745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:04.956607 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 793/1568] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:04 2022] PUT /identity/v3/projects/846b4191b3c04d3e9af6bb24abc6f270/users/acf2c8c1c26a4e069ec29aaaa90d9264/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:04.956607 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38391a4b-bf98-4271-8f92-a3d25fe6afce admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:04.956607 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:04.991876 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33a93e-4fa8-4e4a-9fd2-b2ed6001ee2b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.012056 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38391a4b-bf98-4271-8f92-a3d25fe6afce admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.017408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ab10-90ab-4118-8b14-9e943d53131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.018007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ab10-90ab-4118-8b14-9e943d53131a admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.018280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ab10-90ab-4118-8b14-9e943d53131a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.018551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ab10-90ab-4118-8b14-9e943d53131a admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.019166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3ab10-90ab-4118-8b14-9e943d53131a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.021111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3ab10-90ab-4118-8b14-9e943d53131a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.052135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 794/1569] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:05.052359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c414e8-cd8a-4755-a8dd-f17a7ec17908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.052487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ab10-90ab-4118-8b14-9e943d53131a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.052883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c414e8-cd8a-4755-a8dd-f17a7ec17908 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.052883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c414e8-cd8a-4755-a8dd-f17a7ec17908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.052883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c414e8-cd8a-4755-a8dd-f17a7ec17908 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.052883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c414e8-cd8a-4755-a8dd-f17a7ec17908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.053334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c414e8-cd8a-4755-a8dd-f17a7ec17908 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.080193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 776/1570] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:04 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:05.081065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c414e8-cd8a-4755-a8dd-f17a7ec17908 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.113996 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ab10-90ab-4118-8b14-9e943d53131a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.142752 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c414e8-cd8a-4755-a8dd-f17a7ec17908 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.147388 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4b724-1287-4a73-ba14-e7e852fa7d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.148019 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4b724-1287-4a73-ba14-e7e852fa7d8f admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.148298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4b724-1287-4a73-ba14-e7e852fa7d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.148571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4b724-1287-4a73-ba14-e7e852fa7d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.149218 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4b724-1287-4a73-ba14-e7e852fa7d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.151121 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4b724-1287-4a73-ba14-e7e852fa7d8f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.169695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91dc1e-1428-4e48-8974-84858a2b84bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.170429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91dc1e-1428-4e48-8974-84858a2b84bd admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.170737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91dc1e-1428-4e48-8974-84858a2b84bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.171028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91dc1e-1428-4e48-8974-84858a2b84bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.171799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91dc1e-1428-4e48-8974-84858a2b84bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:05.172129 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91dc1e-1428-4e48-8974-84858a2b84bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.173750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91dc1e-1428-4e48-8974-84858a2b84bd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.182875 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 777/1571] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:05 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:05.182875 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4b724-1287-4a73-ba14-e7e852fa7d8f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.189013 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 795/1572] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:05.189989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91dc1e-1428-4e48-8974-84858a2b84bd admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.201440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91dc1e-1428-4e48-8974-84858a2b84bd admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.220621 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:05.231497 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:05.244183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4b724-1287-4a73-ba14-e7e852fa7d8f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.249169 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6b3ec-9422-4b48-922c-95c7562d2986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.249760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6b3ec-9422-4b48-922c-95c7562d2986 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.250608 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6b3ec-9422-4b48-922c-95c7562d2986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.251072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6b3ec-9422-4b48-922c-95c7562d2986 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.252084 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6b3ec-9422-4b48-922c-95c7562d2986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.254006 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6b3ec-9422-4b48-922c-95c7562d2986 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.263437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf04af4-8d66-48f5-813c-40eef5265c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.264038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf04af4-8d66-48f5-813c-40eef5265c22 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.264318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf04af4-8d66-48f5-813c-40eef5265c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.264609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf04af4-8d66-48f5-813c-40eef5265c22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.265241 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf04af4-8d66-48f5-813c-40eef5265c22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.267700 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf04af4-8d66-48f5-813c-40eef5265c22 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.284742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 778/1573] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:05 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:05.284742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6b3ec-9422-4b48-922c-95c7562d2986 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.298711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 796/1574] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:05 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:05.300228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e917115-95cf-4dd6-a79e-3d3f122d6404 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.300510 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e917115-95cf-4dd6-a79e-3d3f122d6404 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.300810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e917115-95cf-4dd6-a79e-3d3f122d6404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.327406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8e917115-95cf-4dd6-a79e-3d3f122d6404 None None] MFA Rules not processed for user `acf2c8c1c26a4e069ec29aaaa90d9264`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:05.328690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8e917115-95cf-4dd6-a79e-3d3f122d6404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:05.344966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6b3ec-9422-4b48-922c-95c7562d2986 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.391222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 797/1575] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:05.391957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e917115-95cf-4dd6-a79e-3d3f122d6404 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.400197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00927a2-f9da-4153-999f-78b8c907c5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.400831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00927a2-f9da-4153-999f-78b8c907c5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.401107 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00927a2-f9da-4153-999f-78b8c907c5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.401377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00927a2-f9da-4153-999f-78b8c907c5a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.401991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00927a2-f9da-4153-999f-78b8c907c5a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.403879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00927a2-f9da-4153-999f-78b8c907c5a8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.433223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 779/1576] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:05 2022] POST /identity/v3/users => generated 296 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:05.433223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00927a2-f9da-4153-999f-78b8c907c5a8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.444878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00927a2-f9da-4153-999f-78b8c907c5a8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.449537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba43167-bc54-4bdb-9358-e51d5ae518ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.450116 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba43167-bc54-4bdb-9358-e51d5ae518ec admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.450398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba43167-bc54-4bdb-9358-e51d5ae518ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.450704 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba43167-bc54-4bdb-9358-e51d5ae518ec admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.451444 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba43167-bc54-4bdb-9358-e51d5ae518ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.453363 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba43167-bc54-4bdb-9358-e51d5ae518ec admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.456462 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e917115-95cf-4dd6-a79e-3d3f122d6404 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.460964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c675c-1347-43bc-8834-486d738e1df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.461577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c675c-1347-43bc-8834-486d738e1df0 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.461851 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c675c-1347-43bc-8834-486d738e1df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.462125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c675c-1347-43bc-8834-486d738e1df0 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.462737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c675c-1347-43bc-8834-486d738e1df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.463738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-544c675c-1347-43bc-8834-486d738e1df0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:25:05.463738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: warnings.warn(msg) Aug 11 16:25:05.463738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: Aug 11 16:25:05.464964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c675c-1347-43bc-8834-486d738e1df0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.475988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 780/1577] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:05 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:05.477666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba43167-bc54-4bdb-9358-e51d5ae518ec admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.488926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 798/1578] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:05 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:05.489738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c675c-1347-43bc-8834-486d738e1df0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.490701 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba43167-bc54-4bdb-9358-e51d5ae518ec admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.495550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10e493-4b04-434d-ab28-d6d8c7ff5d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.496145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10e493-4b04-434d-ab28-d6d8c7ff5d51 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.496418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10e493-4b04-434d-ab28-d6d8c7ff5d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.496736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10e493-4b04-434d-ab28-d6d8c7ff5d51 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.497347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10e493-4b04-434d-ab28-d6d8c7ff5d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.499240 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10e493-4b04-434d-ab28-d6d8c7ff5d51 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.499921 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c675c-1347-43bc-8834-486d738e1df0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.505247 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa77937-f39d-4d66-aa14-63964dec611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.505831 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa77937-f39d-4d66-aa14-63964dec611b admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.506108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa77937-f39d-4d66-aa14-63964dec611b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.506378 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa77937-f39d-4d66-aa14-63964dec611b admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.507078 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa77937-f39d-4d66-aa14-63964dec611b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.509184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa77937-f39d-4d66-aa14-63964dec611b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.524425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 781/1579] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:05 2022] POST /identity/v3/users => generated 295 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:05.524425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10e493-4b04-434d-ab28-d6d8c7ff5d51 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.531599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10e493-4b04-434d-ab28-d6d8c7ff5d51 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.536740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eacbd-0726-496c-b7ab-5ee78701a736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.537323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eacbd-0726-496c-b7ab-5ee78701a736 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.537603 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eacbd-0726-496c-b7ab-5ee78701a736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.537871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eacbd-0726-496c-b7ab-5ee78701a736 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.538480 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eacbd-0726-496c-b7ab-5ee78701a736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.540362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eacbd-0726-496c-b7ab-5ee78701a736 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.540856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 799/1580] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:05 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:05.541664 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa77937-f39d-4d66-aa14-63964dec611b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.554670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:05.566492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 782/1581] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:05 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:05.566492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f030af5-3f5a-4d71-8af5-ba5e7a727d4c None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.566492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f030af5-3f5a-4d71-8af5-ba5e7a727d4c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.566492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f030af5-3f5a-4d71-8af5-ba5e7a727d4c None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.567068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 783/1582] 10.222.0.40 () {54 vars in 962 bytes} [Thu Aug 11 16:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:25:05.569385 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f030af5-3f5a-4d71-8af5-ba5e7a727d4c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.575544 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:05.606375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa77937-f39d-4d66-aa14-63964dec611b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.611489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bc11b-3dcb-440e-b67d-e5d9b4f0767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.612110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bc11b-3dcb-440e-b67d-e5d9b4f0767e admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.612383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bc11b-3dcb-440e-b67d-e5d9b4f0767e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.612682 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bc11b-3dcb-440e-b67d-e5d9b4f0767e admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.613307 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bc11b-3dcb-440e-b67d-e5d9b4f0767e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.615599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bc11b-3dcb-440e-b67d-e5d9b4f0767e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.636296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 800/1583] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:05 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:05.636694 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f030af5-3f5a-4d71-8af5-ba5e7a727d4c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.637171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bc11b-3dcb-440e-b67d-e5d9b4f0767e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.641597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b2272-d383-4ebf-a933-9c6125c564ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.642167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b2272-d383-4ebf-a933-9c6125c564ef admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.642438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b2272-d383-4ebf-a933-9c6125c564ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.642702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b2272-d383-4ebf-a933-9c6125c564ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.643332 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b2272-d383-4ebf-a933-9c6125c564ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.644945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b2272-d383-4ebf-a933-9c6125c564ef admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.646816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bc11b-3dcb-440e-b67d-e5d9b4f0767e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.651322 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0edc20-34e2-4a45-ad41-6e756409f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.651899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0edc20-34e2-4a45-ad41-6e756409f42d admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.652173 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0edc20-34e2-4a45-ad41-6e756409f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.652447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0edc20-34e2-4a45-ad41-6e756409f42d admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.653108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0edc20-34e2-4a45-ad41-6e756409f42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.654669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0edc20-34e2-4a45-ad41-6e756409f42d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.655382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 784/1584] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:05.656793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b2272-d383-4ebf-a933-9c6125c564ef admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.668189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 801/1585] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:05.668189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0edc20-34e2-4a45-ad41-6e756409f42d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.668467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b2272-d383-4ebf-a933-9c6125c564ef admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.671318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e5d8b-440d-4361-8baf-ad3af5133453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.671947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e5d8b-440d-4361-8baf-ad3af5133453 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.672760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e5d8b-440d-4361-8baf-ad3af5133453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.673032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e5d8b-440d-4361-8baf-ad3af5133453 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.673653 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e5d8b-440d-4361-8baf-ad3af5133453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.675210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e5d8b-440d-4361-8baf-ad3af5133453 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.676958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0edc20-34e2-4a45-ad41-6e756409f42d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.681516 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bbddc-25bb-4384-9c7d-6fd59576b9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.682082 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bbddc-25bb-4384-9c7d-6fd59576b9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.682357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bbddc-25bb-4384-9c7d-6fd59576b9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.682626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bbddc-25bb-4384-9c7d-6fd59576b9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.683242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bbddc-25bb-4384-9c7d-6fd59576b9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.684822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bbddc-25bb-4384-9c7d-6fd59576b9c8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.685591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 785/1586] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:05.689280 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e5d8b-440d-4361-8baf-ad3af5133453 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.696637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 802/1587] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:05.696637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bbddc-25bb-4384-9c7d-6fd59576b9c8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.699637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e5d8b-440d-4361-8baf-ad3af5133453 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.704488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88130a97-afcb-41dd-9b5a-d5e8b1277775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.705026 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bbddc-25bb-4384-9c7d-6fd59576b9c8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.705141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88130a97-afcb-41dd-9b5a-d5e8b1277775 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.705428 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88130a97-afcb-41dd-9b5a-d5e8b1277775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.705697 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88130a97-afcb-41dd-9b5a-d5e8b1277775 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.706303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88130a97-afcb-41dd-9b5a-d5e8b1277775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.708255 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88130a97-afcb-41dd-9b5a-d5e8b1277775 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.709586 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e0145-d0ba-4d8c-9841-5184122b9fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.710273 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e0145-d0ba-4d8c-9841-5184122b9fde admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.710545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e0145-d0ba-4d8c-9841-5184122b9fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.710811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e0145-d0ba-4d8c-9841-5184122b9fde admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.711434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e0145-d0ba-4d8c-9841-5184122b9fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.713003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e0145-d0ba-4d8c-9841-5184122b9fde admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.724256 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 803/1588] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:05.725456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08935a-4dd0-48ae-9b43-bae7acab3430 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.725748 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08935a-4dd0-48ae-9b43-bae7acab3430 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.726054 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08935a-4dd0-48ae-9b43-bae7acab3430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.729443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 786/1589] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:05 2022] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:05.733073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88130a97-afcb-41dd-9b5a-d5e8b1277775 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.743103 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88130a97-afcb-41dd-9b5a-d5e8b1277775 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.747869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5589e-3fe1-410a-ba3b-990b7202fd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.748444 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5589e-3fe1-410a-ba3b-990b7202fd56 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.748849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5589e-3fe1-410a-ba3b-990b7202fd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.749119 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5589e-3fe1-410a-ba3b-990b7202fd56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.749742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5589e-3fe1-410a-ba3b-990b7202fd56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.751411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5589e-3fe1-410a-ba3b-990b7202fd56 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.761307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 787/1590] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:05.762765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5589e-3fe1-410a-ba3b-990b7202fd56 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.763039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-af08935a-4dd0-48ae-9b43-bae7acab3430 None None] MFA Rules not processed for user `4e91f3fbe098459dba0acf8ec1fb7098`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:05.764278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-af08935a-4dd0-48ae-9b43-bae7acab3430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:05.772359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5589e-3fe1-410a-ba3b-990b7202fd56 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.776865 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68024d-6923-4cfe-9c1e-d49553364f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.777430 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68024d-6923-4cfe-9c1e-d49553364f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.777698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68024d-6923-4cfe-9c1e-d49553364f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.778021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68024d-6923-4cfe-9c1e-d49553364f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.778608 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68024d-6923-4cfe-9c1e-d49553364f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.780139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68024d-6923-4cfe-9c1e-d49553364f05 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.790855 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 788/1591] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:05.791684 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68024d-6923-4cfe-9c1e-d49553364f05 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.801973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68024d-6923-4cfe-9c1e-d49553364f05 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.806467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123cf26-cd14-498a-a7a6-252c0595dc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.807048 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123cf26-cd14-498a-a7a6-252c0595dc86 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.807321 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123cf26-cd14-498a-a7a6-252c0595dc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.807586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123cf26-cd14-498a-a7a6-252c0595dc86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.808207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123cf26-cd14-498a-a7a6-252c0595dc86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.809828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123cf26-cd14-498a-a7a6-252c0595dc86 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.820502 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 789/1592] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:05.821384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123cf26-cd14-498a-a7a6-252c0595dc86 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.830581 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123cf26-cd14-498a-a7a6-252c0595dc86 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.835015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac454d9-3889-4325-a2c7-2a2100966ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.835570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac454d9-3889-4325-a2c7-2a2100966ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.835842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac454d9-3889-4325-a2c7-2a2100966ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.836105 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac454d9-3889-4325-a2c7-2a2100966ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.836748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac454d9-3889-4325-a2c7-2a2100966ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.837549 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 804/1593] 10.222.0.40 () {58 vars in 1059 bytes} [Thu Aug 11 16:25:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:05.838355 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac454d9-3889-4325-a2c7-2a2100966ac1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.838476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08935a-4dd0-48ae-9b43-bae7acab3430 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.851691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 790/1594] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:05.851691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac454d9-3889-4325-a2c7-2a2100966ac1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.853061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08935a-4dd0-48ae-9b43-bae7acab3430 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.857571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab537b-116e-4e07-a39d-3efd63219280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.858153 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab537b-116e-4e07-a39d-3efd63219280 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.858425 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab537b-116e-4e07-a39d-3efd63219280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.858695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab537b-116e-4e07-a39d-3efd63219280 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.858954 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac454d9-3889-4325-a2c7-2a2100966ac1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.859327 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab537b-116e-4e07-a39d-3efd63219280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.861539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab537b-116e-4e07-a39d-3efd63219280 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.864062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a649f42-c01c-400d-8aec-3e7d4d1bd40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.864634 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a649f42-c01c-400d-8aec-3e7d4d1bd40a admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.864912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a649f42-c01c-400d-8aec-3e7d4d1bd40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.865180 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a649f42-c01c-400d-8aec-3e7d4d1bd40a admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.865786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a649f42-c01c-400d-8aec-3e7d4d1bd40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.867323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a649f42-c01c-400d-8aec-3e7d4d1bd40a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.875393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 805/1595] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:05.875393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab537b-116e-4e07-a39d-3efd63219280 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.883254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 791/1596] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:05.883254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a649f42-c01c-400d-8aec-3e7d4d1bd40a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.883509 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab537b-116e-4e07-a39d-3efd63219280 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.886755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3901b5-70e4-47c6-a3ef-be2ef64361bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.887331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3901b5-70e4-47c6-a3ef-be2ef64361bd admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.887606 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3901b5-70e4-47c6-a3ef-be2ef64361bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.887874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3901b5-70e4-47c6-a3ef-be2ef64361bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.888500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3901b5-70e4-47c6-a3ef-be2ef64361bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.890079 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3901b5-70e4-47c6-a3ef-be2ef64361bd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.890991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a649f42-c01c-400d-8aec-3e7d4d1bd40a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.895764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55745fd3-5836-4f17-aa51-2dfb35f4aa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.896308 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55745fd3-5836-4f17-aa51-2dfb35f4aa49 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.896610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55745fd3-5836-4f17-aa51-2dfb35f4aa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.896884 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55745fd3-5836-4f17-aa51-2dfb35f4aa49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.897502 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55745fd3-5836-4f17-aa51-2dfb35f4aa49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.899045 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55745fd3-5836-4f17-aa51-2dfb35f4aa49 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.899814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 806/1597] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:05.900557 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3901b5-70e4-47c6-a3ef-be2ef64361bd admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.911051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3901b5-70e4-47c6-a3ef-be2ef64361bd admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.915214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 792/1598] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:05.915214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55745fd3-5836-4f17-aa51-2dfb35f4aa49 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.918919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af823707-bf03-4c06-a0dc-5f142a94d11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.919558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af823707-bf03-4c06-a0dc-5f142a94d11a admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.919833 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af823707-bf03-4c06-a0dc-5f142a94d11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.920105 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af823707-bf03-4c06-a0dc-5f142a94d11a admin admin] PATH_INFO: `/v3/projects/a80b4ce3aaff4063afa0f7db3812aeb0/users/8f34b288e7b1499ea30c2c87023cb917/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.923163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55745fd3-5836-4f17-aa51-2dfb35f4aa49 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:05.927646 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5a375-3844-4d15-b907-ced6b238e655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:05.928271 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5a375-3844-4d15-b907-ced6b238e655 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:05.928550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5a375-3844-4d15-b907-ced6b238e655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:05.928856 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5a375-3844-4d15-b907-ced6b238e655 admin admin] PATH_INFO: `/v3/projects/707a6776a592409a893497d39eaca81b/users/2a497e12851f43f6b8c265b07b0348c3/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:05.935731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af823707-bf03-4c06-a0dc-5f142a94d11a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80b4ce3aaff4063afa0f7db3812aeb0, user_id=8f34b288e7b1499ea30c2c87023cb917, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.938439 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af823707-bf03-4c06-a0dc-5f142a94d11a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.942785 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5a375-3844-4d15-b907-ced6b238e655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=707a6776a592409a893497d39eaca81b, user_id=2a497e12851f43f6b8c265b07b0348c3, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:05.943801 dv-cinder-852208-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-4dc5a375-3844-4d15-b907-ced6b238e655 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:25:05.943801 dv-cinder-852208-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Aug 11 16:25:05.943801 dv-cinder-852208-4-smb devstack@keystone.service[81409]: Aug 11 16:25:05.945823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5a375-3844-4d15-b907-ced6b238e655 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:05.946997 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:05.952333 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 807/1599] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:05 2022] PUT /identity/v3/projects/a80b4ce3aaff4063afa0f7db3812aeb0/users/8f34b288e7b1499ea30c2c87023cb917/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:05.953489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af823707-bf03-4c06-a0dc-5f142a94d11a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:05.959111 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 793/1600] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:05 2022] PUT /identity/v3/projects/707a6776a592409a893497d39eaca81b/users/2a497e12851f43f6b8c265b07b0348c3/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:05.959740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5a375-3844-4d15-b907-ced6b238e655 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:06.004649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:06.024908 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5a375-3844-4d15-b907-ced6b238e655 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:06.029525 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d92a0-da57-40fb-a33d-af139e8ca467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:06.030198 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d92a0-da57-40fb-a33d-af139e8ca467 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.030577 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d92a0-da57-40fb-a33d-af139e8ca467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.030857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d92a0-da57-40fb-a33d-af139e8ca467 admin admin] PATH_INFO: `/v3/projects/f317f083cc2d4dd2801a266b8c6cdfbe/users/abe49b89481a4d41ac4e74ccbdf50e56/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.034153 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af823707-bf03-4c06-a0dc-5f142a94d11a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:06.045813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d92a0-da57-40fb-a33d-af139e8ca467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f317f083cc2d4dd2801a266b8c6cdfbe, user_id=abe49b89481a4d41ac4e74ccbdf50e56, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:06.048476 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d92a0-da57-40fb-a33d-af139e8ca467 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:06.060996 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 794/1601] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:05 2022] PUT /identity/v3/projects/f317f083cc2d4dd2801a266b8c6cdfbe/users/abe49b89481a4d41ac4e74ccbdf50e56/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:06.061985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d92a0-da57-40fb-a33d-af139e8ca467 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:06.099974 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ba323-f6e6-4ab0-9905-357a82ea6bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:06.100627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ba323-f6e6-4ab0-9905-357a82ea6bc1 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.100938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ba323-f6e6-4ab0-9905-357a82ea6bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.101212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ba323-f6e6-4ab0-9905-357a82ea6bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.123442 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d92a0-da57-40fb-a33d-af139e8ca467 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:06.128028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e5223-d445-4689-b4a4-cd04e9f33ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:06.128690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e5223-d445-4689-b4a4-cd04e9f33ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.128968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e5223-d445-4689-b4a4-cd04e9f33ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.129240 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e5223-d445-4689-b4a4-cd04e9f33ff6 admin admin] PATH_INFO: `/v3/projects/806bc735e276493a92c94d6ae077536a/users/a9f0bcfc9c4b48d98cd3385309adaafb/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.143901 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e5223-d445-4689-b4a4-cd04e9f33ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=806bc735e276493a92c94d6ae077536a, user_id=a9f0bcfc9c4b48d98cd3385309adaafb, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:06.146972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e5223-d445-4689-b4a4-cd04e9f33ff6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:06.159362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ba323-f6e6-4ab0-9905-357a82ea6bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:06.160726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 795/1602] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:06 2022] PUT /identity/v3/projects/806bc735e276493a92c94d6ae077536a/users/a9f0bcfc9c4b48d98cd3385309adaafb/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:06.161522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e5223-d445-4689-b4a4-cd04e9f33ff6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:06.164483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ba323-f6e6-4ab0-9905-357a82ea6bc1 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:06.173614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 808/1603] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:06.174407 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ba323-f6e6-4ab0-9905-357a82ea6bc1 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:06.183966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ba323-f6e6-4ab0-9905-357a82ea6bc1 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:06.222287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e5223-d445-4689-b4a4-cd04e9f33ff6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:06.225302 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:06.227458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921c9ee-da90-42e0-8b64-f60a76ea09de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:06.228120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921c9ee-da90-42e0-8b64-f60a76ea09de admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.228365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921c9ee-da90-42e0-8b64-f60a76ea09de admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.228662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921c9ee-da90-42e0-8b64-f60a76ea09de admin admin] PATH_INFO: `/v3/projects/cd71348ec34843408b412b1e7c09cf17/users/a18909e123914a83a7388802cd9938df/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.244377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921c9ee-da90-42e0-8b64-f60a76ea09de admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd71348ec34843408b412b1e7c09cf17, user_id=a18909e123914a83a7388802cd9938df, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:06.247046 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921c9ee-da90-42e0-8b64-f60a76ea09de admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:06.252270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53c5fa-7b3c-4d76-a498-1fe23832b63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:06.253172 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53c5fa-7b3c-4d76-a498-1fe23832b63e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.253545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53c5fa-7b3c-4d76-a498-1fe23832b63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.253888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53c5fa-7b3c-4d76-a498-1fe23832b63e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.254718 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53c5fa-7b3c-4d76-a498-1fe23832b63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:06.256429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53c5fa-7b3c-4d76-a498-1fe23832b63e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:06.260299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 796/1604] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:06 2022] PUT /identity/v3/projects/cd71348ec34843408b412b1e7c09cf17/users/a18909e123914a83a7388802cd9938df/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:06.261005 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921c9ee-da90-42e0-8b64-f60a76ea09de admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:06.279171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 809/1605] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:06.282475 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc4a92-0be7-44a3-a58c-3854edbba7ff None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.283546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc4a92-0be7-44a3-a58c-3854edbba7ff None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.284371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc4a92-0be7-44a3-a58c-3854edbba7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.296685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:06.309639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6edc4a92-0be7-44a3-a58c-3854edbba7ff None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:06.311886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6edc4a92-0be7-44a3-a58c-3854edbba7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:06.329657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921c9ee-da90-42e0-8b64-f60a76ea09de admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:06.336027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96744c-f995-4170-875f-673ab7f2e44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:06.336716 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96744c-f995-4170-875f-673ab7f2e44a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.336999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96744c-f995-4170-875f-673ab7f2e44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.337274 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96744c-f995-4170-875f-673ab7f2e44a admin admin] PATH_INFO: `/v3/projects/3ac4a068b20546558778972470db02bb/users/46c32bf22365485e93168e1ec7fd80ae/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.356848 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96744c-f995-4170-875f-673ab7f2e44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac4a068b20546558778972470db02bb, user_id=46c32bf22365485e93168e1ec7fd80ae, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:06.359496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96744c-f995-4170-875f-673ab7f2e44a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:06.372356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 797/1606] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:06 2022] PUT /identity/v3/projects/3ac4a068b20546558778972470db02bb/users/46c32bf22365485e93168e1ec7fd80ae/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:06.373413 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898270c2-420c-42b3-9238-b989c086801b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.373724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898270c2-420c-42b3-9238-b989c086801b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.373958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898270c2-420c-42b3-9238-b989c086801b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.380525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 810/1607] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:06.385008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55a98a-ec8e-49b9-b874-f77bb2016cff None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.385297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55a98a-ec8e-49b9-b874-f77bb2016cff None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.385574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55a98a-ec8e-49b9-b874-f77bb2016cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.404230 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-898270c2-420c-42b3-9238-b989c086801b None None] MFA Rules not processed for user `2a497e12851f43f6b8c265b07b0348c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:06.405563 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-898270c2-420c-42b3-9238-b989c086801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:06.406190 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5b55a98a-ec8e-49b9-b874-f77bb2016cff None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:06.408284 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5b55a98a-ec8e-49b9-b874-f77bb2016cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:06.470132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 798/1608] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:06.471767 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd087675-8354-4646-b9b7-ece4c85b1abc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.472221 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd087675-8354-4646-b9b7-ece4c85b1abc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.472331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 811/1609] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:06.472758 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd087675-8354-4646-b9b7-ece4c85b1abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.474028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad41feb-d2a9-41da-9826-825331d25f85 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.474309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad41feb-d2a9-41da-9826-825331d25f85 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.474577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad41feb-d2a9-41da-9826-825331d25f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.494684 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-cd087675-8354-4646-b9b7-ece4c85b1abc None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:06.496214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cd087675-8354-4646-b9b7-ece4c85b1abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:06.504822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4ad41feb-d2a9-41da-9826-825331d25f85 None None] MFA Rules not processed for user `a18909e123914a83a7388802cd9938df`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:06.506191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4ad41feb-d2a9-41da-9826-825331d25f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:06.512489 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 799/1610] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:06.516953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd087675-8354-4646-b9b7-ece4c85b1abc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:06.527159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd087675-8354-4646-b9b7-ece4c85b1abc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:06.531942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a72a1-83a5-422d-a795-a0c1f8c63479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:06.533001 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a72a1-83a5-422d-a795-a0c1f8c63479 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.533347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a72a1-83a5-422d-a795-a0c1f8c63479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.533687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a72a1-83a5-422d-a795-a0c1f8c63479 admin admin] PATH_INFO: `/v3/projects/e86b8ea96eab4b46bd1c76c6dbe7f716/users/7b0f9418982c4a8e8ebd5cf4419c5418/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.548212 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a72a1-83a5-422d-a795-a0c1f8c63479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86b8ea96eab4b46bd1c76c6dbe7f716, user_id=7b0f9418982c4a8e8ebd5cf4419c5418, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:06.550882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a72a1-83a5-422d-a795-a0c1f8c63479 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:06.564349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 800/1611] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:06 2022] PUT /identity/v3/projects/e86b8ea96eab4b46bd1c76c6dbe7f716/users/7b0f9418982c4a8e8ebd5cf4419c5418/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:06.565652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3dec1-8cb6-450a-91e8-6146ca3113d1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.565945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3dec1-8cb6-450a-91e8-6146ca3113d1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.566219 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3dec1-8cb6-450a-91e8-6146ca3113d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.578905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 812/1612] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:06.579647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad41feb-d2a9-41da-9826-825331d25f85 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:06.583689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:06.586523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-02c3dec1-8cb6-450a-91e8-6146ca3113d1 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:06.587778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-02c3dec1-8cb6-450a-91e8-6146ca3113d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:06.633751 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad41feb-d2a9-41da-9826-825331d25f85 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:06.646270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 801/1613] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:06.649528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1981f7d-d849-4bc5-8843-921fd7e52c78 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.649528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1981f7d-d849-4bc5-8843-921fd7e52c78 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.649528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1981f7d-d849-4bc5-8843-921fd7e52c78 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.649528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 802/1614] 10.222.0.40 () {54 vars in 912 bytes} [Thu Aug 11 16:25:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:25:06.649945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1981f7d-d849-4bc5-8843-921fd7e52c78 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:06.664571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:06.688487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee84b8-c20c-47b1-befa-90d164de5104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:06.689123 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee84b8-c20c-47b1-befa-90d164de5104 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.689397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee84b8-c20c-47b1-befa-90d164de5104 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.689664 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee84b8-c20c-47b1-befa-90d164de5104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.698992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee84b8-c20c-47b1-befa-90d164de5104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:06.700451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee84b8-c20c-47b1-befa-90d164de5104 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:06.707905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1981f7d-d849-4bc5-8843-921fd7e52c78 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:06.710387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 813/1615] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:06.711558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb993b1-f342-4a97-ba7e-fe8a249a9d44 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.711700 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf64c9-e272-4950-85cb-66087fd5c2ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:06.711813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb993b1-f342-4a97-ba7e-fe8a249a9d44 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.712047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb993b1-f342-4a97-ba7e-fe8a249a9d44 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.712191 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf64c9-e272-4950-85cb-66087fd5c2ef service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.712795 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf64c9-e272-4950-85cb-66087fd5c2ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.713071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf64c9-e272-4950-85cb-66087fd5c2ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.713417 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 814/1616] 10.222.0.40 () {54 vars in 962 bytes} [Thu Aug 11 16:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:25:06.713990 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb993b1-f342-4a97-ba7e-fe8a249a9d44 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:06.722868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf64c9-e272-4950-85cb-66087fd5c2ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:06.724047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb993b1-f342-4a97-ba7e-fe8a249a9d44 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:06.724463 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf64c9-e272-4950-85cb-66087fd5c2ef service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:06.727617 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79dec2-9f03-499c-a74e-6fdf589080fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:06.728184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79dec2-9f03-499c-a74e-6fdf589080fe service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.728458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79dec2-9f03-499c-a74e-6fdf589080fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.728756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79dec2-9f03-499c-a74e-6fdf589080fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.734835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 803/1617] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:06.735913 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84f09d-a2dd-40e2-97c1-3f8da9c3560d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.736186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84f09d-a2dd-40e2-97c1-3f8da9c3560d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.736459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84f09d-a2dd-40e2-97c1-3f8da9c3560d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.739696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79dec2-9f03-499c-a74e-6fdf589080fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:06.741152 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79dec2-9f03-499c-a74e-6fdf589080fe service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:06.753434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 815/1618] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:06.754409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79dec2-9f03-499c-a74e-6fdf589080fe service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:06.757122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ab84f09d-a2dd-40e2-97c1-3f8da9c3560d None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:06.758363 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ab84f09d-a2dd-40e2-97c1-3f8da9c3560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:06.764527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79dec2-9f03-499c-a74e-6fdf589080fe service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:06.768066 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 804/1619] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:06.769408 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c740a-2f28-4648-bce5-ad066d3190a4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.769743 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c740a-2f28-4648-bce5-ad066d3190a4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.770090 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c740a-2f28-4648-bce5-ad066d3190a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.781777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1a952-f299-4100-baa1-9efea50ab118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:06.782404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1a952-f299-4100-baa1-9efea50ab118 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.782979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1a952-f299-4100-baa1-9efea50ab118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.783251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1a952-f299-4100-baa1-9efea50ab118 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.783928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1a952-f299-4100-baa1-9efea50ab118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:06.785952 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1a952-f299-4100-baa1-9efea50ab118 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:06.793460 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-600c740a-2f28-4648-bce5-ad066d3190a4 None None] MFA Rules not processed for user `4e91f3fbe098459dba0acf8ec1fb7098`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:06.794709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-600c740a-2f28-4648-bce5-ad066d3190a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:06.824033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 816/1620] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:06 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:06.824033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1a952-f299-4100-baa1-9efea50ab118 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:06.879437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 805/1621] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Aug 11 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:06.881345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21379-4a1e-4721-9679-edcf50e20f43 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.881895 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21379-4a1e-4721-9679-edcf50e20f43 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.882388 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21379-4a1e-4721-9679-edcf50e20f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.891584 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1a952-f299-4100-baa1-9efea50ab118 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:06.896155 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce1c98-fb68-4614-820d-902d0a92f2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:06.897034 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce1c98-fb68-4614-820d-902d0a92f2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:06.897522 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce1c98-fb68-4614-820d-902d0a92f2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:06.897803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce1c98-fb68-4614-820d-902d0a92f2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:06.906066 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-83f21379-4a1e-4721-9679-edcf50e20f43 None None] MFA Rules not processed for user `4e91f3fbe098459dba0acf8ec1fb7098`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:06.907338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-83f21379-4a1e-4721-9679-edcf50e20f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:06.950841 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:06.979121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce1c98-fb68-4614-820d-902d0a92f2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:06.980833 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce1c98-fb68-4614-820d-902d0a92f2a7 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:06.993269 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 817/1622] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:06.993947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce1c98-fb68-4614-820d-902d0a92f2a7 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:06.995441 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c4ce1c98-fb68-4614-820d-902d0a92f2a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:06.997652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 806/1623] 10.222.0.40 () {58 vars in 1059 bytes} [Thu Aug 11 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:06.998652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f21379-4a1e-4721-9679-edcf50e20f43 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:07.010171 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f21379-4a1e-4721-9679-edcf50e20f43 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:07.012157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce1c98-fb68-4614-820d-902d0a92f2a7 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:07.016771 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3c016-bb3b-40b1-bdb9-cae6d2a49f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:07.016953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b799b2d-5181-4521-9d88-6377cb28d132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:07.017384 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3c016-bb3b-40b1-bdb9-cae6d2a49f66 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:07.017504 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b799b2d-5181-4521-9d88-6377cb28d132 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:07.017685 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3c016-bb3b-40b1-bdb9-cae6d2a49f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:07.017793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b799b2d-5181-4521-9d88-6377cb28d132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:07.017980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3c016-bb3b-40b1-bdb9-cae6d2a49f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:07.018084 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b799b2d-5181-4521-9d88-6377cb28d132 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:07.018694 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b799b2d-5181-4521-9d88-6377cb28d132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:07.020891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b799b2d-5181-4521-9d88-6377cb28d132 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:07.029081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3c016-bb3b-40b1-bdb9-cae6d2a49f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:07.030694 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3c016-bb3b-40b1-bdb9-cae6d2a49f66 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:07.043464 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 818/1624] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:07.045774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3c016-bb3b-40b1-bdb9-cae6d2a49f66 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:07.054075 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 807/1625] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:06 2022] POST /identity/v3/users => generated 293 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:07.055008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b799b2d-5181-4521-9d88-6377cb28d132 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:07.070858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b799b2d-5181-4521-9d88-6377cb28d132 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:07.083394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2cd62-c204-4ade-b337-cfcce36aca89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:07.084937 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2cd62-c204-4ade-b337-cfcce36aca89 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:07.086582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2cd62-c204-4ade-b337-cfcce36aca89 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:07.087582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2cd62-c204-4ade-b337-cfcce36aca89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:07.110787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:07.130994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3c016-bb3b-40b1-bdb9-cae6d2a49f66 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:07.137198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a6b23-35d7-4f61-9eaa-9178802dd532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:07.138795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a6b23-35d7-4f61-9eaa-9178802dd532 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:07.139197 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a6b23-35d7-4f61-9eaa-9178802dd532 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:07.139479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a6b23-35d7-4f61-9eaa-9178802dd532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:07.161571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a6b23-35d7-4f61-9eaa-9178802dd532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:07.163061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a6b23-35d7-4f61-9eaa-9178802dd532 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:07.177650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 819/1626] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:07.178614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a6b23-35d7-4f61-9eaa-9178802dd532 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:07.188760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2cd62-c204-4ade-b337-cfcce36aca89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:07.190701 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2cd62-c204-4ade-b337-cfcce36aca89 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:07.190863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a6b23-35d7-4f61-9eaa-9178802dd532 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:07.195527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393297ee-4d0a-48c2-9275-68a7b7944396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:07.196132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393297ee-4d0a-48c2-9275-68a7b7944396 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:07.196410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393297ee-4d0a-48c2-9275-68a7b7944396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:07.196912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393297ee-4d0a-48c2-9275-68a7b7944396 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:07.197559 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393297ee-4d0a-48c2-9275-68a7b7944396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:07.199655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393297ee-4d0a-48c2-9275-68a7b7944396 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:07.202980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 808/1627] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:07.210967 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 820/1628] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:07.215517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2cd62-c204-4ade-b337-cfcce36aca89 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:07.227626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2cd62-c204-4ade-b337-cfcce36aca89 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:07.233099 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4337b7-3a6b-481b-a43c-2d72f2d1ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:07.233799 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4337b7-3a6b-481b-a43c-2d72f2d1ae7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:07.234094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4337b7-3a6b-481b-a43c-2d72f2d1ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:07.234425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4337b7-3a6b-481b-a43c-2d72f2d1ae7a admin admin] PATH_INFO: `/v3/projects/28df32f2c28a4bff8fd66c307ad824f3/users/e818a574a94c4afba0520c4626f510d8/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:07.253214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4337b7-3a6b-481b-a43c-2d72f2d1ae7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=28df32f2c28a4bff8fd66c307ad824f3, user_id=e818a574a94c4afba0520c4626f510d8, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:07.257059 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4337b7-3a6b-481b-a43c-2d72f2d1ae7a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:07.279551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 809/1629] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:07 2022] PUT /identity/v3/projects/28df32f2c28a4bff8fd66c307ad824f3/users/e818a574a94c4afba0520c4626f510d8/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:07.284279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393297ee-4d0a-48c2-9275-68a7b7944396 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:07.298305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393297ee-4d0a-48c2-9275-68a7b7944396 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:07.419898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23b6e4-c617-491f-bd8b-2fb065c2e136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:07.420232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23b6e4-c617-491f-bd8b-2fb065c2e136 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:07.420523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23b6e4-c617-491f-bd8b-2fb065c2e136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:07.420842 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23b6e4-c617-491f-bd8b-2fb065c2e136 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:07.421620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23b6e4-c617-491f-bd8b-2fb065c2e136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:07.423812 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23b6e4-c617-491f-bd8b-2fb065c2e136 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:07.453763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4337b7-3a6b-481b-a43c-2d72f2d1ae7a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:07.461546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 821/1630] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:07.468487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4337b7-3a6b-481b-a43c-2d72f2d1ae7a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:07.481467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70218fca-6556-4c64-a3e8-ec72e2acb8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:07.482389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218fca-6556-4c64-a3e8-ec72e2acb8fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:07.488872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218fca-6556-4c64-a3e8-ec72e2acb8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:07.488872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218fca-6556-4c64-a3e8-ec72e2acb8fd admin admin] PATH_INFO: `/v3/projects/28df32f2c28a4bff8fd66c307ad824f3/users/e818a574a94c4afba0520c4626f510d8/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:07.488872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70218fca-6556-4c64-a3e8-ec72e2acb8fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=28df32f2c28a4bff8fd66c307ad824f3, user_id=e818a574a94c4afba0520c4626f510d8, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:07.491762 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70218fca-6556-4c64-a3e8-ec72e2acb8fd admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:07.501296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea4f02-fd99-4025-9637-5e932e553cc4 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:07.501587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea4f02-fd99-4025-9637-5e932e553cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:07.501862 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea4f02-fd99-4025-9637-5e932e553cc4 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:07.503257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 822/1631] 10.222.0.40 () {54 vars in 912 bytes} [Thu Aug 11 16:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:25:07.510899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf734f-6799-432a-915f-e5854641ec98 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:07.511197 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf734f-6799-432a-915f-e5854641ec98 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:07.511467 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf734f-6799-432a-915f-e5854641ec98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:07.537481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 810/1632] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:07 2022] PUT /identity/v3/projects/28df32f2c28a4bff8fd66c307ad824f3/users/e818a574a94c4afba0520c4626f510d8/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:07.547533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a99068-964d-42a1-a066-959b6001b9bb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:07.547827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a99068-964d-42a1-a066-959b6001b9bb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:07.548199 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a99068-964d-42a1-a066-959b6001b9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:07.556800 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-dacf734f-6799-432a-915f-e5854641ec98 None None] MFA Rules not processed for user `4e91f3fbe098459dba0acf8ec1fb7098`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:07.625911 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dacf734f-6799-432a-915f-e5854641ec98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:07.631504 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-37a99068-964d-42a1-a066-959b6001b9bb None None] MFA Rules not processed for user `e818a574a94c4afba0520c4626f510d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:07.633604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-37a99068-964d-42a1-a066-959b6001b9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:07.683505 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:07.736157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 823/1633] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Aug 11 16:25:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:07.751702 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf734f-6799-432a-915f-e5854641ec98 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:07.827858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 811/1634] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:25:07.887806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf734f-6799-432a-915f-e5854641ec98 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:07.897038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d514b-5e9f-40e8-90f4-e8d7d6f57d56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:07.897980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d514b-5e9f-40e8-90f4-e8d7d6f57d56 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:07.899056 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d514b-5e9f-40e8-90f4-e8d7d6f57d56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:07.899849 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d514b-5e9f-40e8-90f4-e8d7d6f57d56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:07.927420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d514b-5e9f-40e8-90f4-e8d7d6f57d56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:07.928896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d514b-5e9f-40e8-90f4-e8d7d6f57d56 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:07.948447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 824/1635] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:25:08.030233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a99068-964d-42a1-a066-959b6001b9bb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:08.056626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a99068-964d-42a1-a066-959b6001b9bb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:08.067823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61214cfd-61ff-43ca-a0c1-f16dbb548e1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:08.071539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61214cfd-61ff-43ca-a0c1-f16dbb548e1f service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:08.072119 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61214cfd-61ff-43ca-a0c1-f16dbb548e1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:08.073156 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61214cfd-61ff-43ca-a0c1-f16dbb548e1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:08.101025 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61214cfd-61ff-43ca-a0c1-f16dbb548e1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:08.106367 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61214cfd-61ff-43ca-a0c1-f16dbb548e1f service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:08.131381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 812/1636] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:08.505183 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d514b-5e9f-40e8-90f4-e8d7d6f57d56 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:08.515274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d514b-5e9f-40e8-90f4-e8d7d6f57d56 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:08.520632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08002dc7-1cb0-4ceb-b04f-5f83b398de18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:08.521312 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08002dc7-1cb0-4ceb-b04f-5f83b398de18 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:08.521627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08002dc7-1cb0-4ceb-b04f-5f83b398de18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:08.521901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08002dc7-1cb0-4ceb-b04f-5f83b398de18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:08.628935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08002dc7-1cb0-4ceb-b04f-5f83b398de18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:08.631014 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08002dc7-1cb0-4ceb-b04f-5f83b398de18 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:08.648825 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 825/1637] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:09.291990 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97e531-eec8-492d-8034-3b9ab32bf5ac None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:09.292691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97e531-eec8-492d-8034-3b9ab32bf5ac None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:09.293160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97e531-eec8-492d-8034-3b9ab32bf5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:09.324432 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4f97e531-eec8-492d-8034-3b9ab32bf5ac None None] MFA Rules not processed for user `46c32bf22365485e93168e1ec7fd80ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:09.325934 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4f97e531-eec8-492d-8034-3b9ab32bf5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:09.368386 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:09.405234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 813/1638] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:09 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:09.409729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08002dc7-1cb0-4ceb-b04f-5f83b398de18 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:09.490340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08002dc7-1cb0-4ceb-b04f-5f83b398de18 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:09.496294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69f685-dc7b-432c-8c1c-1e412994a32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:09.497241 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69f685-dc7b-432c-8c1c-1e412994a32b admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:09.497637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69f685-dc7b-432c-8c1c-1e412994a32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:09.497909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69f685-dc7b-432c-8c1c-1e412994a32b admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:09.498540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69f685-dc7b-432c-8c1c-1e412994a32b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:09.505271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69f685-dc7b-432c-8c1c-1e412994a32b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:09.538648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 826/1639] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:09 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:09.542580 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97e531-eec8-492d-8034-3b9ab32bf5ac None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:09.554974 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97e531-eec8-492d-8034-3b9ab32bf5ac None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:09.679767 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454ab8a-eb3d-4846-9196-22269e9c24f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:09.680389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454ab8a-eb3d-4846-9196-22269e9c24f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:09.680784 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454ab8a-eb3d-4846-9196-22269e9c24f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:09.680998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454ab8a-eb3d-4846-9196-22269e9c24f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:09.681599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454ab8a-eb3d-4846-9196-22269e9c24f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:09.683512 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454ab8a-eb3d-4846-9196-22269e9c24f0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:09.715778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 814/1640] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:09 2022] POST /identity/v3/users => generated 309 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:09.722872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69f685-dc7b-432c-8c1c-1e412994a32b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:09.737341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69f685-dc7b-432c-8c1c-1e412994a32b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:09.744029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd5bcb-8d8a-44bd-884c-9d9ca1a426b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:09.744904 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd5bcb-8d8a-44bd-884c-9d9ca1a426b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:09.745331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd5bcb-8d8a-44bd-884c-9d9ca1a426b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:09.745917 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd5bcb-8d8a-44bd-884c-9d9ca1a426b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:09.746727 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd5bcb-8d8a-44bd-884c-9d9ca1a426b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:09.748482 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd5bcb-8d8a-44bd-884c-9d9ca1a426b2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:09.751126 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:09.767592 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 827/1641] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:09.768268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454ab8a-eb3d-4846-9196-22269e9c24f0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:09.780270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454ab8a-eb3d-4846-9196-22269e9c24f0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:09.789258 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9485f-4252-40fa-a58e-618bd83075b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:09.790029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9485f-4252-40fa-a58e-618bd83075b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:09.790674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9485f-4252-40fa-a58e-618bd83075b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:09.790674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9485f-4252-40fa-a58e-618bd83075b9 admin admin] PATH_INFO: `/v3/projects/9b7c056f41284ff4a039196cefae1187/users/bb535ca61c4347168b5f44733401f12e/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:09.810502 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9485f-4252-40fa-a58e-618bd83075b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7c056f41284ff4a039196cefae1187, user_id=bb535ca61c4347168b5f44733401f12e, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:09.814928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9485f-4252-40fa-a58e-618bd83075b9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:09.847376 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 815/1642] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:09 2022] PUT /identity/v3/projects/9b7c056f41284ff4a039196cefae1187/users/bb535ca61c4347168b5f44733401f12e/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:09.851487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd5bcb-8d8a-44bd-884c-9d9ca1a426b2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:09.862449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd5bcb-8d8a-44bd-884c-9d9ca1a426b2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:09.931829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bce8a-08af-4116-9bd1-251131e15346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:09.932452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bce8a-08af-4116-9bd1-251131e15346 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:09.932767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bce8a-08af-4116-9bd1-251131e15346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:09.933037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bce8a-08af-4116-9bd1-251131e15346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:09.933687 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23bce8a-08af-4116-9bd1-251131e15346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:09.935491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23bce8a-08af-4116-9bd1-251131e15346 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:09.946428 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 828/1643] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:09.950886 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9485f-4252-40fa-a58e-618bd83075b9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:09.978019 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9485f-4252-40fa-a58e-618bd83075b9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:09.991416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b163757-ea18-4307-aee6-3ffcd81f667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:09.992097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163757-ea18-4307-aee6-3ffcd81f667e admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:09.992376 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163757-ea18-4307-aee6-3ffcd81f667e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:09.992677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163757-ea18-4307-aee6-3ffcd81f667e admin admin] PATH_INFO: `/v3/projects/9b7c056f41284ff4a039196cefae1187/users/bb535ca61c4347168b5f44733401f12e/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:09.998420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b163757-ea18-4307-aee6-3ffcd81f667e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7c056f41284ff4a039196cefae1187, user_id=bb535ca61c4347168b5f44733401f12e, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:10.005825 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b163757-ea18-4307-aee6-3ffcd81f667e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:10.041797 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 816/1644] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:09 2022] PUT /identity/v3/projects/9b7c056f41284ff4a039196cefae1187/users/bb535ca61c4347168b5f44733401f12e/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:11.986016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bce8a-08af-4116-9bd1-251131e15346 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:11.986016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bce8a-08af-4116-9bd1-251131e15346 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:12.115908 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa887042-7062-4406-a7a5-0b8b7ffc2f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:12.116797 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa887042-7062-4406-a7a5-0b8b7ffc2f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:12.117083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa887042-7062-4406-a7a5-0b8b7ffc2f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:12.117359 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa887042-7062-4406-a7a5-0b8b7ffc2f9e admin admin] PATH_INFO: `/v3/users/2a497e12851f43f6b8c265b07b0348c3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:12.119507 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa887042-7062-4406-a7a5-0b8b7ffc2f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a497e12851f43f6b8c265b07b0348c3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:12.122574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa887042-7062-4406-a7a5-0b8b7ffc2f9e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:12.264680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-aa887042-7062-4406-a7a5-0b8b7ffc2f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a497e12851f43f6b8c265b07b0348c3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:12.302996 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-aa887042-7062-4406-a7a5-0b8b7ffc2f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a497e12851f43f6b8c265b07b0348c3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:12.317730 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-aa887042-7062-4406-a7a5-0b8b7ffc2f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a497e12851f43f6b8c265b07b0348c3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:12.337115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-aa887042-7062-4406-a7a5-0b8b7ffc2f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a497e12851f43f6b8c265b07b0348c3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:12.338300 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-aa887042-7062-4406-a7a5-0b8b7ffc2f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a497e12851f43f6b8c265b07b0348c3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:12.359294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 829/1645] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:11 2022] DELETE /identity/v3/users/2a497e12851f43f6b8c265b07b0348c3 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:12.363773 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84162769-77ec-416a-b174-2d7a6e83e942 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:12.364307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84162769-77ec-416a-b174-2d7a6e83e942 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:12.364307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84162769-77ec-416a-b174-2d7a6e83e942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:12.394399 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-84162769-77ec-416a-b174-2d7a6e83e942 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:12.395642 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-84162769-77ec-416a-b174-2d7a6e83e942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:12.597382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 817/1646] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:12.660404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa887042-7062-4406-a7a5-0b8b7ffc2f9e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:12.662116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-aa887042-7062-4406-a7a5-0b8b7ffc2f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:12.710986 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:12.875585 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa887042-7062-4406-a7a5-0b8b7ffc2f9e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:12.889442 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc69ae-a7d7-4a72-bf79-767c204ff0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:12.893713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc69ae-a7d7-4a72-bf79-767c204ff0be service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:12.894458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc69ae-a7d7-4a72-bf79-767c204ff0be service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:12.895771 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc69ae-a7d7-4a72-bf79-767c204ff0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:12.936543 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc69ae-a7d7-4a72-bf79-767c204ff0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:12.940959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc69ae-a7d7-4a72-bf79-767c204ff0be service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:12.969147 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 830/1647] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:13.579254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84162769-77ec-416a-b174-2d7a6e83e942 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:13.580943 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-84162769-77ec-416a-b174-2d7a6e83e942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:13.610178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84162769-77ec-416a-b174-2d7a6e83e942 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:13.633792 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2eb7a-44d6-4e4b-9688-b61e4c32d2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:13.635373 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2eb7a-44d6-4e4b-9688-b61e4c32d2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:13.635889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2eb7a-44d6-4e4b-9688-b61e4c32d2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:13.636367 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2eb7a-44d6-4e4b-9688-b61e4c32d2ca admin admin] PATH_INFO: `/v3/users/acf2c8c1c26a4e069ec29aaaa90d9264` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:13.638262 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2eb7a-44d6-4e4b-9688-b61e4c32d2ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf2c8c1c26a4e069ec29aaaa90d9264)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:13.642824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-1cd2eb7a-44d6-4e4b-9688-b61e4c32d2ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:25:13.642824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Aug 11 16:25:13.642824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: Aug 11 16:25:13.652071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2eb7a-44d6-4e4b-9688-b61e4c32d2ca admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:13.818049 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:13.876865 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1cd2eb7a-44d6-4e4b-9688-b61e4c32d2ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf2c8c1c26a4e069ec29aaaa90d9264'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:13.922290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1cd2eb7a-44d6-4e4b-9688-b61e4c32d2ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf2c8c1c26a4e069ec29aaaa90d9264'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:13.996825 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1cd2eb7a-44d6-4e4b-9688-b61e4c32d2ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf2c8c1c26a4e069ec29aaaa90d9264'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:14.049867 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1cd2eb7a-44d6-4e4b-9688-b61e4c32d2ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf2c8c1c26a4e069ec29aaaa90d9264'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:14.052146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1cd2eb7a-44d6-4e4b-9688-b61e4c32d2ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf2c8c1c26a4e069ec29aaaa90d9264'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:14.061214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 818/1648] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:13 2022] DELETE /identity/v3/users/acf2c8c1c26a4e069ec29aaaa90d9264 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:14.066117 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2e7e-78bd-4302-ad25-41272beae50d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:14.066637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2e7e-78bd-4302-ad25-41272beae50d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:14.066637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2e7e-78bd-4302-ad25-41272beae50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:14.112806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-39cb2e7e-78bd-4302-ad25-41272beae50d None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:14.114069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-39cb2e7e-78bd-4302-ad25-41272beae50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:14.287640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2eb7a-44d6-4e4b-9688-b61e4c32d2ca admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:14.289318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1cd2eb7a-44d6-4e4b-9688-b61e4c32d2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:14.331321 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2eb7a-44d6-4e4b-9688-b61e4c32d2ca admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:14.332036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 831/1649] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:14.352265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1234c82-f471-4038-8ed8-6fe5ac81d438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:14.355027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1234c82-f471-4038-8ed8-6fe5ac81d438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:14.356998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1234c82-f471-4038-8ed8-6fe5ac81d438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:14.357295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1234c82-f471-4038-8ed8-6fe5ac81d438 admin admin] PATH_INFO: `/v3/projects/707a6776a592409a893497d39eaca81b` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:14.359621 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1234c82-f471-4038-8ed8-6fe5ac81d438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=707a6776a592409a893497d39eaca81b)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:14.365599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1234c82-f471-4038-8ed8-6fe5ac81d438 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:14.418233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb2e7e-78bd-4302-ad25-41272beae50d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:14.419677 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-39cb2e7e-78bd-4302-ad25-41272beae50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:14.506719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c1234c82-f471-4038-8ed8-6fe5ac81d438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707a6776a592409a893497d39eaca81b', 'request_id': 'req-c1234c82-f471-4038-8ed8-6fe5ac81d438'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:14.535099 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c1234c82-f471-4038-8ed8-6fe5ac81d438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707a6776a592409a893497d39eaca81b', 'request_id': 'req-c1234c82-f471-4038-8ed8-6fe5ac81d438'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:14.563834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb2e7e-78bd-4302-ad25-41272beae50d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:14.564821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c1234c82-f471-4038-8ed8-6fe5ac81d438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707a6776a592409a893497d39eaca81b', 'request_id': 'req-c1234c82-f471-4038-8ed8-6fe5ac81d438'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:14.586735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c1234c82-f471-4038-8ed8-6fe5ac81d438 admin admin] The token cache is being invalidate because project 707a6776a592409a893497d39eaca81b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:14.588162 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c1234c82-f471-4038-8ed8-6fe5ac81d438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:14.589087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c1234c82-f471-4038-8ed8-6fe5ac81d438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:14.591319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 819/1650] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:14 2022] DELETE /identity/v3/projects/707a6776a592409a893497d39eaca81b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:14.596667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a9138-19ea-4676-8720-b65f65bbeaca None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:14.597267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a9138-19ea-4676-8720-b65f65bbeaca None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:14.598255 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a9138-19ea-4676-8720-b65f65bbeaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:14.647198 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a95a9138-19ea-4676-8720-b65f65bbeaca None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:14.652368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a95a9138-19ea-4676-8720-b65f65bbeaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:14.676773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d6667-378d-49f9-b59b-44325850f93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:14.677853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d6667-378d-49f9-b59b-44325850f93f service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:14.679215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d6667-378d-49f9-b59b-44325850f93f service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:14.679816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d6667-378d-49f9-b59b-44325850f93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:14.683444 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-490d6667-378d-49f9-b59b-44325850f93f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:14.755243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:14.835326 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 820/1651] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:25:14.838690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3c379-d4e3-4516-afcb-292c392b9be8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:14.839942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3c379-d4e3-4516-afcb-292c392b9be8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:14.839942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3c379-d4e3-4516-afcb-292c392b9be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:14.861818 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1ed3c379-d4e3-4516-afcb-292c392b9be8 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:14.863129 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1ed3c379-d4e3-4516-afcb-292c392b9be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:14.872283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 821/1652] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:25:14.882355 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3c379-d4e3-4516-afcb-292c392b9be8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:14.903985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3c379-d4e3-4516-afcb-292c392b9be8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:14.925223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e48235-d941-458f-8fa6-8811aedf1395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:14.926210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e48235-d941-458f-8fa6-8811aedf1395 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:14.926690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e48235-d941-458f-8fa6-8811aedf1395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:14.927178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e48235-d941-458f-8fa6-8811aedf1395 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:14.928192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e48235-d941-458f-8fa6-8811aedf1395 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:14.928756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e48235-d941-458f-8fa6-8811aedf1395 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:14.930568 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e48235-d941-458f-8fa6-8811aedf1395 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:14.944760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d6667-378d-49f9-b59b-44325850f93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:14.946291 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d6667-378d-49f9-b59b-44325850f93f service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:14.971612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 822/1653] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:14.971612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b458f-ae45-4684-a5bf-bc403c122dda None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:14.971612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b458f-ae45-4684-a5bf-bc403c122dda None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:14.971612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b458f-ae45-4684-a5bf-bc403c122dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:14.985027 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 832/1654] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:14.988402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d6667-378d-49f9-b59b-44325850f93f service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:15.016167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:15.037354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d6667-378d-49f9-b59b-44325850f93f service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:15.058499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31c521-312a-4856-a29f-754cd69257c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:15.059345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31c521-312a-4856-a29f-754cd69257c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:15.059984 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31c521-312a-4856-a29f-754cd69257c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:15.064022 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31c521-312a-4856-a29f-754cd69257c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:15.064751 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31c521-312a-4856-a29f-754cd69257c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:15.072515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31c521-312a-4856-a29f-754cd69257c6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:15.084926 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6b0b458f-ae45-4684-a5bf-bc403c122dda None None] MFA Rules not processed for user `bb535ca61c4347168b5f44733401f12e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:15.111419 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6b0b458f-ae45-4684-a5bf-bc403c122dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:15.180357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 833/1655] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:14 2022] POST /identity/v3/projects => generated 405 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:15.182154 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31c521-312a-4856-a29f-754cd69257c6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:15.386918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 823/1656] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:14 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:15.396179 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31c521-312a-4856-a29f-754cd69257c6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:15.404064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842170db-43fe-4a4b-9c64-4f75a14062b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:15.404064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842170db-43fe-4a4b-9c64-4f75a14062b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:15.404064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842170db-43fe-4a4b-9c64-4f75a14062b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:15.404064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842170db-43fe-4a4b-9c64-4f75a14062b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:15.404631 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842170db-43fe-4a4b-9c64-4f75a14062b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:15.407133 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842170db-43fe-4a4b-9c64-4f75a14062b4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:15.460846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 834/1657] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:15 2022] POST /identity/v3/users => generated 303 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:25:15.465298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b458f-ae45-4684-a5bf-bc403c122dda None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:15.495681 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b458f-ae45-4684-a5bf-bc403c122dda None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:15.510082 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed4a1a-18c9-47fa-922a-d707a126e5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:15.510719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4a1a-18c9-47fa-922a-d707a126e5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:15.510986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4a1a-18c9-47fa-922a-d707a126e5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:15.511520 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4a1a-18c9-47fa-922a-d707a126e5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:15.522095 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed4a1a-18c9-47fa-922a-d707a126e5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:15.522095 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed4a1a-18c9-47fa-922a-d707a126e5b9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:15.563113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 824/1658] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:15.567214 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842170db-43fe-4a4b-9c64-4f75a14062b4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:15.583903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842170db-43fe-4a4b-9c64-4f75a14062b4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:15.605050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e31af-1093-429c-82db-b13dea66b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:15.605911 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e31af-1093-429c-82db-b13dea66b4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:15.606791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e31af-1093-429c-82db-b13dea66b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:15.607688 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e31af-1093-429c-82db-b13dea66b4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:15.608578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e31af-1093-429c-82db-b13dea66b4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:15.615569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e31af-1093-429c-82db-b13dea66b4c6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:15.646168 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed4a1a-18c9-47fa-922a-d707a126e5b9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:15.647207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 835/1659] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:15.669081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed4a1a-18c9-47fa-922a-d707a126e5b9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:15.682599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3401404-856d-4569-960c-fac4443360a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:15.683536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3401404-856d-4569-960c-fac4443360a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:15.683976 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3401404-856d-4569-960c-fac4443360a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:15.684418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3401404-856d-4569-960c-fac4443360a4 admin admin] PATH_INFO: `/v3/projects/c3b8e69d61fa4ea4908fc4b5f909ec1f/users/df9d263247a9441bb8a1e41e23ee78e6/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:15.720478 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3401404-856d-4569-960c-fac4443360a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b8e69d61fa4ea4908fc4b5f909ec1f, user_id=df9d263247a9441bb8a1e41e23ee78e6, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:15.725931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3401404-856d-4569-960c-fac4443360a4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:15.754788 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 825/1660] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:15 2022] PUT /identity/v3/projects/c3b8e69d61fa4ea4908fc4b5f909ec1f/users/df9d263247a9441bb8a1e41e23ee78e6/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:15.765962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d7062-c49d-43dd-8453-c57fcecd4a15 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:15.766340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d7062-c49d-43dd-8453-c57fcecd4a15 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:15.766714 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d7062-c49d-43dd-8453-c57fcecd4a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:15.834845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6b4d7062-c49d-43dd-8453-c57fcecd4a15 None None] MFA Rules not processed for user `df9d263247a9441bb8a1e41e23ee78e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:15.849754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6b4d7062-c49d-43dd-8453-c57fcecd4a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:16.025839 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 836/1661] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:15 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:16.026921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3401404-856d-4569-960c-fac4443360a4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:16.173028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3401404-856d-4569-960c-fac4443360a4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:16.187580 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1ca7a-b63b-4507-95ff-8b9b74a6b3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:16.188233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ca7a-b63b-4507-95ff-8b9b74a6b3da admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:16.188527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ca7a-b63b-4507-95ff-8b9b74a6b3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:16.188826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ca7a-b63b-4507-95ff-8b9b74a6b3da admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:16.189467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1ca7a-b63b-4507-95ff-8b9b74a6b3da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:16.191777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1ca7a-b63b-4507-95ff-8b9b74a6b3da admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:16.269368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 826/1662] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:16 2022] POST /identity/v3/projects => generated 403 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:16.273114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d7062-c49d-43dd-8453-c57fcecd4a15 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:16.295250 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d7062-c49d-43dd-8453-c57fcecd4a15 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:16.313725 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:16.405908 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c472b9d-6457-45dd-b28f-01240458a6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:16.406634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c472b9d-6457-45dd-b28f-01240458a6ce admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:16.406891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c472b9d-6457-45dd-b28f-01240458a6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:16.407168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c472b9d-6457-45dd-b28f-01240458a6ce admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:16.408062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c472b9d-6457-45dd-b28f-01240458a6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:16.410371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c472b9d-6457-45dd-b28f-01240458a6ce admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:16.443384 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 837/1663] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:16 2022] POST /identity/v3/users => generated 308 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:16.447379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1ca7a-b63b-4507-95ff-8b9b74a6b3da admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:16.464368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1ca7a-b63b-4507-95ff-8b9b74a6b3da admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:16.476748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24600a03-2c41-4171-9f70-938ed8d0924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:16.477625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24600a03-2c41-4171-9f70-938ed8d0924d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:16.479575 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24600a03-2c41-4171-9f70-938ed8d0924d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:16.479914 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24600a03-2c41-4171-9f70-938ed8d0924d admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:16.480677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24600a03-2c41-4171-9f70-938ed8d0924d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:16.485002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24600a03-2c41-4171-9f70-938ed8d0924d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:16.507666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 827/1664] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:16.513532 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c472b9d-6457-45dd-b28f-01240458a6ce admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:16.529174 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c472b9d-6457-45dd-b28f-01240458a6ce admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:16.541059 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596a42a-2f3f-4a8a-a273-496072ab1989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:16.541926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596a42a-2f3f-4a8a-a273-496072ab1989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:16.542736 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596a42a-2f3f-4a8a-a273-496072ab1989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:16.543024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596a42a-2f3f-4a8a-a273-496072ab1989 admin admin] PATH_INFO: `/v3/projects/a7db5c36a6434bb38b93a3fe06fd5cef/users/70ec95368ce1437eb1338a1f81ee2ed3/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:16.580544 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596a42a-2f3f-4a8a-a273-496072ab1989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7db5c36a6434bb38b93a3fe06fd5cef, user_id=70ec95368ce1437eb1338a1f81ee2ed3, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:16.587318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596a42a-2f3f-4a8a-a273-496072ab1989 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:16.628242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 838/1665] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:16 2022] PUT /identity/v3/projects/a7db5c36a6434bb38b93a3fe06fd5cef/users/70ec95368ce1437eb1338a1f81ee2ed3/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:16.629339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24600a03-2c41-4171-9f70-938ed8d0924d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:16.647241 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24600a03-2c41-4171-9f70-938ed8d0924d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:16.727304 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:16.800177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccccb9-d66e-4413-aca9-d9015e494f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:16.800979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccccb9-d66e-4413-aca9-d9015e494f76 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:16.801449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccccb9-d66e-4413-aca9-d9015e494f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:16.801921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccccb9-d66e-4413-aca9-d9015e494f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:16.802720 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccccb9-d66e-4413-aca9-d9015e494f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:16.806848 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccccb9-d66e-4413-aca9-d9015e494f76 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:16.813543 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596a42a-2f3f-4a8a-a273-496072ab1989 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:16.815515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c596a42a-2f3f-4a8a-a273-496072ab1989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:16.843058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596a42a-2f3f-4a8a-a273-496072ab1989 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:16.859741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 828/1666] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:25:16.863159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccccb9-d66e-4413-aca9-d9015e494f76 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:16.875838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:16.876528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:16.876835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:16.877110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04 admin admin] PATH_INFO: `/v3/projects/846b4191b3c04d3e9af6bb24abc6f270` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:16.882897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=846b4191b3c04d3e9af6bb24abc6f270)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:16.883953 dv-cinder-852208-4-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:25:16.883953 dv-cinder-852208-4-smb devstack@keystone.service[81408]: warnings.warn(msg) Aug 11 16:25:16.883953 dv-cinder-852208-4-smb devstack@keystone.service[81408]: Aug 11 16:25:16.889504 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccccb9-d66e-4413-aca9-d9015e494f76 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:16.893086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:16.896298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c719e9-8240-46d6-abfe-abf17644ddd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:16.897935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c719e9-8240-46d6-abfe-abf17644ddd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:16.898395 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c719e9-8240-46d6-abfe-abf17644ddd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:16.898812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c719e9-8240-46d6-abfe-abf17644ddd5 admin admin] PATH_INFO: `/v3/projects/a7db5c36a6434bb38b93a3fe06fd5cef/users/70ec95368ce1437eb1338a1f81ee2ed3/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:16.906675 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c719e9-8240-46d6-abfe-abf17644ddd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7db5c36a6434bb38b93a3fe06fd5cef, user_id=70ec95368ce1437eb1338a1f81ee2ed3, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:16.911719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c719e9-8240-46d6-abfe-abf17644ddd5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:16.941677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 829/1667] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:16 2022] PUT /identity/v3/projects/a7db5c36a6434bb38b93a3fe06fd5cef/users/70ec95368ce1437eb1338a1f81ee2ed3/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:16.957273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4fd86-ce4f-48e7-8958-49cbadfd666a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:16.957567 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4fd86-ce4f-48e7-8958-49cbadfd666a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:16.957844 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4fd86-ce4f-48e7-8958-49cbadfd666a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:17.019051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-edd4fd86-ce4f-48e7-8958-49cbadfd666a None None] MFA Rules not processed for user `70ec95368ce1437eb1338a1f81ee2ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:17.020929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-edd4fd86-ce4f-48e7-8958-49cbadfd666a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:17.054281 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '846b4191b3c04d3e9af6bb24abc6f270', 'request_id': 'req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:17.070058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '846b4191b3c04d3e9af6bb24abc6f270', 'request_id': 'req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:17.085943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '846b4191b3c04d3e9af6bb24abc6f270', 'request_id': 'req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:17.115098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04 admin admin] The token cache is being invalidate because project 846b4191b3c04d3e9af6bb24abc6f270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:17.115661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:17.116331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5f3474c2-e93f-4e6a-8c2f-79332dc87e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:17.118629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 839/1668] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:16 2022] DELETE /identity/v3/projects/846b4191b3c04d3e9af6bb24abc6f270 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:17.125956 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c7de8-43be-4deb-be44-e178118141e9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:17.126589 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c7de8-43be-4deb-be44-e178118141e9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:17.126760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c7de8-43be-4deb-be44-e178118141e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:17.152501 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 830/1669] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:16 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:17.168178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4fd86-ce4f-48e7-8958-49cbadfd666a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:17.174929 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-879c7de8-43be-4deb-be44-e178118141e9 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:17.176163 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-879c7de8-43be-4deb-be44-e178118141e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:17.176443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-edd4fd86-ce4f-48e7-8958-49cbadfd666a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:17.287058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:17.314889 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 840/1670] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:17.316315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff059e3c-aab7-41bc-8a8b-bff64794359a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:17.317264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff059e3c-aab7-41bc-8a8b-bff64794359a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:17.317542 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff059e3c-aab7-41bc-8a8b-bff64794359a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:17.327869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4fd86-ce4f-48e7-8958-49cbadfd666a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:17.340231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28235517-156d-443c-9da5-c94dc613031d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:17.340987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28235517-156d-443c-9da5-c94dc613031d service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:17.341409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28235517-156d-443c-9da5-c94dc613031d service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:17.341693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28235517-156d-443c-9da5-c94dc613031d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:17.352403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ff059e3c-aab7-41bc-8a8b-bff64794359a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:17.353584 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ff059e3c-aab7-41bc-8a8b-bff64794359a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:17.377466 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28235517-156d-443c-9da5-c94dc613031d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:17.379248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28235517-156d-443c-9da5-c94dc613031d service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:17.387693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 841/1671] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:17.391699 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff059e3c-aab7-41bc-8a8b-bff64794359a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:17.405075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff059e3c-aab7-41bc-8a8b-bff64794359a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:17.423905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fd4e2-0673-4cd4-b75a-02e3de303512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:17.424534 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fd4e2-0673-4cd4-b75a-02e3de303512 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:17.424863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fd4e2-0673-4cd4-b75a-02e3de303512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:17.425134 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fd4e2-0673-4cd4-b75a-02e3de303512 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:17.425793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fd4e2-0673-4cd4-b75a-02e3de303512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:17.426094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fd4e2-0673-4cd4-b75a-02e3de303512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:17.427861 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fd4e2-0673-4cd4-b75a-02e3de303512 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:17.441100 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 831/1672] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:17 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:17.471848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 842/1673] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:17.480032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28235517-156d-443c-9da5-c94dc613031d service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:17.535887 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28235517-156d-443c-9da5-c94dc613031d service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:17.544793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b11a71-bd79-410b-8e8c-4b51dda30e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:17.548481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b11a71-bd79-410b-8e8c-4b51dda30e5f admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:17.548481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b11a71-bd79-410b-8e8c-4b51dda30e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:17.548481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b11a71-bd79-410b-8e8c-4b51dda30e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:17.550369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b11a71-bd79-410b-8e8c-4b51dda30e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:17.560172 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b11a71-bd79-410b-8e8c-4b51dda30e5f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:17.656527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 832/1674] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:17 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:17.658708 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fd4e2-0673-4cd4-b75a-02e3de303512 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:17.681234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fd4e2-0673-4cd4-b75a-02e3de303512 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:17.700899 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b11a71-bd79-410b-8e8c-4b51dda30e5f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:17.703063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-04b11a71-bd79-410b-8e8c-4b51dda30e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:17.794025 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:17.904694 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ef4d5-bfa3-4963-8fac-4a46c2f116bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:17.905347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ef4d5-bfa3-4963-8fac-4a46c2f116bd admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:17.907903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ef4d5-bfa3-4963-8fac-4a46c2f116bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:17.908203 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ef4d5-bfa3-4963-8fac-4a46c2f116bd admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:17.908912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ef4d5-bfa3-4963-8fac-4a46c2f116bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:17.910889 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ef4d5-bfa3-4963-8fac-4a46c2f116bd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:17.931472 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b11a71-bd79-410b-8e8c-4b51dda30e5f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:17.939941 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc55b2-5989-4b1d-8d8b-406df89b5242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:17.940649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc55b2-5989-4b1d-8d8b-406df89b5242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:17.940942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc55b2-5989-4b1d-8d8b-406df89b5242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:17.941222 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc55b2-5989-4b1d-8d8b-406df89b5242 admin admin] PATH_INFO: `/v3/users/df9d263247a9441bb8a1e41e23ee78e6` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:17.942492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc55b2-5989-4b1d-8d8b-406df89b5242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9d263247a9441bb8a1e41e23ee78e6)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:17.944752 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc55b2-5989-4b1d-8d8b-406df89b5242 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:17.970279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 843/1675] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:17 2022] POST /identity/v3/users => generated 288 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:17.974677 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ef4d5-bfa3-4963-8fac-4a46c2f116bd admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:18.007945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ef4d5-bfa3-4963-8fac-4a46c2f116bd admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:18.045774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eb022-75c3-411a-9e18-84ea6955da9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:18.048605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eb022-75c3-411a-9e18-84ea6955da9e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:18.049822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eb022-75c3-411a-9e18-84ea6955da9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:18.052007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eb022-75c3-411a-9e18-84ea6955da9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:18.053533 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eb022-75c3-411a-9e18-84ea6955da9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:18.060220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eb022-75c3-411a-9e18-84ea6955da9e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:18.094982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 844/1676] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:18.099169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eb022-75c3-411a-9e18-84ea6955da9e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:18.107974 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-acbc55b2-5989-4b1d-8d8b-406df89b5242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9d263247a9441bb8a1e41e23ee78e6'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:18.118439 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-acbc55b2-5989-4b1d-8d8b-406df89b5242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9d263247a9441bb8a1e41e23ee78e6'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:18.134813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-acbc55b2-5989-4b1d-8d8b-406df89b5242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9d263247a9441bb8a1e41e23ee78e6'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:18.145094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eb022-75c3-411a-9e18-84ea6955da9e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:18.145887 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-acbc55b2-5989-4b1d-8d8b-406df89b5242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9d263247a9441bb8a1e41e23ee78e6'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:18.147697 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-acbc55b2-5989-4b1d-8d8b-406df89b5242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9d263247a9441bb8a1e41e23ee78e6'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:18.161002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10906495-5435-44c1-b501-8a3e867d06f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:18.161856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10906495-5435-44c1-b501-8a3e867d06f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:18.162290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10906495-5435-44c1-b501-8a3e867d06f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:18.162552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 833/1677] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:17 2022] DELETE /identity/v3/users/df9d263247a9441bb8a1e41e23ee78e6 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:18.163001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10906495-5435-44c1-b501-8a3e867d06f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:18.163800 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10906495-5435-44c1-b501-8a3e867d06f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:18.164504 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43a852-2aa0-4dba-b606-8be59f5bb5ae None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:18.164912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43a852-2aa0-4dba-b606-8be59f5bb5ae None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:18.165405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43a852-2aa0-4dba-b606-8be59f5bb5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:18.166077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10906495-5435-44c1-b501-8a3e867d06f0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:18.186638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 845/1678] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:18.190460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10906495-5435-44c1-b501-8a3e867d06f0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:18.192634 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1b43a852-2aa0-4dba-b606-8be59f5bb5ae None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:18.194293 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1b43a852-2aa0-4dba-b606-8be59f5bb5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:18.195170 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-10906495-5435-44c1-b501-8a3e867d06f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:18.224039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10906495-5435-44c1-b501-8a3e867d06f0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:18.360823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 834/1679] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:18.389587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96c456-55b8-4547-9df2-8c9eba546482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:18.391599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96c456-55b8-4547-9df2-8c9eba546482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:18.392186 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96c456-55b8-4547-9df2-8c9eba546482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:18.392782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96c456-55b8-4547-9df2-8c9eba546482 admin admin] PATH_INFO: `/v3/projects/6cbb99a9685c49ad9fa6ce6020324e92/users/4b844013ed96406c8d11a5cd8b0aa444/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:18.424657 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96c456-55b8-4547-9df2-8c9eba546482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cbb99a9685c49ad9fa6ce6020324e92, user_id=4b844013ed96406c8d11a5cd8b0aa444, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:18.427579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96c456-55b8-4547-9df2-8c9eba546482 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:18.459981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 846/1680] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:18 2022] PUT /identity/v3/projects/6cbb99a9685c49ad9fa6ce6020324e92/users/4b844013ed96406c8d11a5cd8b0aa444/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:25:18.460279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43a852-2aa0-4dba-b606-8be59f5bb5ae None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:18.462091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1b43a852-2aa0-4dba-b606-8be59f5bb5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:18.487091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdaa51-19a2-4f02-8a7a-347fb927b3f0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:18.487379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdaa51-19a2-4f02-8a7a-347fb927b3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:18.487651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdaa51-19a2-4f02-8a7a-347fb927b3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:18.590147 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0fbdaa51-19a2-4f02-8a7a-347fb927b3f0 None None] MFA Rules not processed for user `4b844013ed96406c8d11a5cd8b0aa444`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:18.595878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0fbdaa51-19a2-4f02-8a7a-347fb927b3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:18.624271 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:18.650886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:18.665009 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43a852-2aa0-4dba-b606-8be59f5bb5ae None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:18.764486 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 847/1681] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:18.768021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f563c-c748-4366-bf40-d5770164fd9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:18.768699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f563c-c748-4366-bf40-d5770164fd9e service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:18.768998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f563c-c748-4366-bf40-d5770164fd9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:18.769279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f563c-c748-4366-bf40-d5770164fd9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:18.772799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdaa51-19a2-4f02-8a7a-347fb927b3f0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:18.774373 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0fbdaa51-19a2-4f02-8a7a-347fb927b3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:18.934483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f563c-c748-4366-bf40-d5770164fd9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:18.935654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f563c-c748-4366-bf40-d5770164fd9e service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:18.947722 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdaa51-19a2-4f02-8a7a-347fb927b3f0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:18.963791 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 835/1682] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:18.967782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa06111-0c44-4599-a9d0-2ab64aab2a75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:18.968456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa06111-0c44-4599-a9d0-2ab64aab2a75 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:18.968788 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa06111-0c44-4599-a9d0-2ab64aab2a75 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:18.969065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa06111-0c44-4599-a9d0-2ab64aab2a75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:18.978964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa06111-0c44-4599-a9d0-2ab64aab2a75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:18.980947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa06111-0c44-4599-a9d0-2ab64aab2a75 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:18.994876 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 848/1683] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:25:19.329820 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f563c-c748-4366-bf40-d5770164fd9e service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:19.343102 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f563c-c748-4366-bf40-d5770164fd9e service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:19.348761 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2de63-14ff-449a-8f69-2d2f16f290e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:19.349531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2de63-14ff-449a-8f69-2d2f16f290e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:19.349911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2de63-14ff-449a-8f69-2d2f16f290e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:19.350285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2de63-14ff-449a-8f69-2d2f16f290e6 admin admin] PATH_INFO: `/v3/users/4b844013ed96406c8d11a5cd8b0aa444` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:19.351728 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2de63-14ff-449a-8f69-2d2f16f290e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b844013ed96406c8d11a5cd8b0aa444)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:19.353897 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2de63-14ff-449a-8f69-2d2f16f290e6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:19.432605 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2ca2de63-14ff-449a-8f69-2d2f16f290e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b844013ed96406c8d11a5cd8b0aa444'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:19.447381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2ca2de63-14ff-449a-8f69-2d2f16f290e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b844013ed96406c8d11a5cd8b0aa444'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:19.491841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2ca2de63-14ff-449a-8f69-2d2f16f290e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b844013ed96406c8d11a5cd8b0aa444'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:19.507828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2ca2de63-14ff-449a-8f69-2d2f16f290e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b844013ed96406c8d11a5cd8b0aa444'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:19.518200 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2ca2de63-14ff-449a-8f69-2d2f16f290e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b844013ed96406c8d11a5cd8b0aa444'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:19.530043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 836/1684] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:19 2022] DELETE /identity/v3/users/4b844013ed96406c8d11a5cd8b0aa444 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:19.536383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f9cea-3739-4e12-a2a2-b0acd3b00855 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:19.536971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f9cea-3739-4e12-a2a2-b0acd3b00855 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:19.536971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f9cea-3739-4e12-a2a2-b0acd3b00855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:19.576085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f67f9cea-3739-4e12-a2a2-b0acd3b00855 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:19.578132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f67f9cea-3739-4e12-a2a2-b0acd3b00855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:19.757550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 849/1685] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:19.823217 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2de63-14ff-449a-8f69-2d2f16f290e6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:19.825295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2ca2de63-14ff-449a-8f69-2d2f16f290e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:19.867518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:19.892112 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a05df8-e634-49dd-8927-9a28c963cc3f None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:19.892375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a05df8-e634-49dd-8927-9a28c963cc3f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:19.892854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a05df8-e634-49dd-8927-9a28c963cc3f None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:19.895533 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 850/1686] 10.222.0.40 () {54 vars in 921 bytes} [Thu Aug 11 16:25:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 16:25:20.010558 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2de63-14ff-449a-8f69-2d2f16f290e6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:20.020120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e1036-ab29-490a-b816-f27db7e46944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:20.020942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e1036-ab29-490a-b816-f27db7e46944 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:20.021327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e1036-ab29-490a-b816-f27db7e46944 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:20.021783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e1036-ab29-490a-b816-f27db7e46944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:20.035456 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e1036-ab29-490a-b816-f27db7e46944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:20.037289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e1036-ab29-490a-b816-f27db7e46944 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:20.053366 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 837/1687] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:20.158818 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d1ff9-64c9-4358-bb52-e148222ae988 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:20.159095 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d1ff9-64c9-4358-bb52-e148222ae988 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:20.159752 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d1ff9-64c9-4358-bb52-e148222ae988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:20.242846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-315d1ff9-64c9-4358-bb52-e148222ae988 None None] MFA Rules not processed for user `64e1c7e6ee814b47912760cf7daf54c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:20.253328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-315d1ff9-64c9-4358-bb52-e148222ae988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:20.361206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:20.367349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42075012-69c5-41df-9260-3e12cb65061e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:20.367637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42075012-69c5-41df-9260-3e12cb65061e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:20.368279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42075012-69c5-41df-9260-3e12cb65061e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:20.404966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 851/1688] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Aug 11 16:25:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:20.428180 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-42075012-69c5-41df-9260-3e12cb65061e None None] MFA Rules not processed for user `abe49b89481a4d41ac4e74ccbdf50e56`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:20.429613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-42075012-69c5-41df-9260-3e12cb65061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:20.444863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5f88a-ea82-45d4-b117-375be4a9d6e1 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:20.445862 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5f88a-ea82-45d4-b117-375be4a9d6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:20.446205 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5f88a-ea82-45d4-b117-375be4a9d6e1 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:20.448167 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 852/1689] 10.222.0.40 () {54 vars in 961 bytes} [Thu Aug 11 16:25:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:25:20.454932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d8d49-1bf7-480c-ba30-04bd7a6402fe None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:20.455238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d8d49-1bf7-480c-ba30-04bd7a6402fe None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:20.455595 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d8d49-1bf7-480c-ba30-04bd7a6402fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:20.518293 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-385d8d49-1bf7-480c-ba30-04bd7a6402fe None None] MFA Rules not processed for user `64e1c7e6ee814b47912760cf7daf54c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:20.521164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-385d8d49-1bf7-480c-ba30-04bd7a6402fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:20.549378 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 853/1690] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Aug 11 16:25:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:25:20.580028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d8d49-1bf7-480c-ba30-04bd7a6402fe None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:20.601555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d8d49-1bf7-480c-ba30-04bd7a6402fe None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:20.620194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f0be6-0beb-488e-83e6-060bf8786066 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e1c7e6ee814b47912760cf7daf54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:20.620542 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 838/1691] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:20.623958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f0be6-0beb-488e-83e6-060bf8786066 service placement] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:20.624249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f0be6-0beb-488e-83e6-060bf8786066 service placement] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:20.626291 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f0be6-0beb-488e-83e6-060bf8786066 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:20.632905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd43b9-c079-4eaf-b2cb-a3718d9b2b0f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:20.633525 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd43b9-c079-4eaf-b2cb-a3718d9b2b0f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:20.633948 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd43b9-c079-4eaf-b2cb-a3718d9b2b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:20.658760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f0be6-0beb-488e-83e6-060bf8786066 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:20.663768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f0be6-0beb-488e-83e6-060bf8786066 service placement] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:20.668194 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-25fd43b9-c079-4eaf-b2cb-a3718d9b2b0f None None] MFA Rules not processed for user `abe49b89481a4d41ac4e74ccbdf50e56`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:20.669713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-25fd43b9-c079-4eaf-b2cb-a3718d9b2b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:20.688636 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 839/1692] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:25:20.697654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd43b9-c079-4eaf-b2cb-a3718d9b2b0f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:20.699256 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 854/1693] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:20.699375 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-25fd43b9-c079-4eaf-b2cb-a3718d9b2b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:20.841591 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f0be6-0beb-488e-83e6-060bf8786066 service placement] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:20.844179 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c07f0be6-0beb-488e-83e6-060bf8786066 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:20.872782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd43b9-c079-4eaf-b2cb-a3718d9b2b0f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:20.873324 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f0be6-0beb-488e-83e6-060bf8786066 service placement] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:20.883477 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e329f-dd62-4c80-b66b-f2c78718dfb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:20.886054 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e329f-dd62-4c80-b66b-f2c78718dfb4 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:20.886422 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e329f-dd62-4c80-b66b-f2c78718dfb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:20.886808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e329f-dd62-4c80-b66b-f2c78718dfb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:20.887960 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90dfb8-147a-4179-aa7e-d0f496914cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:20.889014 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90dfb8-147a-4179-aa7e-d0f496914cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:20.889296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90dfb8-147a-4179-aa7e-d0f496914cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:20.889571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90dfb8-147a-4179-aa7e-d0f496914cb5 admin admin] PATH_INFO: `/v3/projects/c3b8e69d61fa4ea4908fc4b5f909ec1f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:20.892784 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90dfb8-147a-4179-aa7e-d0f496914cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b8e69d61fa4ea4908fc4b5f909ec1f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:20.895150 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90dfb8-147a-4179-aa7e-d0f496914cb5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:20.910662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e329f-dd62-4c80-b66b-f2c78718dfb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:20.912184 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e329f-dd62-4c80-b66b-f2c78718dfb4 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:20.941061 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 840/1694] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:21.033347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9f90dfb8-147a-4179-aa7e-d0f496914cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b8e69d61fa4ea4908fc4b5f909ec1f', 'request_id': 'req-9f90dfb8-147a-4179-aa7e-d0f496914cb5'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:21.049207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9f90dfb8-147a-4179-aa7e-d0f496914cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b8e69d61fa4ea4908fc4b5f909ec1f', 'request_id': 'req-9f90dfb8-147a-4179-aa7e-d0f496914cb5'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:21.064821 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9f90dfb8-147a-4179-aa7e-d0f496914cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b8e69d61fa4ea4908fc4b5f909ec1f', 'request_id': 'req-9f90dfb8-147a-4179-aa7e-d0f496914cb5'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:21.110394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9f90dfb8-147a-4179-aa7e-d0f496914cb5 admin admin] The token cache is being invalidate because project c3b8e69d61fa4ea4908fc4b5f909ec1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:21.110503 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9f90dfb8-147a-4179-aa7e-d0f496914cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:21.115561 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9f90dfb8-147a-4179-aa7e-d0f496914cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:21.124475 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 855/1695] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:20 2022] DELETE /identity/v3/projects/c3b8e69d61fa4ea4908fc4b5f909ec1f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:21.125489 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e329f-dd62-4c80-b66b-f2c78718dfb4 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:21.140800 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e329f-dd62-4c80-b66b-f2c78718dfb4 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:21.199427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:21.258981 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a0055-8f59-40b7-98ed-4d73651a7760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:21.260012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0055-8f59-40b7-98ed-4d73651a7760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:21.260012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0055-8f59-40b7-98ed-4d73651a7760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:21.260012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0055-8f59-40b7-98ed-4d73651a7760 admin admin] PATH_INFO: `/v3/users/70ec95368ce1437eb1338a1f81ee2ed3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:21.264344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a0055-8f59-40b7-98ed-4d73651a7760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ec95368ce1437eb1338a1f81ee2ed3)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:21.266836 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a0055-8f59-40b7-98ed-4d73651a7760 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:21.377439 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c57a0055-8f59-40b7-98ed-4d73651a7760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ec95368ce1437eb1338a1f81ee2ed3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:21.394317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c57a0055-8f59-40b7-98ed-4d73651a7760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ec95368ce1437eb1338a1f81ee2ed3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:21.424772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c57a0055-8f59-40b7-98ed-4d73651a7760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ec95368ce1437eb1338a1f81ee2ed3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:21.441877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c57a0055-8f59-40b7-98ed-4d73651a7760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ec95368ce1437eb1338a1f81ee2ed3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:21.449054 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c57a0055-8f59-40b7-98ed-4d73651a7760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ec95368ce1437eb1338a1f81ee2ed3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:21.457299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 841/1696] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:21 2022] DELETE /identity/v3/users/70ec95368ce1437eb1338a1f81ee2ed3 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:22.406705 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57625d0d-e1fc-401d-bd1e-2422e5d4d391 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:22.408048 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57625d0d-e1fc-401d-bd1e-2422e5d4d391 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:22.408466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57625d0d-e1fc-401d-bd1e-2422e5d4d391 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:22.410491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 856/1697] 10.222.0.40 () {54 vars in 912 bytes} [Thu Aug 11 16:25:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:25:22.417841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd37a5-9fc3-4dec-bea4-7065ed6bc430 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:22.418683 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd37a5-9fc3-4dec-bea4-7065ed6bc430 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:22.419147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd37a5-9fc3-4dec-bea4-7065ed6bc430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:22.518291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f6bd37a5-9fc3-4dec-bea4-7065ed6bc430 None None] MFA Rules not processed for user `16d2570f97234d62948762562616000c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:22.521681 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f6bd37a5-9fc3-4dec-bea4-7065ed6bc430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:22.626397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 842/1698] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Aug 11 16:25:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:22.689658 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57625d0d-e1fc-401d-bd1e-2422e5d4d391 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:22.692238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-57625d0d-e1fc-401d-bd1e-2422e5d4d391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:22.870424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57625d0d-e1fc-401d-bd1e-2422e5d4d391 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:22.880767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec5ded-8e56-4f20-8c8c-f9f6dda50f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:22.881432 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec5ded-8e56-4f20-8c8c-f9f6dda50f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:22.881712 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec5ded-8e56-4f20-8c8c-f9f6dda50f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:22.881986 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec5ded-8e56-4f20-8c8c-f9f6dda50f00 admin admin] PATH_INFO: `/v3/projects/6cbb99a9685c49ad9fa6ce6020324e92` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:22.885882 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec5ded-8e56-4f20-8c8c-f9f6dda50f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cbb99a9685c49ad9fa6ce6020324e92)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:22.888802 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec5ded-8e56-4f20-8c8c-f9f6dda50f00 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:22.993913 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:22.998081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5bec5ded-8e56-4f20-8c8c-f9f6dda50f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cbb99a9685c49ad9fa6ce6020324e92', 'request_id': 'req-5bec5ded-8e56-4f20-8c8c-f9f6dda50f00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:23.007774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5bec5ded-8e56-4f20-8c8c-f9f6dda50f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cbb99a9685c49ad9fa6ce6020324e92', 'request_id': 'req-5bec5ded-8e56-4f20-8c8c-f9f6dda50f00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:23.021922 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5bec5ded-8e56-4f20-8c8c-f9f6dda50f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cbb99a9685c49ad9fa6ce6020324e92', 'request_id': 'req-5bec5ded-8e56-4f20-8c8c-f9f6dda50f00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:23.036730 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5bec5ded-8e56-4f20-8c8c-f9f6dda50f00 admin admin] The token cache is being invalidate because project 6cbb99a9685c49ad9fa6ce6020324e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:23.037420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5bec5ded-8e56-4f20-8c8c-f9f6dda50f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:23.038547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5bec5ded-8e56-4f20-8c8c-f9f6dda50f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:23.041021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 857/1699] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:22 2022] DELETE /identity/v3/projects/6cbb99a9685c49ad9fa6ce6020324e92 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:23.046730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64155322-308b-4255-b817-508c7f53fd1c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:23.047366 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64155322-308b-4255-b817-508c7f53fd1c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:23.047834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64155322-308b-4255-b817-508c7f53fd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:23.075178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-64155322-308b-4255-b817-508c7f53fd1c None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:23.078204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-64155322-308b-4255-b817-508c7f53fd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:23.145114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:23.174330 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 843/1700] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:23.182185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8359e6-141b-4c3b-ae72-f7a362864dc0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:23.182845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8359e6-141b-4c3b-ae72-f7a362864dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:23.183315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8359e6-141b-4c3b-ae72-f7a362864dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:23.216325 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-de8359e6-141b-4c3b-ae72-f7a362864dc0 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:23.218687 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-de8359e6-141b-4c3b-ae72-f7a362864dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:23.232517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 858/1701] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:25:23.236279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64155322-308b-4255-b817-508c7f53fd1c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:23.250871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64155322-308b-4255-b817-508c7f53fd1c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:23.258661 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0f60-c6e1-4782-ba96-fead43f0dd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:23.259734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0f60-c6e1-4782-ba96-fead43f0dd63 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:23.260235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0f60-c6e1-4782-ba96-fead43f0dd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:23.260790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0f60-c6e1-4782-ba96-fead43f0dd63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:23.261662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c0f60-c6e1-4782-ba96-fead43f0dd63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:23.262164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c0f60-c6e1-4782-ba96-fead43f0dd63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:23.264257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c0f60-c6e1-4782-ba96-fead43f0dd63 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:23.296645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c83f2-773a-48f2-bf82-e46de6ab5f23 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:23.297268 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c83f2-773a-48f2-bf82-e46de6ab5f23 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:23.298715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c83f2-773a-48f2-bf82-e46de6ab5f23 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:23.300520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 859/1702] 10.222.0.40 () {54 vars in 921 bytes} [Thu Aug 11 16:25:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:25:23.310271 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 844/1703] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:23.321927 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c83f2-773a-48f2-bf82-e46de6ab5f23 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:23.345362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c83f2-773a-48f2-bf82-e46de6ab5f23 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:23.365878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe071b3-b705-4365-a8ca-978d04274532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:23.367103 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe071b3-b705-4365-a8ca-978d04274532 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:23.367103 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe071b3-b705-4365-a8ca-978d04274532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:23.367326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe071b3-b705-4365-a8ca-978d04274532 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:23.367860 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe071b3-b705-4365-a8ca-978d04274532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:23.369838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe071b3-b705-4365-a8ca-978d04274532 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:23.473347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 860/1704] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:23 2022] POST /identity/v3/projects => generated 363 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:23.475329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0f60-c6e1-4782-ba96-fead43f0dd63 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:23.490390 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe071b3-b705-4365-a8ca-978d04274532 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:23.493124 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-afe071b3-b705-4365-a8ca-978d04274532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:23.505700 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0f60-c6e1-4782-ba96-fead43f0dd63 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:23.691811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09fd1e-2b47-4883-9f94-3e687ed84ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:23.692138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe071b3-b705-4365-a8ca-978d04274532 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:23.692451 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09fd1e-2b47-4883-9f94-3e687ed84ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:23.692857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09fd1e-2b47-4883-9f94-3e687ed84ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:23.693063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09fd1e-2b47-4883-9f94-3e687ed84ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:23.698669 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09fd1e-2b47-4883-9f94-3e687ed84ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:23.700839 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09fd1e-2b47-4883-9f94-3e687ed84ad5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:23.714180 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:23.714612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:23.714892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:23.715171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb admin admin] PATH_INFO: `/v3/projects/a7db5c36a6434bb38b93a3fe06fd5cef` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:23.716550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7db5c36a6434bb38b93a3fe06fd5cef)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:23.723110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:23.771271 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 845/1705] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:23 2022] POST /identity/v3/users => generated 282 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:23.771271 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09fd1e-2b47-4883-9f94-3e687ed84ad5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:23.797071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6b09fd1e-2b47-4883-9f94-3e687ed84ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:23.838205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09fd1e-2b47-4883-9f94-3e687ed84ad5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:23.886528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7db5c36a6434bb38b93a3fe06fd5cef', 'request_id': 'req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:23.916960 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7db5c36a6434bb38b93a3fe06fd5cef', 'request_id': 'req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:23.941206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7db5c36a6434bb38b93a3fe06fd5cef', 'request_id': 'req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:23.969396 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb admin admin] The token cache is being invalidate because project a7db5c36a6434bb38b93a3fe06fd5cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:23.969590 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:23.983435 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:23.986596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 861/1706] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:23 2022] DELETE /identity/v3/projects/a7db5c36a6434bb38b93a3fe06fd5cef => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:23.987534 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:23.991317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:24.037662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866230d-4e69-4fd3-b844-efdebf90e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:24.038810 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866230d-4e69-4fd3-b844-efdebf90e667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:24.038810 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866230d-4e69-4fd3-b844-efdebf90e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:24.038964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866230d-4e69-4fd3-b844-efdebf90e667 admin admin] PATH_INFO: `/v3/users/46c32bf22365485e93168e1ec7fd80ae` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:24.040574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866230d-4e69-4fd3-b844-efdebf90e667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46c32bf22365485e93168e1ec7fd80ae)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:24.043602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866230d-4e69-4fd3-b844-efdebf90e667 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:24.126033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:24.210647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb343c-c8c6-4792-ab69-5d63eb3591fb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:24.234322 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd58d6-e8ce-4dc2-b36e-250c20b02f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:24.235085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd58d6-e8ce-4dc2-b36e-250c20b02f96 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:24.236049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd58d6-e8ce-4dc2-b36e-250c20b02f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:24.242598 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd58d6-e8ce-4dc2-b36e-250c20b02f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:24.246593 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f5dd58d6-e8ce-4dc2-b36e-250c20b02f96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:24.274281 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0866230d-4e69-4fd3-b844-efdebf90e667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46c32bf22365485e93168e1ec7fd80ae'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:24.290122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0866230d-4e69-4fd3-b844-efdebf90e667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46c32bf22365485e93168e1ec7fd80ae'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:24.314393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:24.328654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd58d6-e8ce-4dc2-b36e-250c20b02f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:24.330020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd58d6-e8ce-4dc2-b36e-250c20b02f96 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:24.331207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0866230d-4e69-4fd3-b844-efdebf90e667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46c32bf22365485e93168e1ec7fd80ae'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:24.347535 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0866230d-4e69-4fd3-b844-efdebf90e667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46c32bf22365485e93168e1ec7fd80ae'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:24.348965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0866230d-4e69-4fd3-b844-efdebf90e667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46c32bf22365485e93168e1ec7fd80ae'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:24.367546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 846/1707] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:23 2022] DELETE /identity/v3/users/46c32bf22365485e93168e1ec7fd80ae => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:24.368897 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd1dc5-f222-4e86-929c-d4e246b0897d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:24.369186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd1dc5-f222-4e86-929c-d4e246b0897d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:24.369466 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd1dc5-f222-4e86-929c-d4e246b0897d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:24.421643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 862/1708] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:24.425109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd58d6-e8ce-4dc2-b36e-250c20b02f96 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:24.427798 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f5dd58d6-e8ce-4dc2-b36e-250c20b02f96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:24.431007 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2ecd1dc5-f222-4e86-929c-d4e246b0897d None None] MFA Rules not processed for user `64e1c7e6ee814b47912760cf7daf54c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:24.436260 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2ecd1dc5-f222-4e86-929c-d4e246b0897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:24.513480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd58d6-e8ce-4dc2-b36e-250c20b02f96 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:24.721408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1af93-67cd-4a0d-ace5-a152d6754663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:24.722264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1af93-67cd-4a0d-ace5-a152d6754663 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:24.722990 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1af93-67cd-4a0d-ace5-a152d6754663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:24.723412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1af93-67cd-4a0d-ace5-a152d6754663 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:24.727354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1af93-67cd-4a0d-ace5-a152d6754663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:24.732851 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1af93-67cd-4a0d-ace5-a152d6754663 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:24.751594 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 847/1709] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Aug 11 16:25:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:24.755624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d4fb5-13eb-46a9-b0f0-1fe7c7193c0d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:24.756560 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d4fb5-13eb-46a9-b0f0-1fe7c7193c0d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:24.769006 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d4fb5-13eb-46a9-b0f0-1fe7c7193c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:24.772202 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 863/1710] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:24.776466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1af93-67cd-4a0d-ace5-a152d6754663 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:24.784158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-47c1af93-67cd-4a0d-ace5-a152d6754663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:24.828372 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1af93-67cd-4a0d-ace5-a152d6754663 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:24.830741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-738d4fb5-13eb-46a9-b0f0-1fe7c7193c0d None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:24.832268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-738d4fb5-13eb-46a9-b0f0-1fe7c7193c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:24.840184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fe558-dba2-4107-a72a-51faf0825836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:24.840915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fe558-dba2-4107-a72a-51faf0825836 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:24.841200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fe558-dba2-4107-a72a-51faf0825836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:24.841474 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fe558-dba2-4107-a72a-51faf0825836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:24.842135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fe558-dba2-4107-a72a-51faf0825836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:24.843805 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fe558-dba2-4107-a72a-51faf0825836 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:24.857759 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 848/1711] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:24.865790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b609c1-17de-4a42-9a5a-4422f079a3de None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:24.866686 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b609c1-17de-4a42-9a5a-4422f079a3de None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:24.867065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b609c1-17de-4a42-9a5a-4422f079a3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:24.903840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 864/1712] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:24.903980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-85b609c1-17de-4a42-9a5a-4422f079a3de None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:24.904055 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fe558-dba2-4107-a72a-51faf0825836 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:24.904156 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-85b609c1-17de-4a42-9a5a-4422f079a3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:24.917117 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bf1fe558-dba2-4107-a72a-51faf0825836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:24.943542 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 849/1713] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:24.944981 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b609c1-17de-4a42-9a5a-4422f079a3de None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:24.950832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fe558-dba2-4107-a72a-51faf0825836 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:24.959413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8e6e9-adee-41c7-93d1-74097573d772 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e1c7e6ee814b47912760cf7daf54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:24.960874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8e6e9-adee-41c7-93d1-74097573d772 service placement] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:24.961158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8e6e9-adee-41c7-93d1-74097573d772 service placement] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:24.961598 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8e6e9-adee-41c7-93d1-74097573d772 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:24.968832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b609c1-17de-4a42-9a5a-4422f079a3de None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:24.971869 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b8e6e9-adee-41c7-93d1-74097573d772 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:24.973643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b8e6e9-adee-41c7-93d1-74097573d772 service placement] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:24.982140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1312db-a5ec-4d45-bab7-2f5ed44124a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:24.982836 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1312db-a5ec-4d45-bab7-2f5ed44124a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:24.983169 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1312db-a5ec-4d45-bab7-2f5ed44124a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:24.983392 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1312db-a5ec-4d45-bab7-2f5ed44124a5 admin admin] PATH_INFO: `/v3/projects/f0f84cda8122477fac657f75f33b7661/users/b109cf49884d4b38817921b03f5da8bb/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:24.987413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 865/1714] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:24.988999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8e6e9-adee-41c7-93d1-74097573d772 service placement] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:25.013902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8e6e9-adee-41c7-93d1-74097573d772 service placement] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:25.026564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085053d8-f007-4eb9-a9b4-5df75dde2539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:25.027295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085053d8-f007-4eb9-a9b4-5df75dde2539 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:25.027582 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085053d8-f007-4eb9-a9b4-5df75dde2539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:25.027859 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085053d8-f007-4eb9-a9b4-5df75dde2539 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:25.028530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085053d8-f007-4eb9-a9b4-5df75dde2539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:25.029930 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085053d8-f007-4eb9-a9b4-5df75dde2539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:25.031700 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085053d8-f007-4eb9-a9b4-5df75dde2539 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:25.053244 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 866/1715] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:25.063706 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1312db-a5ec-4d45-bab7-2f5ed44124a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f84cda8122477fac657f75f33b7661, user_id=b109cf49884d4b38817921b03f5da8bb, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:25.065304 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085053d8-f007-4eb9-a9b4-5df75dde2539 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:25.072025 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1312db-a5ec-4d45-bab7-2f5ed44124a5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:25.092500 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 850/1716] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:24 2022] PUT /identity/v3/projects/f0f84cda8122477fac657f75f33b7661/users/b109cf49884d4b38817921b03f5da8bb/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:25.106920 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bc9da-1dca-4837-be78-abae8c8d1db4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:25.107826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bc9da-1dca-4837-be78-abae8c8d1db4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:25.108221 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bc9da-1dca-4837-be78-abae8c8d1db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:25.117601 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085053d8-f007-4eb9-a9b4-5df75dde2539 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:25.198405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f38bc9da-1dca-4837-be78-abae8c8d1db4 None None] MFA Rules not processed for user `b109cf49884d4b38817921b03f5da8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:25.202318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f38bc9da-1dca-4837-be78-abae8c8d1db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:25.321332 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 851/1717] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:25.322823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce5fe7-a922-4234-81d8-11876ac35bfb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:25.323123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce5fe7-a922-4234-81d8-11876ac35bfb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:25.323543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce5fe7-a922-4234-81d8-11876ac35bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:25.333600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f24d0-de72-4f30-a283-d22397d16a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:25.334392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f24d0-de72-4f30-a283-d22397d16a5c admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:25.336615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f24d0-de72-4f30-a283-d22397d16a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:25.337974 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f24d0-de72-4f30-a283-d22397d16a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:25.339879 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f24d0-de72-4f30-a283-d22397d16a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:25.347066 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f24d0-de72-4f30-a283-d22397d16a5c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:25.375681 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-27ce5fe7-a922-4234-81d8-11876ac35bfb None None] MFA Rules not processed for user `7b0f9418982c4a8e8ebd5cf4419c5418`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:25.376964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-27ce5fe7-a922-4234-81d8-11876ac35bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:25.418033 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:25.450343 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 867/1718] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:25 2022] POST /identity/v3/projects => generated 375 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:25.465928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f24d0-de72-4f30-a283-d22397d16a5c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:25.550311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:25.578537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 852/1719] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:25.579600 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce5fe7-a922-4234-81d8-11876ac35bfb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:25.623199 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce5fe7-a922-4234-81d8-11876ac35bfb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:25.658095 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f24d0-de72-4f30-a283-d22397d16a5c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:25.672028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27fdb6-2507-4ea8-aee2-2439d522657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:25.673017 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27fdb6-2507-4ea8-aee2-2439d522657e admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:25.673401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27fdb6-2507-4ea8-aee2-2439d522657e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:25.675368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27fdb6-2507-4ea8-aee2-2439d522657e admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:25.676760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27fdb6-2507-4ea8-aee2-2439d522657e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:25.681007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27fdb6-2507-4ea8-aee2-2439d522657e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:25.758120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5eb78-3cee-4251-8e90-18b20999e959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:25.759082 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5eb78-3cee-4251-8e90-18b20999e959 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:25.760381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5eb78-3cee-4251-8e90-18b20999e959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:25.760381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5eb78-3cee-4251-8e90-18b20999e959 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:25.760381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5eb78-3cee-4251-8e90-18b20999e959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:25.763475 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5eb78-3cee-4251-8e90-18b20999e959 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:25.777829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 868/1720] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:25 2022] POST /identity/v3/projects => generated 363 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:25.782945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27fdb6-2507-4ea8-aee2-2439d522657e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:25.785647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9a27fdb6-2507-4ea8-aee2-2439d522657e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:25.806533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 853/1721] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:25 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:25.807509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5eb78-3cee-4251-8e90-18b20999e959 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:25.816008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3bb5eb78-3cee-4251-8e90-18b20999e959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:25.833421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5eb78-3cee-4251-8e90-18b20999e959 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:25.905207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27fdb6-2507-4ea8-aee2-2439d522657e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:25.920626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57e315-30bf-4bee-9239-27fc3ce08a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:25.921587 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57e315-30bf-4bee-9239-27fc3ce08a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:25.922246 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57e315-30bf-4bee-9239-27fc3ce08a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:25.922246 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57e315-30bf-4bee-9239-27fc3ce08a5f admin admin] PATH_INFO: `/v3/projects/3ac4a068b20546558778972470db02bb` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:25.923606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57e315-30bf-4bee-9239-27fc3ce08a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ac4a068b20546558778972470db02bb)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:25.926002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57e315-30bf-4bee-9239-27fc3ce08a5f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:25.930227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b00e1c-e14f-4ab9-aaa7-a195beb4eb2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:25.931208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b00e1c-e14f-4ab9-aaa7-a195beb4eb2d service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:25.931710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b00e1c-e14f-4ab9-aaa7-a195beb4eb2d service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:25.932124 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b00e1c-e14f-4ab9-aaa7-a195beb4eb2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:26.024187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b00e1c-e14f-4ab9-aaa7-a195beb4eb2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:26.027341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b00e1c-e14f-4ab9-aaa7-a195beb4eb2d service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:26.041096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 869/1722] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:26.042184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b00e1c-e14f-4ab9-aaa7-a195beb4eb2d service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:26.056187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b00e1c-e14f-4ab9-aaa7-a195beb4eb2d service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:26.056369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5a57e315-30bf-4bee-9239-27fc3ce08a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ac4a068b20546558778972470db02bb', 'request_id': 'req-5a57e315-30bf-4bee-9239-27fc3ce08a5f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:26.058130 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:26.070746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5a57e315-30bf-4bee-9239-27fc3ce08a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ac4a068b20546558778972470db02bb', 'request_id': 'req-5a57e315-30bf-4bee-9239-27fc3ce08a5f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:26.084366 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5a57e315-30bf-4bee-9239-27fc3ce08a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ac4a068b20546558778972470db02bb', 'request_id': 'req-5a57e315-30bf-4bee-9239-27fc3ce08a5f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:26.122279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:26.133092 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5a57e315-30bf-4bee-9239-27fc3ce08a5f admin admin] The token cache is being invalidate because project 3ac4a068b20546558778972470db02bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:26.137117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5a57e315-30bf-4bee-9239-27fc3ce08a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:26.139236 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5a57e315-30bf-4bee-9239-27fc3ce08a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:26.143312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 854/1723] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:25 2022] DELETE /identity/v3/projects/3ac4a068b20546558778972470db02bb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:26.146527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57e315-30bf-4bee-9239-27fc3ce08a5f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:26.148189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6ed38-2a05-4469-8aff-38235dc5bbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:26.149054 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6ed38-2a05-4469-8aff-38235dc5bbfb admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:26.149340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6ed38-2a05-4469-8aff-38235dc5bbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:26.149622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6ed38-2a05-4469-8aff-38235dc5bbfb admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:26.150115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5a57e315-30bf-4bee-9239-27fc3ce08a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:26.150268 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6ed38-2a05-4469-8aff-38235dc5bbfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:26.152429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6ed38-2a05-4469-8aff-38235dc5bbfb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:26.199952 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 870/1724] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:26 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:26.199952 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6ed38-2a05-4469-8aff-38235dc5bbfb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:26.204642 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-89e6ed38-2a05-4469-8aff-38235dc5bbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:26.209299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57e315-30bf-4bee-9239-27fc3ce08a5f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:26.228496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92b6fd-9ebb-42f9-8ead-7af3dddd9ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:26.230442 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92b6fd-9ebb-42f9-8ead-7af3dddd9ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:26.231953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92b6fd-9ebb-42f9-8ead-7af3dddd9ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:26.233074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92b6fd-9ebb-42f9-8ead-7af3dddd9ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:26.235906 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92b6fd-9ebb-42f9-8ead-7af3dddd9ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:26.240049 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92b6fd-9ebb-42f9-8ead-7af3dddd9ae3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:26.243590 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6ed38-2a05-4469-8aff-38235dc5bbfb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:26.258951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c38a4d-f8a3-40ba-83eb-98c21494cf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:26.262932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c38a4d-f8a3-40ba-83eb-98c21494cf7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:26.263178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c38a4d-f8a3-40ba-83eb-98c21494cf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:26.263471 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c38a4d-f8a3-40ba-83eb-98c21494cf7a admin admin] PATH_INFO: `/v3/users/bb535ca61c4347168b5f44733401f12e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:26.268350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c38a4d-f8a3-40ba-83eb-98c21494cf7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb535ca61c4347168b5f44733401f12e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:26.270351 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c38a4d-f8a3-40ba-83eb-98c21494cf7a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:26.273794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 855/1725] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:26.275897 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92b6fd-9ebb-42f9-8ead-7af3dddd9ae3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:26.281599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8a92b6fd-9ebb-42f9-8ead-7af3dddd9ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:26.317660 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92b6fd-9ebb-42f9-8ead-7af3dddd9ae3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:26.334362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f660fd-8967-4dcb-803a-a8c751707b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:26.335084 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f660fd-8967-4dcb-803a-a8c751707b79 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:26.335445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f660fd-8967-4dcb-803a-a8c751707b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:26.336830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f660fd-8967-4dcb-803a-a8c751707b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:26.340688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f660fd-8967-4dcb-803a-a8c751707b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:26.349400 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f660fd-8967-4dcb-803a-a8c751707b79 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:26.381539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 856/1726] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:26.386769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f660fd-8967-4dcb-803a-a8c751707b79 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:26.396925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-11c38a4d-f8a3-40ba-83eb-98c21494cf7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb535ca61c4347168b5f44733401f12e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:26.401195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f660fd-8967-4dcb-803a-a8c751707b79 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:26.409162 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddb55e-ed33-4034-9237-bb6e137e1189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:26.410128 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddb55e-ed33-4034-9237-bb6e137e1189 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:26.410688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddb55e-ed33-4034-9237-bb6e137e1189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:26.411154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddb55e-ed33-4034-9237-bb6e137e1189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:26.412100 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ddb55e-ed33-4034-9237-bb6e137e1189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:26.414744 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ddb55e-ed33-4034-9237-bb6e137e1189 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:26.424920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-11c38a4d-f8a3-40ba-83eb-98c21494cf7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb535ca61c4347168b5f44733401f12e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:26.429375 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 857/1727] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:26.430446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddb55e-ed33-4034-9237-bb6e137e1189 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:26.446933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddb55e-ed33-4034-9237-bb6e137e1189 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:26.455115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-11c38a4d-f8a3-40ba-83eb-98c21494cf7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb535ca61c4347168b5f44733401f12e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:26.457185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5589ce-5929-4c8e-a1a2-add0eeca5b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:26.459073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5589ce-5929-4c8e-a1a2-add0eeca5b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:26.459567 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5589ce-5929-4c8e-a1a2-add0eeca5b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:26.460689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5589ce-5929-4c8e-a1a2-add0eeca5b79 admin admin] PATH_INFO: `/v3/projects/327122b079d54e4c9bc630a39c28cde5/users/1e85c4c41f08411b8242a63fd96e5339/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:26.485324 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-11c38a4d-f8a3-40ba-83eb-98c21494cf7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb535ca61c4347168b5f44733401f12e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:26.486103 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-11c38a4d-f8a3-40ba-83eb-98c21494cf7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb535ca61c4347168b5f44733401f12e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:26.494525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 871/1728] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:26 2022] DELETE /identity/v3/users/bb535ca61c4347168b5f44733401f12e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:26.495085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c38a4d-f8a3-40ba-83eb-98c21494cf7a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:26.496441 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-11c38a4d-f8a3-40ba-83eb-98c21494cf7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:26.518326 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5589ce-5929-4c8e-a1a2-add0eeca5b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=327122b079d54e4c9bc630a39c28cde5, user_id=1e85c4c41f08411b8242a63fd96e5339, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:26.522455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5589ce-5929-4c8e-a1a2-add0eeca5b79 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:26.559060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 858/1729] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:26 2022] PUT /identity/v3/projects/327122b079d54e4c9bc630a39c28cde5/users/1e85c4c41f08411b8242a63fd96e5339/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:26.569512 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5589ce-5929-4c8e-a1a2-add0eeca5b79 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:26.584796 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ce5589ce-5929-4c8e-a1a2-add0eeca5b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:26.656938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c38a4d-f8a3-40ba-83eb-98c21494cf7a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:26.768142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5589ce-5929-4c8e-a1a2-add0eeca5b79 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:26.795725 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:26.808433 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5ec6f-4a1c-4fe5-a248-72850c24ce09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:26.809712 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5ec6f-4a1c-4fe5-a248-72850c24ce09 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:26.812002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5ec6f-4a1c-4fe5-a248-72850c24ce09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:26.812413 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5ec6f-4a1c-4fe5-a248-72850c24ce09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:26.813193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5ec6f-4a1c-4fe5-a248-72850c24ce09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:26.817987 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a238a3c-a982-4d53-b8d4-bacd984a9788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:26.818307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5ec6f-4a1c-4fe5-a248-72850c24ce09 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:26.818674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a238a3c-a982-4d53-b8d4-bacd984a9788 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:26.818957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a238a3c-a982-4d53-b8d4-bacd984a9788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:26.819241 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a238a3c-a982-4d53-b8d4-bacd984a9788 admin admin] PATH_INFO: `/v3/projects/c471205451b84a7e841ae4c7214eb05f/users/2f7dd596252a43eb9fd3ab49b7cfb4c3/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:26.851966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 859/1730] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:26.859963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5ec6f-4a1c-4fe5-a248-72850c24ce09 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:26.866078 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-32e5ec6f-4a1c-4fe5-a248-72850c24ce09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:26.899260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a238a3c-a982-4d53-b8d4-bacd984a9788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c471205451b84a7e841ae4c7214eb05f, user_id=2f7dd596252a43eb9fd3ab49b7cfb4c3, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:26.905155 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a238a3c-a982-4d53-b8d4-bacd984a9788 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:26.948416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 872/1731] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:26 2022] PUT /identity/v3/projects/c471205451b84a7e841ae4c7214eb05f/users/2f7dd596252a43eb9fd3ab49b7cfb4c3/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:26.962104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a238a3c-a982-4d53-b8d4-bacd984a9788 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:27.059434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5ec6f-4a1c-4fe5-a248-72850c24ce09 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:27.103564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:27.106240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a238a3c-a982-4d53-b8d4-bacd984a9788 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:27.114092 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4831a-786b-463e-9bd5-897544cff5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:27.115053 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4831a-786b-463e-9bd5-897544cff5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:27.115343 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4831a-786b-463e-9bd5-897544cff5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:27.115754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4831a-786b-463e-9bd5-897544cff5c0 admin admin] PATH_INFO: `/v3/projects/327122b079d54e4c9bc630a39c28cde5/users/1e85c4c41f08411b8242a63fd96e5339/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:27.118194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4831a-786b-463e-9bd5-897544cff5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=327122b079d54e4c9bc630a39c28cde5, user_id=1e85c4c41f08411b8242a63fd96e5339, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:27.121608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4831a-786b-463e-9bd5-897544cff5c0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:27.136440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 873/1732] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:26 2022] PUT /identity/v3/projects/327122b079d54e4c9bc630a39c28cde5/users/1e85c4c41f08411b8242a63fd96e5339/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:27.138081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e83c5-8a7a-481a-b0c0-843677b1150a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:27.138449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e83c5-8a7a-481a-b0c0-843677b1150a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:27.139080 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e83c5-8a7a-481a-b0c0-843677b1150a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:27.196059 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c7c10-3a60-494c-b94b-fcfe379b0fef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e1c7e6ee814b47912760cf7daf54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:27.197022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c7c10-3a60-494c-b94b-fcfe379b0fef service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:27.197839 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c7c10-3a60-494c-b94b-fcfe379b0fef service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:27.198153 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c7c10-3a60-494c-b94b-fcfe379b0fef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:27.203866 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-119c7c10-3a60-494c-b94b-fcfe379b0fef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:27.210564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-337e83c5-8a7a-481a-b0c0-843677b1150a None None] MFA Rules not processed for user `2f7dd596252a43eb9fd3ab49b7cfb4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:27.212091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-337e83c5-8a7a-481a-b0c0-843677b1150a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:27.224990 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c7c10-3a60-494c-b94b-fcfe379b0fef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:27.231055 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c7c10-3a60-494c-b94b-fcfe379b0fef service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:27.243856 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 860/1733] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:27.245324 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158726c-2ea9-443b-8273-768260999f70 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:27.245680 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158726c-2ea9-443b-8273-768260999f70 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:27.246031 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158726c-2ea9-443b-8273-768260999f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:27.301021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0158726c-2ea9-443b-8273-768260999f70 None None] MFA Rules not processed for user `1e85c4c41f08411b8242a63fd96e5339`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:27.302062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0158726c-2ea9-443b-8273-768260999f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:27.410392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 874/1734] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:27.423882 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e83c5-8a7a-481a-b0c0-843677b1150a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:27.472610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 861/1735] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:27.490291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158726c-2ea9-443b-8273-768260999f70 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:27.493578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0158726c-2ea9-443b-8273-768260999f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:27.588520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e83c5-8a7a-481a-b0c0-843677b1150a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:27.606368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c095ee-d3aa-4f95-ac14-eae7dd617353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:27.607173 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c095ee-d3aa-4f95-ac14-eae7dd617353 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:27.607641 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c095ee-d3aa-4f95-ac14-eae7dd617353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:27.608060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c095ee-d3aa-4f95-ac14-eae7dd617353 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:27.609445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c095ee-d3aa-4f95-ac14-eae7dd617353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:27.611517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c095ee-d3aa-4f95-ac14-eae7dd617353 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:27.622357 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158726c-2ea9-443b-8273-768260999f70 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:27.626270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:27.630452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa76c57-7b53-476c-9360-9d7781590bf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:27.630452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa76c57-7b53-476c-9360-9d7781590bf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:27.630452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa76c57-7b53-476c-9360-9d7781590bf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:27.632389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa76c57-7b53-476c-9360-9d7781590bf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:27.659428 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa76c57-7b53-476c-9360-9d7781590bf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:27.662737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa76c57-7b53-476c-9360-9d7781590bf4 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:27.676159 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 875/1736] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:27 2022] POST /identity/v3/projects => generated 375 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:27.677965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce004ed-2e69-4266-a5c7-0f1cd1e9f44c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:27.678509 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce004ed-2e69-4266-a5c7-0f1cd1e9f44c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:27.678880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce004ed-2e69-4266-a5c7-0f1cd1e9f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:27.702531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 862/1737] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:25:27.703521 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa76c57-7b53-476c-9360-9d7781590bf4 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:27.717447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1ce004ed-2e69-4266-a5c7-0f1cd1e9f44c None None] MFA Rules not processed for user `a9f0bcfc9c4b48d98cd3385309adaafb`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:27.719859 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1ce004ed-2e69-4266-a5c7-0f1cd1e9f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:27.742725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa76c57-7b53-476c-9360-9d7781590bf4 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:27.873319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 876/1738] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:27.875654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce004ed-2e69-4266-a5c7-0f1cd1e9f44c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:27.892332 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:27.942695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fff8ef-b2eb-44b0-8207-40785b38d647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:27.944380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fff8ef-b2eb-44b0-8207-40785b38d647 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:27.944915 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fff8ef-b2eb-44b0-8207-40785b38d647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:27.945379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fff8ef-b2eb-44b0-8207-40785b38d647 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:27.946269 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fff8ef-b2eb-44b0-8207-40785b38d647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:27.948708 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fff8ef-b2eb-44b0-8207-40785b38d647 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:27.975550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce004ed-2e69-4266-a5c7-0f1cd1e9f44c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:27.980918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b351e-9866-4f0b-9f87-2bd1bacff1df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:27.981826 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b351e-9866-4f0b-9f87-2bd1bacff1df service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:27.982076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b351e-9866-4f0b-9f87-2bd1bacff1df service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:27.982480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b351e-9866-4f0b-9f87-2bd1bacff1df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:27.993199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9c9b351e-9866-4f0b-9f87-2bd1bacff1df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:27.996050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 863/1739] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:27 2022] POST /identity/v3/users => generated 294 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:27.997118 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fff8ef-b2eb-44b0-8207-40785b38d647 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:28.003736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-81fff8ef-b2eb-44b0-8207-40785b38d647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:28.190973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b351e-9866-4f0b-9f87-2bd1bacff1df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:28.190973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b351e-9866-4f0b-9f87-2bd1bacff1df service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:28.209772 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 877/1740] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:28.211371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b351e-9866-4f0b-9f87-2bd1bacff1df service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:28.236418 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b351e-9866-4f0b-9f87-2bd1bacff1df service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:28.241403 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fff8ef-b2eb-44b0-8207-40785b38d647 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:28.246284 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d7981-1c8e-4057-b406-8fe6278bd58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:28.251894 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d7981-1c8e-4057-b406-8fe6278bd58d admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:28.252299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d7981-1c8e-4057-b406-8fe6278bd58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:28.252733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d7981-1c8e-4057-b406-8fe6278bd58d admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:28.253497 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d7981-1c8e-4057-b406-8fe6278bd58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:28.256369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d7981-1c8e-4057-b406-8fe6278bd58d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:28.257729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058d0ed-1500-4c1f-8e3f-df96c34a5df3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:28.259634 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058d0ed-1500-4c1f-8e3f-df96c34a5df3 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:28.261324 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058d0ed-1500-4c1f-8e3f-df96c34a5df3 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:28.261623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058d0ed-1500-4c1f-8e3f-df96c34a5df3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:28.274233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 878/1741] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:28.275311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d7981-1c8e-4057-b406-8fe6278bd58d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:28.277802 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-395d7981-1c8e-4057-b406-8fe6278bd58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:28.283616 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058d0ed-1500-4c1f-8e3f-df96c34a5df3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:28.301518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058d0ed-1500-4c1f-8e3f-df96c34a5df3 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:28.331292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d7981-1c8e-4057-b406-8fe6278bd58d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:28.333080 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 864/1742] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:28.334528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058d0ed-1500-4c1f-8e3f-df96c34a5df3 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:28.338152 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b591184-46b1-4cb8-ad26-e418fb73042f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:28.338852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b591184-46b1-4cb8-ad26-e418fb73042f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:28.339593 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b591184-46b1-4cb8-ad26-e418fb73042f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:28.339835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b591184-46b1-4cb8-ad26-e418fb73042f admin admin] PATH_INFO: `/v3/projects/9b7c056f41284ff4a039196cefae1187` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:28.341650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b591184-46b1-4cb8-ad26-e418fb73042f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b7c056f41284ff4a039196cefae1187)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:28.345808 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b591184-46b1-4cb8-ad26-e418fb73042f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:28.369557 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:28.381739 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058d0ed-1500-4c1f-8e3f-df96c34a5df3 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:28.396458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9922951-3f65-490f-a785-7598844bbe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:28.397536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9922951-3f65-490f-a785-7598844bbe84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:28.398047 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9922951-3f65-490f-a785-7598844bbe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:28.398591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9922951-3f65-490f-a785-7598844bbe84 admin admin] PATH_INFO: `/v3/projects/d979076962104285a96fb28898bc9722/users/c1bc567ceffc46f79c3bb0d15a17386d/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:28.437283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9922951-3f65-490f-a785-7598844bbe84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d979076962104285a96fb28898bc9722, user_id=c1bc567ceffc46f79c3bb0d15a17386d, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:28.446823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9922951-3f65-490f-a785-7598844bbe84 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:28.475835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7b591184-46b1-4cb8-ad26-e418fb73042f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7c056f41284ff4a039196cefae1187', 'request_id': 'req-7b591184-46b1-4cb8-ad26-e418fb73042f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:28.484618 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 865/1743] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:28 2022] PUT /identity/v3/projects/d979076962104285a96fb28898bc9722/users/c1bc567ceffc46f79c3bb0d15a17386d/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:28.485766 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9922951-3f65-490f-a785-7598844bbe84 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:28.487788 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7b591184-46b1-4cb8-ad26-e418fb73042f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7c056f41284ff4a039196cefae1187', 'request_id': 'req-7b591184-46b1-4cb8-ad26-e418fb73042f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:28.500409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7b591184-46b1-4cb8-ad26-e418fb73042f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7c056f41284ff4a039196cefae1187', 'request_id': 'req-7b591184-46b1-4cb8-ad26-e418fb73042f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:28.519330 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7b591184-46b1-4cb8-ad26-e418fb73042f admin admin] The token cache is being invalidate because project 9b7c056f41284ff4a039196cefae1187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:28.519862 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7b591184-46b1-4cb8-ad26-e418fb73042f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:28.520760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7b591184-46b1-4cb8-ad26-e418fb73042f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:28.522434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 879/1744] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:28 2022] DELETE /identity/v3/projects/9b7c056f41284ff4a039196cefae1187 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:28.530708 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f5cb-e6fb-4ee5-95b2-5944db2ae13f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:28.530708 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f5cb-e6fb-4ee5-95b2-5944db2ae13f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:28.531025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f5cb-e6fb-4ee5-95b2-5944db2ae13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:28.637374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c268f5cb-e6fb-4ee5-95b2-5944db2ae13f None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:28.641549 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c268f5cb-e6fb-4ee5-95b2-5944db2ae13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:28.674389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9922951-3f65-490f-a785-7598844bbe84 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:28.688154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a2fb7-f5e3-425e-9e22-734825fd882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:28.691358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a2fb7-f5e3-425e-9e22-734825fd882f admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:28.692940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a2fb7-f5e3-425e-9e22-734825fd882f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:28.694967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a2fb7-f5e3-425e-9e22-734825fd882f admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:28.697535 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a2fb7-f5e3-425e-9e22-734825fd882f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:28.705974 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a2fb7-f5e3-425e-9e22-734825fd882f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:28.731128 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 866/1745] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:28.733945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a2fb7-f5e3-425e-9e22-734825fd882f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:28.739616 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-057a2fb7-f5e3-425e-9e22-734825fd882f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:28.770635 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a2fb7-f5e3-425e-9e22-734825fd882f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:28.778044 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79688b8c-93e9-4811-92d8-4e68f4b5afd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:28.779210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79688b8c-93e9-4811-92d8-4e68f4b5afd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:28.779496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79688b8c-93e9-4811-92d8-4e68f4b5afd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:28.779773 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79688b8c-93e9-4811-92d8-4e68f4b5afd0 admin admin] PATH_INFO: `/v3/projects/d979076962104285a96fb28898bc9722/users/c1bc567ceffc46f79c3bb0d15a17386d/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:28.784964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79688b8c-93e9-4811-92d8-4e68f4b5afd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d979076962104285a96fb28898bc9722, user_id=c1bc567ceffc46f79c3bb0d15a17386d, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:28.794660 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79688b8c-93e9-4811-92d8-4e68f4b5afd0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:28.838433 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 867/1746] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:28 2022] PUT /identity/v3/projects/d979076962104285a96fb28898bc9722/users/c1bc567ceffc46f79c3bb0d15a17386d/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:28.839964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2f2af-bb46-4b1e-bcfb-abc11544babb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:28.840259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2f2af-bb46-4b1e-bcfb-abc11544babb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:28.841179 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2f2af-bb46-4b1e-bcfb-abc11544babb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:28.841290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 880/1747] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:28.842832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7a5c2-77b9-4432-adec-b69e4be5c358 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:28.843222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7a5c2-77b9-4432-adec-b69e4be5c358 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:28.843602 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7a5c2-77b9-4432-adec-b69e4be5c358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:28.884550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:28.905159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8ec2f2af-bb46-4b1e-bcfb-abc11544babb None None] MFA Rules not processed for user `8f34b288e7b1499ea30c2c87023cb917`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:28.908098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8ec2f2af-bb46-4b1e-bcfb-abc11544babb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:28.913120 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f1e7a5c2-77b9-4432-adec-b69e4be5c358 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:28.921601 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f1e7a5c2-77b9-4432-adec-b69e4be5c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:29.059484 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 881/1748] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:29.061708 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da747-a9be-4e5d-82d8-c04d847a644e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:29.061988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da747-a9be-4e5d-82d8-c04d847a644e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:29.062424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da747-a9be-4e5d-82d8-c04d847a644e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:29.105213 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ae8da747-a9be-4e5d-82d8-c04d847a644e None None] MFA Rules not processed for user `c1bc567ceffc46f79c3bb0d15a17386d`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:29.105847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 868/1749] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:29.106954 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2f2af-bb46-4b1e-bcfb-abc11544babb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:29.107493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ae8da747-a9be-4e5d-82d8-c04d847a644e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:29.130749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2f2af-bb46-4b1e-bcfb-abc11544babb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:29.142561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4100f2-b5ea-495e-b570-a0435e466bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:29.143201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4100f2-b5ea-495e-b570-a0435e466bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:29.146896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4100f2-b5ea-495e-b570-a0435e466bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:29.147121 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4100f2-b5ea-495e-b570-a0435e466bcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:29.147871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4100f2-b5ea-495e-b570-a0435e466bcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:29.148184 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4100f2-b5ea-495e-b570-a0435e466bcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:29.151007 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4100f2-b5ea-495e-b570-a0435e466bcd admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:29.182979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 869/1750] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:29.185473 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79900c8a-b5d4-4116-9564-023b00de584c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:29.185769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79900c8a-b5d4-4116-9564-023b00de584c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:29.186052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79900c8a-b5d4-4116-9564-023b00de584c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:29.193955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:29.222620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-79900c8a-b5d4-4116-9564-023b00de584c None None] MFA Rules not processed for user `8f34b288e7b1499ea30c2c87023cb917`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:29.224025 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-79900c8a-b5d4-4116-9564-023b00de584c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:29.251764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 870/1751] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:29.257495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79900c8a-b5d4-4116-9564-023b00de584c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:29.283244 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79900c8a-b5d4-4116-9564-023b00de584c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:29.295448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f67d0-c8df-4245-a2cd-f1b899a767bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:29.296685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f67d0-c8df-4245-a2cd-f1b899a767bd admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:29.296962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f67d0-c8df-4245-a2cd-f1b899a767bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:29.297230 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f67d0-c8df-4245-a2cd-f1b899a767bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:29.297851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f67d0-c8df-4245-a2cd-f1b899a767bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:29.308964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f67d0-c8df-4245-a2cd-f1b899a767bd admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:29.314050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 882/1752] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:29.314050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8da747-a9be-4e5d-82d8-c04d847a644e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:29.319083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ae8da747-a9be-4e5d-82d8-c04d847a644e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:29.370655 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 871/1753] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:29 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:29.371745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f67d0-c8df-4245-a2cd-f1b899a767bd admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:29.374784 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-983f67d0-c8df-4245-a2cd-f1b899a767bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:29.445784 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8da747-a9be-4e5d-82d8-c04d847a644e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:29.538499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d046932-5a86-418b-b6bc-4e87b8ab0436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:29.540107 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d046932-5a86-418b-b6bc-4e87b8ab0436 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:29.540515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d046932-5a86-418b-b6bc-4e87b8ab0436 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:29.540815 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d046932-5a86-418b-b6bc-4e87b8ab0436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:29.568842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f67d0-c8df-4245-a2cd-f1b899a767bd admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:29.581255 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bf5df-95b0-432a-a5c3-5cd6ed040893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:29.581889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bf5df-95b0-432a-a5c3-5cd6ed040893 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:29.582168 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bf5df-95b0-432a-a5c3-5cd6ed040893 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:29.582443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bf5df-95b0-432a-a5c3-5cd6ed040893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:29.586395 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ae9bf5df-95b0-432a-a5c3-5cd6ed040893 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:29.674322 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d046932-5a86-418b-b6bc-4e87b8ab0436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:29.677617 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d046932-5a86-418b-b6bc-4e87b8ab0436 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:29.715939 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 883/1754] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:29.718268 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d046932-5a86-418b-b6bc-4e87b8ab0436 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:29.727130 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:29.816390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bf5df-95b0-432a-a5c3-5cd6ed040893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:29.817303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d046932-5a86-418b-b6bc-4e87b8ab0436 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:29.817928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bf5df-95b0-432a-a5c3-5cd6ed040893 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:29.828203 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a329556-5ea6-4d1b-a48c-f4f04d5d6d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:29.829270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a329556-5ea6-4d1b-a48c-f4f04d5d6d76 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:29.829755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a329556-5ea6-4d1b-a48c-f4f04d5d6d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:29.830052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a329556-5ea6-4d1b-a48c-f4f04d5d6d76 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:29.830811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a329556-5ea6-4d1b-a48c-f4f04d5d6d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:29.833068 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a329556-5ea6-4d1b-a48c-f4f04d5d6d76 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:29.868880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 872/1755] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:29.872681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 884/1756] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:29 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:29.881492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bf5df-95b0-432a-a5c3-5cd6ed040893 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:29.921328 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bf5df-95b0-432a-a5c3-5cd6ed040893 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:29.959869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cbb9e-e7fc-460f-83e1-5d9e11c54747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:29.960627 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cbb9e-e7fc-460f-83e1-5d9e11c54747 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:29.961837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cbb9e-e7fc-460f-83e1-5d9e11c54747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:29.962725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cbb9e-e7fc-460f-83e1-5d9e11c54747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:29.963491 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cbb9e-e7fc-460f-83e1-5d9e11c54747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:29.965233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cbb9e-e7fc-460f-83e1-5d9e11c54747 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:30.022458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 873/1757] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:30.022758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a329556-5ea6-4d1b-a48c-f4f04d5d6d76 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:30.058601 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a329556-5ea6-4d1b-a48c-f4f04d5d6d76 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:30.078218 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef722982-be94-4989-a854-a4d75343f79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:30.079779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef722982-be94-4989-a854-a4d75343f79f admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:30.080066 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef722982-be94-4989-a854-a4d75343f79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:30.082455 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef722982-be94-4989-a854-a4d75343f79f admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:30.083161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef722982-be94-4989-a854-a4d75343f79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:30.092077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef722982-be94-4989-a854-a4d75343f79f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:30.135262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 885/1758] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:30.136781 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cbb9e-e7fc-460f-83e1-5d9e11c54747 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:30.143807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:30.153581 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cbb9e-e7fc-460f-83e1-5d9e11c54747 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:30.169176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872d159-d24f-4d39-82bb-d91554dfdc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:30.170037 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d159-d24f-4d39-82bb-d91554dfdc78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:30.170509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d159-d24f-4d39-82bb-d91554dfdc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:30.171549 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d159-d24f-4d39-82bb-d91554dfdc78 admin admin] PATH_INFO: `/v3/projects/0a0292d063db4d72a54b7e3711353e7d/users/a0cbe868f2174c1ab55f0fa1265fba30/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:30.217407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872d159-d24f-4d39-82bb-d91554dfdc78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0292d063db4d72a54b7e3711353e7d, user_id=a0cbe868f2174c1ab55f0fa1265fba30, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:30.221253 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872d159-d24f-4d39-82bb-d91554dfdc78 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:30.259483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 874/1759] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:30 2022] PUT /identity/v3/projects/0a0292d063db4d72a54b7e3711353e7d/users/a0cbe868f2174c1ab55f0fa1265fba30/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:30.271668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c37d72-0229-452b-99c7-aa165bde4f49 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:30.271668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c37d72-0229-452b-99c7-aa165bde4f49 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:30.271668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c37d72-0229-452b-99c7-aa165bde4f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:30.334340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-34c37d72-0229-452b-99c7-aa165bde4f49 None None] MFA Rules not processed for user `a0cbe868f2174c1ab55f0fa1265fba30`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:30.342513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-34c37d72-0229-452b-99c7-aa165bde4f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:30.557839 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 886/1760] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:30.562860 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872d159-d24f-4d39-82bb-d91554dfdc78 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:30.754594 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e842663-b91d-4e98-b74c-34af0197a6cd None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:30.754884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e842663-b91d-4e98-b74c-34af0197a6cd None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:30.755163 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e842663-b91d-4e98-b74c-34af0197a6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:30.807854 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872d159-d24f-4d39-82bb-d91554dfdc78 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:30.818381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd2571-09ea-444e-b7a4-b4fc18c85d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:30.819269 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd2571-09ea-444e-b7a4-b4fc18c85d3e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:30.819609 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd2571-09ea-444e-b7a4-b4fc18c85d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:30.819987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd2571-09ea-444e-b7a4-b4fc18c85d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:30.820965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd2571-09ea-444e-b7a4-b4fc18c85d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:30.822763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd2571-09ea-444e-b7a4-b4fc18c85d3e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:30.886125 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 875/1761] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:30 2022] POST /identity/v3/projects => generated 373 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:30.887850 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c96de-ff6c-4a84-849a-a0a7d5525ea2 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:30.888125 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c96de-ff6c-4a84-849a-a0a7d5525ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:30.890150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c96de-ff6c-4a84-849a-a0a7d5525ea2 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:30.896907 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 876/1762] 10.222.0.40 () {54 vars in 912 bytes} [Thu Aug 11 16:25:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:25:30.897827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c96de-ff6c-4a84-849a-a0a7d5525ea2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:30.954621 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3e842663-b91d-4e98-b74c-34af0197a6cd None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:30.960940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3e842663-b91d-4e98-b74c-34af0197a6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:31.044986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c96de-ff6c-4a84-849a-a0a7d5525ea2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:31.065375 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e80c7-7f60-4eac-b55d-80d933c12eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:31.070936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e80c7-7f60-4eac-b55d-80d933c12eca admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:31.072461 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e80c7-7f60-4eac-b55d-80d933c12eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:31.077645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e80c7-7f60-4eac-b55d-80d933c12eca admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:31.078412 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e80c7-7f60-4eac-b55d-80d933c12eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:31.086850 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e80c7-7f60-4eac-b55d-80d933c12eca admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:31.092278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:31.141067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 877/1763] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:30 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:31.142604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33a561-69e5-4a15-89c7-f2bc4d67be73 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:31.145915 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33a561-69e5-4a15-89c7-f2bc4d67be73 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:31.146332 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33a561-69e5-4a15-89c7-f2bc4d67be73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:31.163370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 887/1764] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Aug 11 16:25:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:31.165253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e842663-b91d-4e98-b74c-34af0197a6cd None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:31.201409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7a33a561-69e5-4a15-89c7-f2bc4d67be73 None None] MFA Rules not processed for user `16d2570f97234d62948762562616000c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:31.203204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7a33a561-69e5-4a15-89c7-f2bc4d67be73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:31.211125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e842663-b91d-4e98-b74c-34af0197a6cd None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:31.227823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b71493-23c9-4fa2-b70e-7200121cb52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:31.230619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b71493-23c9-4fa2-b70e-7200121cb52c admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:31.230987 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b71493-23c9-4fa2-b70e-7200121cb52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:31.231267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b71493-23c9-4fa2-b70e-7200121cb52c admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:31.231951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b71493-23c9-4fa2-b70e-7200121cb52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:31.235837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b71493-23c9-4fa2-b70e-7200121cb52c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:31.286481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 888/1765] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:31.289818 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b71493-23c9-4fa2-b70e-7200121cb52c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:31.322442 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b71493-23c9-4fa2-b70e-7200121cb52c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:31.333190 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b5880-a20a-4565-a7f9-a9e5e6e4aba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:31.341799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b5880-a20a-4565-a7f9-a9e5e6e4aba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:31.342095 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b5880-a20a-4565-a7f9-a9e5e6e4aba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:31.342660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b5880-a20a-4565-a7f9-a9e5e6e4aba8 admin admin] PATH_INFO: `/v3/projects/c566002513ed4a4994d159bb2eb79a3d/users/202dd9f6206e437cb8425ba3f4cc45d4/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:31.366320 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 878/1766] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Aug 11 16:25:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:31.390466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b5880-a20a-4565-a7f9-a9e5e6e4aba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c566002513ed4a4994d159bb2eb79a3d, user_id=202dd9f6206e437cb8425ba3f4cc45d4, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:31.395209 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b5880-a20a-4565-a7f9-a9e5e6e4aba8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:31.404025 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33a561-69e5-4a15-89c7-f2bc4d67be73 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:31.406617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7a33a561-69e5-4a15-89c7-f2bc4d67be73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:31.415186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:31.417928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 889/1767] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:31 2022] PUT /identity/v3/projects/c566002513ed4a4994d159bb2eb79a3d/users/202dd9f6206e437cb8425ba3f4cc45d4/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:25:31.423778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b5880-a20a-4565-a7f9-a9e5e6e4aba8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:31.428088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33a561-69e5-4a15-89c7-f2bc4d67be73 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:31.574276 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f04d40-b4e1-4abb-be71-5ad977644ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:31.574276 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f04d40-b4e1-4abb-be71-5ad977644ddc service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:31.574617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f04d40-b4e1-4abb-be71-5ad977644ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:31.574933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f04d40-b4e1-4abb-be71-5ad977644ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:31.591407 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b5880-a20a-4565-a7f9-a9e5e6e4aba8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:31.592510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f04d40-b4e1-4abb-be71-5ad977644ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:31.596333 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f04d40-b4e1-4abb-be71-5ad977644ddc service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:31.603974 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27749eb-48bc-4b6a-b9f9-f0b1f5f8e79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:31.605061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27749eb-48bc-4b6a-b9f9-f0b1f5f8e79e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:31.606648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27749eb-48bc-4b6a-b9f9-f0b1f5f8e79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:31.606648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27749eb-48bc-4b6a-b9f9-f0b1f5f8e79e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:31.609432 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27749eb-48bc-4b6a-b9f9-f0b1f5f8e79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:31.611517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27749eb-48bc-4b6a-b9f9-f0b1f5f8e79e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:31.614859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 879/1768] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:31.617470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f04d40-b4e1-4abb-be71-5ad977644ddc service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:31.622785 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-95f04d40-b4e1-4abb-be71-5ad977644ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:31.668484 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 890/1769] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:31.672896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27749eb-48bc-4b6a-b9f9-f0b1f5f8e79e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:31.720646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27749eb-48bc-4b6a-b9f9-f0b1f5f8e79e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:31.737419 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32931d-b700-4d3e-ae96-74bfa68f64fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:31.738107 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32931d-b700-4d3e-ae96-74bfa68f64fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:31.738389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32931d-b700-4d3e-ae96-74bfa68f64fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:31.738694 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32931d-b700-4d3e-ae96-74bfa68f64fb admin admin] PATH_INFO: `/v3/projects/c566002513ed4a4994d159bb2eb79a3d/users/202dd9f6206e437cb8425ba3f4cc45d4/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:31.750014 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32931d-b700-4d3e-ae96-74bfa68f64fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c566002513ed4a4994d159bb2eb79a3d, user_id=202dd9f6206e437cb8425ba3f4cc45d4, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:31.788425 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32931d-b700-4d3e-ae96-74bfa68f64fb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:31.831169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 891/1770] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:31 2022] PUT /identity/v3/projects/c566002513ed4a4994d159bb2eb79a3d/users/202dd9f6206e437cb8425ba3f4cc45d4/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:31.837846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051891d9-7e15-4260-b049-0f912b44469c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:31.839072 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051891d9-7e15-4260-b049-0f912b44469c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:31.840304 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051891d9-7e15-4260-b049-0f912b44469c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:31.928855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-051891d9-7e15-4260-b049-0f912b44469c None None] MFA Rules not processed for user `7b0f9418982c4a8e8ebd5cf4419c5418`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:31.932217 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-051891d9-7e15-4260-b049-0f912b44469c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:31.967463 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f04d40-b4e1-4abb-be71-5ad977644ddc service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:32.125626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 892/1771] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:32.127408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfe79d-0b99-4518-ac8b-ab7993d9f874 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:32.127697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfe79d-0b99-4518-ac8b-ab7993d9f874 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:32.127970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfe79d-0b99-4518-ac8b-ab7993d9f874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:32.200937 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94916250-55fc-4a47-83b8-76b4a4fd4a5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:32.204202 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-dcdfe79d-0b99-4518-ac8b-ab7993d9f874 None None] MFA Rules not processed for user `202dd9f6206e437cb8425ba3f4cc45d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:32.205052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94916250-55fc-4a47-83b8-76b4a4fd4a5c service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:32.205698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94916250-55fc-4a47-83b8-76b4a4fd4a5c service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:32.207222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dcdfe79d-0b99-4518-ac8b-ab7993d9f874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:32.208488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94916250-55fc-4a47-83b8-76b4a4fd4a5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:32.278361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:32.319704 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:32.378909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 893/1772] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:32.380427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfe79d-0b99-4518-ac8b-ab7993d9f874 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:32.382478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dcdfe79d-0b99-4518-ac8b-ab7993d9f874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:32.417520 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94916250-55fc-4a47-83b8-76b4a4fd4a5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:32.427627 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94916250-55fc-4a47-83b8-76b4a4fd4a5c service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:32.497145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 880/1773] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:25:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 881 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:25:32.498987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94916250-55fc-4a47-83b8-76b4a4fd4a5c service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:32.501377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-94916250-55fc-4a47-83b8-76b4a4fd4a5c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:32.590684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfe79d-0b99-4518-ac8b-ab7993d9f874 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:32.613425 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952df40-2f1d-4acc-b536-d579b7199f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:32.614093 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952df40-2f1d-4acc-b536-d579b7199f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:32.617087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952df40-2f1d-4acc-b536-d579b7199f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:32.617367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952df40-2f1d-4acc-b536-d579b7199f60 admin admin] PATH_INFO: `/v3/users/b109cf49884d4b38817921b03f5da8bb` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:32.624156 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952df40-2f1d-4acc-b536-d579b7199f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b109cf49884d4b38817921b03f5da8bb)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:32.629650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952df40-2f1d-4acc-b536-d579b7199f60 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:32.744771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94916250-55fc-4a47-83b8-76b4a4fd4a5c service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:32.763653 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159179b-1525-4d3a-b0f2-a4cefb1a6c52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:32.767017 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159179b-1525-4d3a-b0f2-a4cefb1a6c52 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:32.768869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159179b-1525-4d3a-b0f2-a4cefb1a6c52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:32.769547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159179b-1525-4d3a-b0f2-a4cefb1a6c52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:32.789326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6952df40-2f1d-4acc-b536-d579b7199f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b109cf49884d4b38817921b03f5da8bb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:32.805463 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159179b-1525-4d3a-b0f2-a4cefb1a6c52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:32.810325 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159179b-1525-4d3a-b0f2-a4cefb1a6c52 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:32.838058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6952df40-2f1d-4acc-b536-d579b7199f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b109cf49884d4b38817921b03f5da8bb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:32.864947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 881/1774] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:32.869114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6952df40-2f1d-4acc-b536-d579b7199f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b109cf49884d4b38817921b03f5da8bb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:32.874708 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ead92-5a99-40e0-95b1-17ebfe72bafc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:32.874997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ead92-5a99-40e0-95b1-17ebfe72bafc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:32.875312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ead92-5a99-40e0-95b1-17ebfe72bafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:32.918972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6952df40-2f1d-4acc-b536-d579b7199f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b109cf49884d4b38817921b03f5da8bb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:32.923785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6952df40-2f1d-4acc-b536-d579b7199f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b109cf49884d4b38817921b03f5da8bb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:32.950555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 894/1775] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:32 2022] DELETE /identity/v3/users/b109cf49884d4b38817921b03f5da8bb => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:32.956962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc1474-1971-4e84-bc15-598f69032e7d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:32.957249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc1474-1971-4e84-bc15-598f69032e7d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:32.957528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc1474-1971-4e84-bc15-598f69032e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:32.971827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4a8ead92-5a99-40e0-95b1-17ebfe72bafc None None] MFA Rules not processed for user `a9f0bcfc9c4b48d98cd3385309adaafb`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:32.974260 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4a8ead92-5a99-40e0-95b1-17ebfe72bafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:33.035211 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5ccc1474-1971-4e84-bc15-598f69032e7d None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:33.040061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5ccc1474-1971-4e84-bc15-598f69032e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:33.156267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:33.187431 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 882/1776] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:33.250887 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 895/1777] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:33.262709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ead92-5a99-40e0-95b1-17ebfe72bafc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:33.265555 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4a8ead92-5a99-40e0-95b1-17ebfe72bafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:33.446932 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ead92-5a99-40e0-95b1-17ebfe72bafc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:33.450727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c58d4-8d8b-4c79-bf75-21b787703c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:33.451424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c58d4-8d8b-4c79-bf75-21b787703c27 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:33.452470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c58d4-8d8b-4c79-bf75-21b787703c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:33.452844 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c58d4-8d8b-4c79-bf75-21b787703c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:33.494322 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c58d4-8d8b-4c79-bf75-21b787703c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:33.496150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c58d4-8d8b-4c79-bf75-21b787703c27 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:33.552516 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 883/1778] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:33.644138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc1474-1971-4e84-bc15-598f69032e7d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:33.645947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5ccc1474-1971-4e84-bc15-598f69032e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:33.888287 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc1474-1971-4e84-bc15-598f69032e7d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:33.905890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3bef3-e598-466b-8d19-c4f37588ef72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:33.906934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3bef3-e598-466b-8d19-c4f37588ef72 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:33.907627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3bef3-e598-466b-8d19-c4f37588ef72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:33.908113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3bef3-e598-466b-8d19-c4f37588ef72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:33.914073 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cbb3bef3-e598-466b-8d19-c4f37588ef72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:34.194806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3bef3-e598-466b-8d19-c4f37588ef72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:34.196764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3bef3-e598-466b-8d19-c4f37588ef72 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:34.247095 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 896/1779] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:34.432210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c58d4-8d8b-4c79-bf75-21b787703c27 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:34.435958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-272c58d4-8d8b-4c79-bf75-21b787703c27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:34.487810 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c58d4-8d8b-4c79-bf75-21b787703c27 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:34.495710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:34.496893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:34.497332 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:34.497810 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119 admin admin] PATH_INFO: `/v3/projects/f0f84cda8122477fac657f75f33b7661` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:34.499941 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f84cda8122477fac657f75f33b7661)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:34.503399 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:34.530644 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:34.535529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdcfc0-77a5-4271-9fe9-3b48af279b69 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:34.535820 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdcfc0-77a5-4271-9fe9-3b48af279b69 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:34.536337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdcfc0-77a5-4271-9fe9-3b48af279b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:34.596996 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-bbcdcfc0-77a5-4271-9fe9-3b48af279b69 None None] MFA Rules not processed for user `16d2570f97234d62948762562616000c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:34.599833 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bbcdcfc0-77a5-4271-9fe9-3b48af279b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:34.690218 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f84cda8122477fac657f75f33b7661', 'request_id': 'req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:34.712222 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f84cda8122477fac657f75f33b7661', 'request_id': 'req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:34.732473 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f84cda8122477fac657f75f33b7661', 'request_id': 'req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:34.795437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119 admin admin] The token cache is being invalidate because project f0f84cda8122477fac657f75f33b7661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:34.805412 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:34.807534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:34.811653 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 884/1780] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:34 2022] DELETE /identity/v3/projects/f0f84cda8122477fac657f75f33b7661 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:34.815780 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:34.818288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:34.821827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 897/1781] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Aug 11 16:25:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:25:34.922913 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdcfc0-77a5-4271-9fe9-3b48af279b69 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:34.925608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bbcdcfc0-77a5-4271-9fe9-3b48af279b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:34.949041 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdcfc0-77a5-4271-9fe9-3b48af279b69 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:34.967978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582e09a-8667-489b-90e4-984fb442e43f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:34.971297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab91d6-47ab-4f41-8b76-27cbb1eae119 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:34.972229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582e09a-8667-489b-90e4-984fb442e43f service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:34.974249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582e09a-8667-489b-90e4-984fb442e43f service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:34.975216 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582e09a-8667-489b-90e4-984fb442e43f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:34.982822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3582e09a-8667-489b-90e4-984fb442e43f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:34.983963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240917f3-a556-4e36-94dc-5bfaba77641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:34.984657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240917f3-a556-4e36-94dc-5bfaba77641b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:34.984944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240917f3-a556-4e36-94dc-5bfaba77641b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:34.985215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240917f3-a556-4e36-94dc-5bfaba77641b admin admin] PATH_INFO: `/v3/users/1e85c4c41f08411b8242a63fd96e5339` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:34.992704 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240917f3-a556-4e36-94dc-5bfaba77641b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e85c4c41f08411b8242a63fd96e5339)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:34.994715 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240917f3-a556-4e36-94dc-5bfaba77641b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:35.023203 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582e09a-8667-489b-90e4-984fb442e43f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:35.028974 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582e09a-8667-489b-90e4-984fb442e43f service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:35.062802 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 898/1782] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:35.113856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c351f-96a6-4393-b556-9ccb72e18dbc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:35.114160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c351f-96a6-4393-b556-9ccb72e18dbc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:35.114848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c351f-96a6-4393-b556-9ccb72e18dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:35.116442 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-240917f3-a556-4e36-94dc-5bfaba77641b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e85c4c41f08411b8242a63fd96e5339'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:35.146780 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-240917f3-a556-4e36-94dc-5bfaba77641b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e85c4c41f08411b8242a63fd96e5339'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:35.169960 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-740c351f-96a6-4393-b556-9ccb72e18dbc None None] MFA Rules not processed for user `8f34b288e7b1499ea30c2c87023cb917`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:35.172271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-740c351f-96a6-4393-b556-9ccb72e18dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:35.196309 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-240917f3-a556-4e36-94dc-5bfaba77641b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e85c4c41f08411b8242a63fd96e5339'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:35.229638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:35.243564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-240917f3-a556-4e36-94dc-5bfaba77641b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e85c4c41f08411b8242a63fd96e5339'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:35.247810 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-240917f3-a556-4e36-94dc-5bfaba77641b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e85c4c41f08411b8242a63fd96e5339'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:35.271622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 885/1783] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:34 2022] DELETE /identity/v3/users/1e85c4c41f08411b8242a63fd96e5339 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:35.274063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240917f3-a556-4e36-94dc-5bfaba77641b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:35.284812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-240917f3-a556-4e36-94dc-5bfaba77641b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:35.361314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 899/1784] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:25:35.398533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:35.664394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240917f3-a556-4e36-94dc-5bfaba77641b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:35.702796 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8b856-526f-47cf-addc-0765a192b63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:35.704854 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8b856-526f-47cf-addc-0765a192b63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:35.705149 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8b856-526f-47cf-addc-0765a192b63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:35.709093 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8b856-526f-47cf-addc-0765a192b63a admin admin] PATH_INFO: `/v3/users/a0cbe868f2174c1ab55f0fa1265fba30` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:35.713436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8b856-526f-47cf-addc-0765a192b63a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0cbe868f2174c1ab55f0fa1265fba30)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:35.720534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8b856-526f-47cf-addc-0765a192b63a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:35.843400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c351f-96a6-4393-b556-9ccb72e18dbc None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:35.845087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-740c351f-96a6-4393-b556-9ccb72e18dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:35.927144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c351f-96a6-4393-b556-9ccb72e18dbc None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:35.933571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2dd8b856-526f-47cf-addc-0765a192b63a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0cbe868f2174c1ab55f0fa1265fba30'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:35.941200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e5dc9-ea31-49e6-9adb-942ab274a620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:35.943292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e5dc9-ea31-49e6-9adb-942ab274a620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:35.944363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e5dc9-ea31-49e6-9adb-942ab274a620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:35.946409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e5dc9-ea31-49e6-9adb-942ab274a620 admin admin] PATH_INFO: `/v3/projects/327122b079d54e4c9bc630a39c28cde5` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:35.949067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e5dc9-ea31-49e6-9adb-942ab274a620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=327122b079d54e4c9bc630a39c28cde5)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:35.952856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e5dc9-ea31-49e6-9adb-942ab274a620 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:35.956616 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2dd8b856-526f-47cf-addc-0765a192b63a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0cbe868f2174c1ab55f0fa1265fba30'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:36.056457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2dd8b856-526f-47cf-addc-0765a192b63a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0cbe868f2174c1ab55f0fa1265fba30'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:36.075108 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2dd8b856-526f-47cf-addc-0765a192b63a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0cbe868f2174c1ab55f0fa1265fba30'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:36.076641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2dd8b856-526f-47cf-addc-0765a192b63a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0cbe868f2174c1ab55f0fa1265fba30'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:36.087708 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 886/1785] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:35 2022] DELETE /identity/v3/users/a0cbe868f2174c1ab55f0fa1265fba30 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:36.089039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ac6e5dc9-ea31-49e6-9adb-942ab274a620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '327122b079d54e4c9bc630a39c28cde5', 'request_id': 'req-ac6e5dc9-ea31-49e6-9adb-942ab274a620'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:36.102277 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ac6e5dc9-ea31-49e6-9adb-942ab274a620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '327122b079d54e4c9bc630a39c28cde5', 'request_id': 'req-ac6e5dc9-ea31-49e6-9adb-942ab274a620'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:36.118111 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee173176-8c25-4b66-877b-79ddd8ee3984 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:36.120003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ac6e5dc9-ea31-49e6-9adb-942ab274a620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '327122b079d54e4c9bc630a39c28cde5', 'request_id': 'req-ac6e5dc9-ea31-49e6-9adb-942ab274a620'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:36.123326 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee173176-8c25-4b66-877b-79ddd8ee3984 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:36.125021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee173176-8c25-4b66-877b-79ddd8ee3984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:36.148958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ac6e5dc9-ea31-49e6-9adb-942ab274a620 admin admin] The token cache is being invalidate because project 327122b079d54e4c9bc630a39c28cde5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:36.149490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ac6e5dc9-ea31-49e6-9adb-942ab274a620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:36.154961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ac6e5dc9-ea31-49e6-9adb-942ab274a620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:36.161276 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 900/1786] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:35 2022] DELETE /identity/v3/projects/327122b079d54e4c9bc630a39c28cde5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:36.163076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6f121-3f36-468c-9778-04c556ff6255 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:36.163521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6f121-3f36-468c-9778-04c556ff6255 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:36.163979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6f121-3f36-468c-9778-04c556ff6255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:36.208419 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-bfb6f121-3f36-468c-9778-04c556ff6255 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:36.209786 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bfb6f121-3f36-468c-9778-04c556ff6255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:36.214851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ee173176-8c25-4b66-877b-79ddd8ee3984 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:36.225340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ee173176-8c25-4b66-877b-79ddd8ee3984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:36.349583 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 901/1787] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:36.351791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c154-ec41-4dcb-b2f5-ae67dc4db3d0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:36.352264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c154-ec41-4dcb-b2f5-ae67dc4db3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:36.352767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c154-ec41-4dcb-b2f5-ae67dc4db3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:36.394442 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 887/1788] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:36.394884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ac30c154-ec41-4dcb-b2f5-ae67dc4db3d0 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:36.406097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ac30c154-ec41-4dcb-b2f5-ae67dc4db3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:36.407688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee173176-8c25-4b66-877b-79ddd8ee3984 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:36.409717 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ee173176-8c25-4b66-877b-79ddd8ee3984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:36.428108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 902/1789] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:36.432502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c154-ec41-4dcb-b2f5-ae67dc4db3d0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:36.450502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c154-ec41-4dcb-b2f5-ae67dc4db3d0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:36.462088 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaadcf9-b493-4122-ad48-dbb8c29e1a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:36.462868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaadcf9-b493-4122-ad48-dbb8c29e1a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:36.463223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaadcf9-b493-4122-ad48-dbb8c29e1a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:36.463619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaadcf9-b493-4122-ad48-dbb8c29e1a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:36.464367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaadcf9-b493-4122-ad48-dbb8c29e1a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:36.464893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaadcf9-b493-4122-ad48-dbb8c29e1a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:36.466521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaadcf9-b493-4122-ad48-dbb8c29e1a44 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:36.531067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 903/1790] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:36.532434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaadcf9-b493-4122-ad48-dbb8c29e1a44 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:36.539742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:36.564148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaadcf9-b493-4122-ad48-dbb8c29e1a44 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:36.576412 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee173176-8c25-4b66-877b-79ddd8ee3984 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:36.587272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f489dac-d9af-4bf9-a1a4-c9220c9aa76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:36.587598 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090a451-617a-412c-be24-b89e07b7a2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:36.587900 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f489dac-d9af-4bf9-a1a4-c9220c9aa76a service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:36.588174 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f489dac-d9af-4bf9-a1a4-c9220c9aa76a service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:36.588924 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090a451-617a-412c-be24-b89e07b7a2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:36.589791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090a451-617a-412c-be24-b89e07b7a2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:36.591308 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090a451-617a-412c-be24-b89e07b7a2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:36.592169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090a451-617a-412c-be24-b89e07b7a2f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:36.593214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f489dac-d9af-4bf9-a1a4-c9220c9aa76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:36.598870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090a451-617a-412c-be24-b89e07b7a2f2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:36.611090 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f489dac-d9af-4bf9-a1a4-c9220c9aa76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:36.615559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f489dac-d9af-4bf9-a1a4-c9220c9aa76a service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:36.645582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 888/1791] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:36.740632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 904/1792] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:36 2022] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:36.745721 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f489dac-d9af-4bf9-a1a4-c9220c9aa76a service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:36.765598 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f489dac-d9af-4bf9-a1a4-c9220c9aa76a service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:36.926046 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bef15-c09f-4b18-9c40-e4b586713772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:36.926970 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bef15-c09f-4b18-9c40-e4b586713772 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:36.927536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bef15-c09f-4b18-9c40-e4b586713772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:36.928011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bef15-c09f-4b18-9c40-e4b586713772 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:36.930017 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bef15-c09f-4b18-9c40-e4b586713772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:36.933562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bef15-c09f-4b18-9c40-e4b586713772 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:37.029532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 889/1793] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:36 2022] POST /identity/v3/users => generated 284 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:25:37.030846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090a451-617a-412c-be24-b89e07b7a2f2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:37.059151 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090a451-617a-412c-be24-b89e07b7a2f2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:37.097215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1539ee1-80ee-4228-a3f1-7f03c4d44386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:37.098161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1539ee1-80ee-4228-a3f1-7f03c4d44386 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:37.102645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1539ee1-80ee-4228-a3f1-7f03c4d44386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:37.103047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1539ee1-80ee-4228-a3f1-7f03c4d44386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:37.106014 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1539ee1-80ee-4228-a3f1-7f03c4d44386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:37.128500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1539ee1-80ee-4228-a3f1-7f03c4d44386 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:37.226364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 905/1794] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:37.231106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bef15-c09f-4b18-9c40-e4b586713772 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:37.273707 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bef15-c09f-4b18-9c40-e4b586713772 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:37.291672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d1852-b79b-4998-a283-49ff111a371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:37.292553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d1852-b79b-4998-a283-49ff111a371c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:37.293080 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d1852-b79b-4998-a283-49ff111a371c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:37.293600 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d1852-b79b-4998-a283-49ff111a371c admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:37.296209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d1852-b79b-4998-a283-49ff111a371c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:37.302131 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d1852-b79b-4998-a283-49ff111a371c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:37.353540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1539ee1-80ee-4228-a3f1-7f03c4d44386 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:37.354330 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 890/1795] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:37.370609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:37.383904 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1539ee1-80ee-4228-a3f1-7f03c4d44386 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:37.408118 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ac050-b1bc-4d4a-b4a6-b7f40a8708bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:37.411956 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ac050-b1bc-4d4a-b4a6-b7f40a8708bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:37.413190 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ac050-b1bc-4d4a-b4a6-b7f40a8708bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:37.414626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ac050-b1bc-4d4a-b4a6-b7f40a8708bb admin admin] PATH_INFO: `/v3/projects/dcd4ea84679c4b939522b03c19eab97d/users/01a100e6976f47ce8b9b69aafe80bab9/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:37.527120 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ac050-b1bc-4d4a-b4a6-b7f40a8708bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd4ea84679c4b939522b03c19eab97d, user_id=01a100e6976f47ce8b9b69aafe80bab9, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:37.544265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ac050-b1bc-4d4a-b4a6-b7f40a8708bb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:37.629505 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 906/1796] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:37 2022] PUT /identity/v3/projects/dcd4ea84679c4b939522b03c19eab97d/users/01a100e6976f47ce8b9b69aafe80bab9/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:25:37.641813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bff6a-52bd-4f37-ac74-7afe1385ea27 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:37.642099 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bff6a-52bd-4f37-ac74-7afe1385ea27 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:37.642384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bff6a-52bd-4f37-ac74-7afe1385ea27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:37.731057 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-951bff6a-52bd-4f37-ac74-7afe1385ea27 None None] MFA Rules not processed for user `01a100e6976f47ce8b9b69aafe80bab9`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:37.736679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-951bff6a-52bd-4f37-ac74-7afe1385ea27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:37.893970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ac050-b1bc-4d4a-b4a6-b7f40a8708bb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:37.894436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 891/1797] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:38.092201 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ac050-b1bc-4d4a-b4a6-b7f40a8708bb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:38.116752 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d6903-1f6e-46a7-a2c8-6d458df10d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:38.117745 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d6903-1f6e-46a7-a2c8-6d458df10d87 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:38.118207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d6903-1f6e-46a7-a2c8-6d458df10d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:38.118636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d6903-1f6e-46a7-a2c8-6d458df10d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:38.120644 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d6903-1f6e-46a7-a2c8-6d458df10d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:38.125305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d6903-1f6e-46a7-a2c8-6d458df10d87 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:38.262718 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 907/1798] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:37 2022] POST /identity/v3/projects => generated 369 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:38.263695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bff6a-52bd-4f37-ac74-7afe1385ea27 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:38.303071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bff6a-52bd-4f37-ac74-7afe1385ea27 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:38.641229 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:38.678071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8a47c-d49f-4893-9d84-63ab47e54b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:38.679963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8a47c-d49f-4893-9d84-63ab47e54b3b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:38.680249 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8a47c-d49f-4893-9d84-63ab47e54b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:38.680518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8a47c-d49f-4893-9d84-63ab47e54b3b admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:38.681223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8a47c-d49f-4893-9d84-63ab47e54b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:38.687834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8a47c-d49f-4893-9d84-63ab47e54b3b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:38.754004 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 892/1799] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:38 2022] POST /identity/v3/users => generated 291 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:38.756034 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d6903-1f6e-46a7-a2c8-6d458df10d87 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:38.781229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d6903-1f6e-46a7-a2c8-6d458df10d87 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:38.796280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3887e5-085b-45a2-84e3-1489be61e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:38.798490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3887e5-085b-45a2-84e3-1489be61e789 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:38.798587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3887e5-085b-45a2-84e3-1489be61e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:38.800041 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3887e5-085b-45a2-84e3-1489be61e789 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:38.801883 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3887e5-085b-45a2-84e3-1489be61e789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:38.803588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3887e5-085b-45a2-84e3-1489be61e789 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:38.884204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 908/1800] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:25:38.889017 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8a47c-d49f-4893-9d84-63ab47e54b3b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:38.925247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8a47c-d49f-4893-9d84-63ab47e54b3b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:38.939829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36701d43-094b-4ccf-8b13-4364036616d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:38.940642 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36701d43-094b-4ccf-8b13-4364036616d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:38.941072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36701d43-094b-4ccf-8b13-4364036616d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:38.941351 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36701d43-094b-4ccf-8b13-4364036616d7 admin admin] PATH_INFO: `/v3/projects/676de97277274007b43682c56c845e0c/users/d941bfb59ead4edc82c5912131fd7910/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:39.062086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36701d43-094b-4ccf-8b13-4364036616d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676de97277274007b43682c56c845e0c, user_id=d941bfb59ead4edc82c5912131fd7910, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:39.065254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36701d43-094b-4ccf-8b13-4364036616d7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:39.148400 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 893/1801] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:38 2022] PUT /identity/v3/projects/676de97277274007b43682c56c845e0c/users/d941bfb59ead4edc82c5912131fd7910/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:39.149632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3887e5-085b-45a2-84e3-1489be61e789 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:39.170274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3887e5-085b-45a2-84e3-1489be61e789 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:39.438132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65bf2f-2f69-4527-98cf-844fe25e7091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:39.440965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65bf2f-2f69-4527-98cf-844fe25e7091 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:39.441408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65bf2f-2f69-4527-98cf-844fe25e7091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:39.441929 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65bf2f-2f69-4527-98cf-844fe25e7091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:39.453760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65bf2f-2f69-4527-98cf-844fe25e7091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:39.457232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65bf2f-2f69-4527-98cf-844fe25e7091 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:39.490010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 909/1802] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:39.494142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36701d43-094b-4ccf-8b13-4364036616d7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:39.515636 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36701d43-094b-4ccf-8b13-4364036616d7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:39.533615 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a59ead-2261-43e8-923d-af7c7f887349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:39.534491 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a59ead-2261-43e8-923d-af7c7f887349 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:39.534816 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a59ead-2261-43e8-923d-af7c7f887349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:39.535187 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a59ead-2261-43e8-923d-af7c7f887349 admin admin] PATH_INFO: `/v3/projects/676de97277274007b43682c56c845e0c/users/d941bfb59ead4edc82c5912131fd7910/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:39.540745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a59ead-2261-43e8-923d-af7c7f887349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676de97277274007b43682c56c845e0c, user_id=d941bfb59ead4edc82c5912131fd7910, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:39.545157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a59ead-2261-43e8-923d-af7c7f887349 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:39.593072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 894/1803] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:39 2022] PUT /identity/v3/projects/676de97277274007b43682c56c845e0c/users/d941bfb59ead4edc82c5912131fd7910/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:39.609602 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cea132-84e0-4339-8c37-6ddd7563166a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:39.609958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cea132-84e0-4339-8c37-6ddd7563166a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:39.610204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cea132-84e0-4339-8c37-6ddd7563166a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:39.704817 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-33cea132-84e0-4339-8c37-6ddd7563166a None None] MFA Rules not processed for user `d941bfb59ead4edc82c5912131fd7910`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:39.706081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-33cea132-84e0-4339-8c37-6ddd7563166a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:39.874176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:39.964497 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 910/1804] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:39.975291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a59ead-2261-43e8-923d-af7c7f887349 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:39.979448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-73a59ead-2261-43e8-923d-af7c7f887349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:40.208847 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cea132-84e0-4339-8c37-6ddd7563166a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:40.210477 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-33cea132-84e0-4339-8c37-6ddd7563166a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:40.265846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a59ead-2261-43e8-923d-af7c7f887349 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:40.291505 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0a4af-15bc-4508-aa45-528c11acf5e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:40.293360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0a4af-15bc-4508-aa45-528c11acf5e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:40.295558 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0a4af-15bc-4508-aa45-528c11acf5e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:40.296133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0a4af-15bc-4508-aa45-528c11acf5e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:40.337542 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0a4af-15bc-4508-aa45-528c11acf5e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:40.342692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0a4af-15bc-4508-aa45-528c11acf5e4 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:40.412456 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 895/1805] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:40.465316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cea132-84e0-4339-8c37-6ddd7563166a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:40.478974 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f34c38-0dca-4b12-80c0-ee0416e3c5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:40.479834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f34c38-0dca-4b12-80c0-ee0416e3c5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:40.481950 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f34c38-0dca-4b12-80c0-ee0416e3c5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:40.482356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f34c38-0dca-4b12-80c0-ee0416e3c5b0 admin admin] PATH_INFO: `/v3/projects/0a0292d063db4d72a54b7e3711353e7d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:40.484537 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f34c38-0dca-4b12-80c0-ee0416e3c5b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0292d063db4d72a54b7e3711353e7d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:40.490080 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f34c38-0dca-4b12-80c0-ee0416e3c5b0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:40.723293 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-50f34c38-0dca-4b12-80c0-ee0416e3c5b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0292d063db4d72a54b7e3711353e7d', 'request_id': 'req-50f34c38-0dca-4b12-80c0-ee0416e3c5b0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:40.738889 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-50f34c38-0dca-4b12-80c0-ee0416e3c5b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0292d063db4d72a54b7e3711353e7d', 'request_id': 'req-50f34c38-0dca-4b12-80c0-ee0416e3c5b0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:40.784031 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-50f34c38-0dca-4b12-80c0-ee0416e3c5b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0292d063db4d72a54b7e3711353e7d', 'request_id': 'req-50f34c38-0dca-4b12-80c0-ee0416e3c5b0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:40.830888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-50f34c38-0dca-4b12-80c0-ee0416e3c5b0 admin admin] The token cache is being invalidate because project 0a0292d063db4d72a54b7e3711353e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:40.831335 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-50f34c38-0dca-4b12-80c0-ee0416e3c5b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:40.834978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-50f34c38-0dca-4b12-80c0-ee0416e3c5b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:40.850119 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 911/1806] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:40 2022] DELETE /identity/v3/projects/0a0292d063db4d72a54b7e3711353e7d => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:25:40.854132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0a4af-15bc-4508-aa45-528c11acf5e4 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:40.880973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0a4af-15bc-4508-aa45-528c11acf5e4 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:41.161707 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e618795-4e3e-45cb-a74e-a4d92a6207fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:41.163899 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e618795-4e3e-45cb-a74e-a4d92a6207fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:41.164342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e618795-4e3e-45cb-a74e-a4d92a6207fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:41.165051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e618795-4e3e-45cb-a74e-a4d92a6207fa admin admin] PATH_INFO: `/v3/users/202dd9f6206e437cb8425ba3f4cc45d4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:41.173875 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e618795-4e3e-45cb-a74e-a4d92a6207fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=202dd9f6206e437cb8425ba3f4cc45d4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:41.184013 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e618795-4e3e-45cb-a74e-a4d92a6207fa admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:41.383008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4e618795-4e3e-45cb-a74e-a4d92a6207fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '202dd9f6206e437cb8425ba3f4cc45d4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:41.388108 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:41.413553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4e618795-4e3e-45cb-a74e-a4d92a6207fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '202dd9f6206e437cb8425ba3f4cc45d4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:41.487206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4e618795-4e3e-45cb-a74e-a4d92a6207fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '202dd9f6206e437cb8425ba3f4cc45d4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:41.516271 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4e618795-4e3e-45cb-a74e-a4d92a6207fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '202dd9f6206e437cb8425ba3f4cc45d4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:41.518771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4e618795-4e3e-45cb-a74e-a4d92a6207fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '202dd9f6206e437cb8425ba3f4cc45d4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:41.543203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 896/1807] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:40 2022] DELETE /identity/v3/users/202dd9f6206e437cb8425ba3f4cc45d4 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:41.550050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b78c1-4816-425b-ab54-5027f23abc53 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:41.550643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b78c1-4816-425b-ab54-5027f23abc53 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:41.551033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b78c1-4816-425b-ab54-5027f23abc53 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:41.553330 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 912/1808] 10.222.0.40 () {54 vars in 921 bytes} [Thu Aug 11 16:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:25:41.588659 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfa7e1-07f4-48cd-a950-85c9516852f6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:41.588659 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfa7e1-07f4-48cd-a950-85c9516852f6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:41.588659 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfa7e1-07f4-48cd-a950-85c9516852f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:41.621543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5fdfa7e1-07f4-48cd-a950-85c9516852f6 None None] MFA Rules not processed for user `4e91f3fbe098459dba0acf8ec1fb7098`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:41.623352 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5fdfa7e1-07f4-48cd-a950-85c9516852f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:41.870635 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 897/1809] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Aug 11 16:25:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:42.186856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b78c1-4816-425b-ab54-5027f23abc53 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:42.189061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6d6b78c1-4816-425b-ab54-5027f23abc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:42.236970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b78c1-4816-425b-ab54-5027f23abc53 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:42.256556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e152d9-eba5-4a46-8749-2e7f08577581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:42.257198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e152d9-eba5-4a46-8749-2e7f08577581 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:42.257475 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e152d9-eba5-4a46-8749-2e7f08577581 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:42.257746 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e152d9-eba5-4a46-8749-2e7f08577581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:42.291771 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e152d9-eba5-4a46-8749-2e7f08577581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:42.293407 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e152d9-eba5-4a46-8749-2e7f08577581 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:42.329186 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 913/1810] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:25:44.912647 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfa7e1-07f4-48cd-a950-85c9516852f6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:44.914391 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5fdfa7e1-07f4-48cd-a950-85c9516852f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:45.053435 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e152d9-eba5-4a46-8749-2e7f08577581 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:45.054912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-57e152d9-eba5-4a46-8749-2e7f08577581 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:45.084888 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfa7e1-07f4-48cd-a950-85c9516852f6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:45.092814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e152d9-eba5-4a46-8749-2e7f08577581 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:45.098484 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538984fe-5b32-44b0-a858-1de5fa6fa8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:45.099256 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538984fe-5b32-44b0-a858-1de5fa6fa8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:45.099542 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538984fe-5b32-44b0-a858-1de5fa6fa8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:45.099828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538984fe-5b32-44b0-a858-1de5fa6fa8cc admin admin] PATH_INFO: `/v3/users/01a100e6976f47ce8b9b69aafe80bab9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:45.101307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538984fe-5b32-44b0-a858-1de5fa6fa8cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a100e6976f47ce8b9b69aafe80bab9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:45.106006 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538984fe-5b32-44b0-a858-1de5fa6fa8cc admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:45.107440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09ea41-1c12-4dc0-9930-36cb28e68e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:45.112089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09ea41-1c12-4dc0-9930-36cb28e68e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:45.112377 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09ea41-1c12-4dc0-9930-36cb28e68e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:45.112682 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09ea41-1c12-4dc0-9930-36cb28e68e9e admin admin] PATH_INFO: `/v3/projects/c566002513ed4a4994d159bb2eb79a3d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:45.118888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09ea41-1c12-4dc0-9930-36cb28e68e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c566002513ed4a4994d159bb2eb79a3d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:45.124139 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09ea41-1c12-4dc0-9930-36cb28e68e9e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:45.278468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:45.287636 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-538984fe-5b32-44b0-a858-1de5fa6fa8cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a100e6976f47ce8b9b69aafe80bab9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:45.294947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9f09ea41-1c12-4dc0-9930-36cb28e68e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c566002513ed4a4994d159bb2eb79a3d', 'request_id': 'req-9f09ea41-1c12-4dc0-9930-36cb28e68e9e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:45.325185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-538984fe-5b32-44b0-a858-1de5fa6fa8cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a100e6976f47ce8b9b69aafe80bab9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:45.328755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9f09ea41-1c12-4dc0-9930-36cb28e68e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c566002513ed4a4994d159bb2eb79a3d', 'request_id': 'req-9f09ea41-1c12-4dc0-9930-36cb28e68e9e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:45.349407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:45.358343 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9f09ea41-1c12-4dc0-9930-36cb28e68e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c566002513ed4a4994d159bb2eb79a3d', 'request_id': 'req-9f09ea41-1c12-4dc0-9930-36cb28e68e9e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:45.378457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-538984fe-5b32-44b0-a858-1de5fa6fa8cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a100e6976f47ce8b9b69aafe80bab9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:45.389768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9f09ea41-1c12-4dc0-9930-36cb28e68e9e admin admin] The token cache is being invalidate because project c566002513ed4a4994d159bb2eb79a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:45.390333 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9f09ea41-1c12-4dc0-9930-36cb28e68e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:45.391152 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9f09ea41-1c12-4dc0-9930-36cb28e68e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:45.400500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 914/1811] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:45 2022] DELETE /identity/v3/projects/c566002513ed4a4994d159bb2eb79a3d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:45.402349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7dc2c-989a-4fb4-9202-418627326962 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:45.402785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7dc2c-989a-4fb4-9202-418627326962 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:45.403824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7dc2c-989a-4fb4-9202-418627326962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:45.405957 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-538984fe-5b32-44b0-a858-1de5fa6fa8cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a100e6976f47ce8b9b69aafe80bab9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:45.406739 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-538984fe-5b32-44b0-a858-1de5fa6fa8cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a100e6976f47ce8b9b69aafe80bab9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:45.418131 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 898/1812] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:44 2022] DELETE /identity/v3/users/01a100e6976f47ce8b9b69aafe80bab9 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:45.419835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2ad23-f890-4d2f-982c-cd07dde0b20f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:45.421937 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2ad23-f890-4d2f-982c-cd07dde0b20f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:45.422363 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2ad23-f890-4d2f-982c-cd07dde0b20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:45.459799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-dad7dc2c-989a-4fb4-9202-418627326962 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:45.463807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dad7dc2c-989a-4fb4-9202-418627326962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:45.473015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-bef2ad23-f890-4d2f-982c-cd07dde0b20f None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:45.483514 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bef2ad23-f890-4d2f-982c-cd07dde0b20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:45.630834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 899/1813] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:45.668942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2ad23-f890-4d2f-982c-cd07dde0b20f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:45.672677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bef2ad23-f890-4d2f-982c-cd07dde0b20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:45.686102 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 915/1814] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:45.696783 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91232572-237c-4275-a1f6-8fd9cd11c081 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:45.697077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91232572-237c-4275-a1f6-8fd9cd11c081 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:45.697360 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91232572-237c-4275-a1f6-8fd9cd11c081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:45.753982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-91232572-237c-4275-a1f6-8fd9cd11c081 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:45.756641 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-91232572-237c-4275-a1f6-8fd9cd11c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:45.783083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 916/1815] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:45.786474 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91232572-237c-4275-a1f6-8fd9cd11c081 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:45.805768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91232572-237c-4275-a1f6-8fd9cd11c081 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:45.819920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46b568-3d74-4fb4-8aec-5ee762065f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:45.820554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46b568-3d74-4fb4-8aec-5ee762065f5b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:45.820862 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46b568-3d74-4fb4-8aec-5ee762065f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:45.821139 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46b568-3d74-4fb4-8aec-5ee762065f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:45.821807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46b568-3d74-4fb4-8aec-5ee762065f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:45.822109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46b568-3d74-4fb4-8aec-5ee762065f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:45.834127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46b568-3d74-4fb4-8aec-5ee762065f5b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:45.880623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 917/1816] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:45.881561 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46b568-3d74-4fb4-8aec-5ee762065f5b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:45.923448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2ad23-f890-4d2f-982c-cd07dde0b20f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:45.929752 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46b568-3d74-4fb4-8aec-5ee762065f5b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:45.937813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f1223-91b9-4530-b190-5a1bf0666f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:45.938460 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f1223-91b9-4530-b190-5a1bf0666f29 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:45.938946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f1223-91b9-4530-b190-5a1bf0666f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:45.939367 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f1223-91b9-4530-b190-5a1bf0666f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:45.965726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f1223-91b9-4530-b190-5a1bf0666f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:45.969616 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f1223-91b9-4530-b190-5a1bf0666f29 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:45.984220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc87ab-7aa5-4958-8410-d461ce276609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:45.984886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc87ab-7aa5-4958-8410-d461ce276609 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:45.985167 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc87ab-7aa5-4958-8410-d461ce276609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:45.989111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc87ab-7aa5-4958-8410-d461ce276609 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:45.989854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc87ab-7aa5-4958-8410-d461ce276609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:46.000234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc87ab-7aa5-4958-8410-d461ce276609 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:46.001228 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 900/1817] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:46.141471 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f1223-91b9-4530-b190-5a1bf0666f29 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:46.156995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 918/1818] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:45 2022] POST /identity/v3/projects => generated 377 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:46.163158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f1223-91b9-4530-b190-5a1bf0666f29 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:46.382238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b0652-43e2-47ec-89a9-39af1fd87763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:46.383008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b0652-43e2-47ec-89a9-39af1fd87763 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:46.383526 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b0652-43e2-47ec-89a9-39af1fd87763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:46.384486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b0652-43e2-47ec-89a9-39af1fd87763 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:46.385844 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b0652-43e2-47ec-89a9-39af1fd87763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:46.392390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b0652-43e2-47ec-89a9-39af1fd87763 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:46.459734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 901/1819] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:46 2022] POST /identity/v3/users => generated 289 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:25:46.460387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc87ab-7aa5-4958-8410-d461ce276609 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:46.481397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc87ab-7aa5-4958-8410-d461ce276609 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:46.505405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a18c14-f0d1-4474-a04f-876d2d7bb0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:46.509769 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a18c14-f0d1-4474-a04f-876d2d7bb0bb admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:46.511059 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a18c14-f0d1-4474-a04f-876d2d7bb0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:46.511285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a18c14-f0d1-4474-a04f-876d2d7bb0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:46.517273 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a18c14-f0d1-4474-a04f-876d2d7bb0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:46.522985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a18c14-f0d1-4474-a04f-876d2d7bb0bb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:46.569480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 919/1820] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:25:46.572486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b0652-43e2-47ec-89a9-39af1fd87763 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:46.619049 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b0652-43e2-47ec-89a9-39af1fd87763 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:46.642729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefa55a-6604-4d90-a0f5-34a996ff422e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:46.644544 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefa55a-6604-4d90-a0f5-34a996ff422e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:46.645051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefa55a-6604-4d90-a0f5-34a996ff422e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:46.645517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefa55a-6604-4d90-a0f5-34a996ff422e admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:46.646393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefa55a-6604-4d90-a0f5-34a996ff422e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:46.648334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefa55a-6604-4d90-a0f5-34a996ff422e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:46.656407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:46.673990 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a18c14-f0d1-4474-a04f-876d2d7bb0bb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:46.675539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 902/1821] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:46.696848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a18c14-f0d1-4474-a04f-876d2d7bb0bb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:46.704817 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a677779-097a-4fa1-9355-0cd3e5494df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:46.708845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a677779-097a-4fa1-9355-0cd3e5494df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:46.708845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a677779-097a-4fa1-9355-0cd3e5494df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:46.708845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a677779-097a-4fa1-9355-0cd3e5494df1 admin admin] PATH_INFO: `/v3/projects/800dadddfc854e2cbc5123d8a070a6f4/users/01a3f2a85be54a2c99ec9154347041c9/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:46.740216 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a677779-097a-4fa1-9355-0cd3e5494df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=800dadddfc854e2cbc5123d8a070a6f4, user_id=01a3f2a85be54a2c99ec9154347041c9, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:46.743223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefa55a-6604-4d90-a0f5-34a996ff422e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:46.743393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a677779-097a-4fa1-9355-0cd3e5494df1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:46.746727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-aeefa55a-6604-4d90-a0f5-34a996ff422e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:46.769079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefa55a-6604-4d90-a0f5-34a996ff422e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:46.803819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 920/1822] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:46 2022] PUT /identity/v3/projects/800dadddfc854e2cbc5123d8a070a6f4/users/01a3f2a85be54a2c99ec9154347041c9/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:46.816568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb16837-eee4-4119-baad-f17ad48f5f7d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:46.817029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb16837-eee4-4119-baad-f17ad48f5f7d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:46.817740 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb16837-eee4-4119-baad-f17ad48f5f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:46.861342 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1eb16837-eee4-4119-baad-f17ad48f5f7d None None] MFA Rules not processed for user `01a3f2a85be54a2c99ec9154347041c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:46.863744 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1eb16837-eee4-4119-baad-f17ad48f5f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:46.922763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cee75c-481c-468e-b713-c759e8973a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:46.924074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cee75c-481c-468e-b713-c759e8973a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:46.925131 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cee75c-481c-468e-b713-c759e8973a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:46.925742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cee75c-481c-468e-b713-c759e8973a88 admin admin] PATH_INFO: `/v3/users/a18909e123914a83a7388802cd9938df` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:46.928245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cee75c-481c-468e-b713-c759e8973a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18909e123914a83a7388802cd9938df)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:46.938822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cee75c-481c-468e-b713-c759e8973a88 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:46.979734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:47.041076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 921/1823] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:25:47.042256 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb16837-eee4-4119-baad-f17ad48f5f7d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:47.056753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb16837-eee4-4119-baad-f17ad48f5f7d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:47.061279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-91cee75c-481c-468e-b713-c759e8973a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18909e123914a83a7388802cd9938df'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:47.063767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3ea5f-3714-46f3-bcf9-87eb41012e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:47.064457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3ea5f-3714-46f3-bcf9-87eb41012e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:47.064900 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3ea5f-3714-46f3-bcf9-87eb41012e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:47.065459 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3ea5f-3714-46f3-bcf9-87eb41012e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:47.066681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3ea5f-3714-46f3-bcf9-87eb41012e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:47.069056 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3ea5f-3714-46f3-bcf9-87eb41012e67 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:47.090404 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-91cee75c-481c-468e-b713-c759e8973a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18909e123914a83a7388802cd9938df'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:47.113883 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 922/1824] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:47 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:47.116879 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3ea5f-3714-46f3-bcf9-87eb41012e67 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:47.156388 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-91cee75c-481c-468e-b713-c759e8973a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18909e123914a83a7388802cd9938df'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:47.212574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-91cee75c-481c-468e-b713-c759e8973a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18909e123914a83a7388802cd9938df'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:47.217132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-91cee75c-481c-468e-b713-c759e8973a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18909e123914a83a7388802cd9938df'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:47.267083 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 903/1825] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:46 2022] DELETE /identity/v3/users/a18909e123914a83a7388802cd9938df => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:25:47.270331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccfb1c-8c61-42f1-977e-6289429139b4 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:47.270674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccfb1c-8c61-42f1-977e-6289429139b4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:47.271043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccfb1c-8c61-42f1-977e-6289429139b4 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:47.273453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 904/1826] 10.222.0.40 () {54 vars in 921 bytes} [Thu Aug 11 16:25:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:25:47.274604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f8ebf-7f76-4f37-8ad8-bb03d3138dd7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:47.275642 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f8ebf-7f76-4f37-8ad8-bb03d3138dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:47.275923 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f8ebf-7f76-4f37-8ad8-bb03d3138dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:47.315714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5f7f8ebf-7f76-4f37-8ad8-bb03d3138dd7 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:47.317887 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5f7f8ebf-7f76-4f37-8ad8-bb03d3138dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:47.418116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3ea5f-3714-46f3-bcf9-87eb41012e67 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:47.534589 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 905/1827] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:47.536866 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d615a8c-a7be-42ae-9611-f2730fa184a4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:47.541828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d615a8c-a7be-42ae-9611-f2730fa184a4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:47.542619 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d615a8c-a7be-42ae-9611-f2730fa184a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:47.563449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cdbd7-c5a3-475f-935f-4d30b35a5879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:47.564074 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cdbd7-c5a3-475f-935f-4d30b35a5879 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:47.564456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cdbd7-c5a3-475f-935f-4d30b35a5879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:47.564636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cdbd7-c5a3-475f-935f-4d30b35a5879 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:47.565275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cdbd7-c5a3-475f-935f-4d30b35a5879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:47.573422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cdbd7-c5a3-475f-935f-4d30b35a5879 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:47.579921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9d615a8c-a7be-42ae-9611-f2730fa184a4 None None] MFA Rules not processed for user `4e91f3fbe098459dba0acf8ec1fb7098`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:47.585046 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9d615a8c-a7be-42ae-9611-f2730fa184a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:47.617416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:47.623062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 923/1828] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:47 2022] POST /identity/v3/users => generated 294 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:47.628796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cdbd7-c5a3-475f-935f-4d30b35a5879 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:47.634654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-731cdbd7-c5a3-475f-935f-4d30b35a5879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:47.661832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cdbd7-c5a3-475f-935f-4d30b35a5879 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:47.677800 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea66ee-8125-48a4-a075-6b803fcada96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:47.678777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea66ee-8125-48a4-a075-6b803fcada96 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:47.679236 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea66ee-8125-48a4-a075-6b803fcada96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:47.679754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea66ee-8125-48a4-a075-6b803fcada96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:47.682187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea66ee-8125-48a4-a075-6b803fcada96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:47.686294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea66ee-8125-48a4-a075-6b803fcada96 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:47.703240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 924/1829] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:47.708402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea66ee-8125-48a4-a075-6b803fcada96 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:47.740963 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea66ee-8125-48a4-a075-6b803fcada96 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:47.753700 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc67b93-0f6b-4a37-bfea-f5c50deb7258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:47.755565 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc67b93-0f6b-4a37-bfea-f5c50deb7258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:47.757047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc67b93-0f6b-4a37-bfea-f5c50deb7258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:47.757660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc67b93-0f6b-4a37-bfea-f5c50deb7258 admin admin] PATH_INFO: `/v3/projects/f6174566ccbc43819df0ad9a1b6af55c/users/842895edbe2a4d8289c8cef8c4f7fa7e/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:47.783435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 906/1830] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Aug 11 16:25:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:47.792959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc67b93-0f6b-4a37-bfea-f5c50deb7258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6174566ccbc43819df0ad9a1b6af55c, user_id=842895edbe2a4d8289c8cef8c4f7fa7e, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:47.796487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc67b93-0f6b-4a37-bfea-f5c50deb7258 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:47.812974 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d615a8c-a7be-42ae-9611-f2730fa184a4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:47.816275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9d615a8c-a7be-42ae-9611-f2730fa184a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:47.840806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 925/1831] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:47 2022] PUT /identity/v3/projects/f6174566ccbc43819df0ad9a1b6af55c/users/842895edbe2a4d8289c8cef8c4f7fa7e/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:25:47.848695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc67b93-0f6b-4a37-bfea-f5c50deb7258 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:47.923926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:48.000381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d615a8c-a7be-42ae-9611-f2730fa184a4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:48.011223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc67b93-0f6b-4a37-bfea-f5c50deb7258 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:48.051233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b524a9-f95c-4311-be44-58f4b4796b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:48.052377 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b524a9-f95c-4311-be44-58f4b4796b5c admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:48.052377 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b524a9-f95c-4311-be44-58f4b4796b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:48.052564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b524a9-f95c-4311-be44-58f4b4796b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:48.054058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b524a9-f95c-4311-be44-58f4b4796b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:48.055145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b524a9-f95c-4311-be44-58f4b4796b5c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:48.094150 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 926/1832] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:48.095296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b524a9-f95c-4311-be44-58f4b4796b5c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:48.122104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b524a9-f95c-4311-be44-58f4b4796b5c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:48.129285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31370c6a-8cf6-4e32-b427-165901762dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:48.130052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31370c6a-8cf6-4e32-b427-165901762dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:48.130454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31370c6a-8cf6-4e32-b427-165901762dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:48.130655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31370c6a-8cf6-4e32-b427-165901762dd8 admin admin] PATH_INFO: `/v3/projects/f6174566ccbc43819df0ad9a1b6af55c/users/842895edbe2a4d8289c8cef8c4f7fa7e/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:48.133011 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31370c6a-8cf6-4e32-b427-165901762dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6174566ccbc43819df0ad9a1b6af55c, user_id=842895edbe2a4d8289c8cef8c4f7fa7e, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:48.136272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31370c6a-8cf6-4e32-b427-165901762dd8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:48.152662 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 927/1833] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:48 2022] PUT /identity/v3/projects/f6174566ccbc43819df0ad9a1b6af55c/users/842895edbe2a4d8289c8cef8c4f7fa7e/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:48.199998 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a842fc-cb71-4835-9ee4-13448c3eb6af None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:48.205824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a842fc-cb71-4835-9ee4-13448c3eb6af None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:48.211338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0fd1b-db14-4f18-a891-e7dd278ddb3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:48.225029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0fd1b-db14-4f18-a891-e7dd278ddb3e service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:48.225343 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a842fc-cb71-4835-9ee4-13448c3eb6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:48.226161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0fd1b-db14-4f18-a891-e7dd278ddb3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:48.226161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0fd1b-db14-4f18-a891-e7dd278ddb3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:48.226460 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0fd1b-db14-4f18-a891-e7dd278ddb3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:48.228203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0fd1b-db14-4f18-a891-e7dd278ddb3e service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:48.246782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 907/1834] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:25:48.282828 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-11a842fc-cb71-4835-9ee4-13448c3eb6af None None] MFA Rules not processed for user `842895edbe2a4d8289c8cef8c4f7fa7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:48.284257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-11a842fc-cb71-4835-9ee4-13448c3eb6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:48.350547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0fd1b-db14-4f18-a891-e7dd278ddb3e service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:48.353559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e7b0fd1b-db14-4f18-a891-e7dd278ddb3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:48.407486 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 928/1835] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:48.419260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a842fc-cb71-4835-9ee4-13448c3eb6af None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:48.422297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-11a842fc-cb71-4835-9ee4-13448c3eb6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:48.503706 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a842fc-cb71-4835-9ee4-13448c3eb6af None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:48.508949 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b415c8-5a8e-4117-a79f-3fd35236d843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:48.509619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b415c8-5a8e-4117-a79f-3fd35236d843 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:48.509906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b415c8-5a8e-4117-a79f-3fd35236d843 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:48.510183 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b415c8-5a8e-4117-a79f-3fd35236d843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:48.513273 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e5b415c8-5a8e-4117-a79f-3fd35236d843 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:48.518322 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0fd1b-db14-4f18-a891-e7dd278ddb3e service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:48.527151 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:48.581890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:48.602708 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b415c8-5a8e-4117-a79f-3fd35236d843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:48.604165 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b415c8-5a8e-4117-a79f-3fd35236d843 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:48.619775 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 929/1836] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:25:48.651274 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04e4cc-8fba-4d90-b913-c7e60fa0af87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:48.652165 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04e4cc-8fba-4d90-b913-c7e60fa0af87 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:48.652765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04e4cc-8fba-4d90-b913-c7e60fa0af87 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:48.654634 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04e4cc-8fba-4d90-b913-c7e60fa0af87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:48.666267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04e4cc-8fba-4d90-b913-c7e60fa0af87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:48.668287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04e4cc-8fba-4d90-b913-c7e60fa0af87 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:48.703918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 908/1837] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:25:48.892705 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b415c8-5a8e-4117-a79f-3fd35236d843 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:48.897657 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e5b415c8-5a8e-4117-a79f-3fd35236d843 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:49.095234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b415c8-5a8e-4117-a79f-3fd35236d843 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:49.110491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94707ed-d692-4b0e-a37c-9d3889df0607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:49.112033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94707ed-d692-4b0e-a37c-9d3889df0607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:49.112321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94707ed-d692-4b0e-a37c-9d3889df0607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:49.113042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94707ed-d692-4b0e-a37c-9d3889df0607 admin admin] PATH_INFO: `/v3/projects/dcd4ea84679c4b939522b03c19eab97d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:49.116556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94707ed-d692-4b0e-a37c-9d3889df0607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd4ea84679c4b939522b03c19eab97d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:49.121338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94707ed-d692-4b0e-a37c-9d3889df0607 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:49.258351 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b94707ed-d692-4b0e-a37c-9d3889df0607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd4ea84679c4b939522b03c19eab97d', 'request_id': 'req-b94707ed-d692-4b0e-a37c-9d3889df0607'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.271682 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b94707ed-d692-4b0e-a37c-9d3889df0607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd4ea84679c4b939522b03c19eab97d', 'request_id': 'req-b94707ed-d692-4b0e-a37c-9d3889df0607'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.289535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b94707ed-d692-4b0e-a37c-9d3889df0607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd4ea84679c4b939522b03c19eab97d', 'request_id': 'req-b94707ed-d692-4b0e-a37c-9d3889df0607'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.324380 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b94707ed-d692-4b0e-a37c-9d3889df0607 admin admin] The token cache is being invalidate because project dcd4ea84679c4b939522b03c19eab97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:49.324787 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b94707ed-d692-4b0e-a37c-9d3889df0607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.325531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b94707ed-d692-4b0e-a37c-9d3889df0607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.331631 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 930/1838] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:48 2022] DELETE /identity/v3/projects/dcd4ea84679c4b939522b03c19eab97d => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:49.335461 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04e4cc-8fba-4d90-b913-c7e60fa0af87 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:49.358370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04e4cc-8fba-4d90-b913-c7e60fa0af87 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:49.447534 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94707ed-d692-4b0e-a37c-9d3889df0607 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:49.456054 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b94707ed-d692-4b0e-a37c-9d3889df0607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:49.501711 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb748d2-9418-477d-8145-37782aa2d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:49.504307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb748d2-9418-477d-8145-37782aa2d4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:49.504775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb748d2-9418-477d-8145-37782aa2d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:49.505429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb748d2-9418-477d-8145-37782aa2d4d0 admin admin] PATH_INFO: `/v3/users/d941bfb59ead4edc82c5912131fd7910` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:49.507131 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb748d2-9418-477d-8145-37782aa2d4d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d941bfb59ead4edc82c5912131fd7910)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:49.510183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb748d2-9418-477d-8145-37782aa2d4d0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:49.550155 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94707ed-d692-4b0e-a37c-9d3889df0607 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:49.559325 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752074d3-1cf9-4767-97c8-9abcae249c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:49.560182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752074d3-1cf9-4767-97c8-9abcae249c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:49.560547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752074d3-1cf9-4767-97c8-9abcae249c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:49.561453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752074d3-1cf9-4767-97c8-9abcae249c2c admin admin] PATH_INFO: `/v3/projects/cd71348ec34843408b412b1e7c09cf17` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:49.562805 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752074d3-1cf9-4767-97c8-9abcae249c2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd71348ec34843408b412b1e7c09cf17)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:49.565018 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752074d3-1cf9-4767-97c8-9abcae249c2c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:49.596344 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:49.606745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6eb748d2-9418-477d-8145-37782aa2d4d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd941bfb59ead4edc82c5912131fd7910'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.619861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6eb748d2-9418-477d-8145-37782aa2d4d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd941bfb59ead4edc82c5912131fd7910'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.636714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6eb748d2-9418-477d-8145-37782aa2d4d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd941bfb59ead4edc82c5912131fd7910'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.648950 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6eb748d2-9418-477d-8145-37782aa2d4d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd941bfb59ead4edc82c5912131fd7910'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.649078 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-752074d3-1cf9-4767-97c8-9abcae249c2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd71348ec34843408b412b1e7c09cf17', 'request_id': 'req-752074d3-1cf9-4767-97c8-9abcae249c2c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.650272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6eb748d2-9418-477d-8145-37782aa2d4d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd941bfb59ead4edc82c5912131fd7910'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.659231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-752074d3-1cf9-4767-97c8-9abcae249c2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd71348ec34843408b412b1e7c09cf17', 'request_id': 'req-752074d3-1cf9-4767-97c8-9abcae249c2c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.660846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 909/1839] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:49 2022] DELETE /identity/v3/users/d941bfb59ead4edc82c5912131fd7910 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:49.669593 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-752074d3-1cf9-4767-97c8-9abcae249c2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd71348ec34843408b412b1e7c09cf17', 'request_id': 'req-752074d3-1cf9-4767-97c8-9abcae249c2c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.686619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-752074d3-1cf9-4767-97c8-9abcae249c2c admin admin] The token cache is being invalidate because project cd71348ec34843408b412b1e7c09cf17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:49.687201 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-752074d3-1cf9-4767-97c8-9abcae249c2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.690061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-752074d3-1cf9-4767-97c8-9abcae249c2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.693431 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 931/1840] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:49 2022] DELETE /identity/v3/projects/cd71348ec34843408b412b1e7c09cf17 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:49.697588 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb748d2-9418-477d-8145-37782aa2d4d0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:49.699096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6eb748d2-9418-477d-8145-37782aa2d4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:49.727645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:49.835098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb748d2-9418-477d-8145-37782aa2d4d0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:49.841665 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c58ff-5769-49cb-ab91-f4d8ed349af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:49.843098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c58ff-5769-49cb-ab91-f4d8ed349af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:49.843841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c58ff-5769-49cb-ab91-f4d8ed349af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:49.844275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c58ff-5769-49cb-ab91-f4d8ed349af5 admin admin] PATH_INFO: `/v3/users/e818a574a94c4afba0520c4626f510d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:49.846471 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c58ff-5769-49cb-ab91-f4d8ed349af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e818a574a94c4afba0520c4626f510d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:49.848730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c58ff-5769-49cb-ab91-f4d8ed349af5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:49.932487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c37c58ff-5769-49cb-ab91-f4d8ed349af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e818a574a94c4afba0520c4626f510d8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.946710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c37c58ff-5769-49cb-ab91-f4d8ed349af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e818a574a94c4afba0520c4626f510d8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.969120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c37c58ff-5769-49cb-ab91-f4d8ed349af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e818a574a94c4afba0520c4626f510d8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.978804 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c37c58ff-5769-49cb-ab91-f4d8ed349af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e818a574a94c4afba0520c4626f510d8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.979940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c37c58ff-5769-49cb-ab91-f4d8ed349af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e818a574a94c4afba0520c4626f510d8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:49.991613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 910/1841] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:49 2022] DELETE /identity/v3/users/e818a574a94c4afba0520c4626f510d8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:50.234277 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752074d3-1cf9-4767-97c8-9abcae249c2c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:50.236111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-752074d3-1cf9-4767-97c8-9abcae249c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:50.326980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752074d3-1cf9-4767-97c8-9abcae249c2c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:50.415282 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82946393-81da-4e61-a631-b4a845666b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:50.415282 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82946393-81da-4e61-a631-b4a845666b3e service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:50.416326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82946393-81da-4e61-a631-b4a845666b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:50.416326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82946393-81da-4e61-a631-b4a845666b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:50.418144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-82946393-81da-4e61-a631-b4a845666b3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:50.500866 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82946393-81da-4e61-a631-b4a845666b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:50.502469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82946393-81da-4e61-a631-b4a845666b3e service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:50.520916 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 932/1842] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:50.680955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c58ff-5769-49cb-ab91-f4d8ed349af5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:50.682482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c37c58ff-5769-49cb-ab91-f4d8ed349af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:50.785977 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c58ff-5769-49cb-ab91-f4d8ed349af5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:50.793546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab2092-f386-404e-b99e-ee14069b32ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:50.795515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab2092-f386-404e-b99e-ee14069b32ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:50.795643 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab2092-f386-404e-b99e-ee14069b32ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:50.796029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab2092-f386-404e-b99e-ee14069b32ae admin admin] PATH_INFO: `/v3/projects/676de97277274007b43682c56c845e0c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:50.798215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab2092-f386-404e-b99e-ee14069b32ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=676de97277274007b43682c56c845e0c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:50.801259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab2092-f386-404e-b99e-ee14069b32ae admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:50.891438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:50.909086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-02ab2092-f386-404e-b99e-ee14069b32ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676de97277274007b43682c56c845e0c', 'request_id': 'req-02ab2092-f386-404e-b99e-ee14069b32ae'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:50.921003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-02ab2092-f386-404e-b99e-ee14069b32ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676de97277274007b43682c56c845e0c', 'request_id': 'req-02ab2092-f386-404e-b99e-ee14069b32ae'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:50.925613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82946393-81da-4e61-a631-b4a845666b3e service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:50.926963 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-82946393-81da-4e61-a631-b4a845666b3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:50.935011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-02ab2092-f386-404e-b99e-ee14069b32ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676de97277274007b43682c56c845e0c', 'request_id': 'req-02ab2092-f386-404e-b99e-ee14069b32ae'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:50.951156 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82946393-81da-4e61-a631-b4a845666b3e service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:50.990596 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-02ab2092-f386-404e-b99e-ee14069b32ae admin admin] The token cache is being invalidate because project 676de97277274007b43682c56c845e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:50.996494 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-02ab2092-f386-404e-b99e-ee14069b32ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:51.001451 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-02ab2092-f386-404e-b99e-ee14069b32ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:51.004154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 911/1843] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:50 2022] DELETE /identity/v3/projects/676de97277274007b43682c56c845e0c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:51.021379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93603583-2eac-4199-9e6c-b500f355252c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.022524 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93603583-2eac-4199-9e6c-b500f355252c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.022635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:51.022797 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93603583-2eac-4199-9e6c-b500f355252c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.079438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-93603583-2eac-4199-9e6c-b500f355252c None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:51.084228 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-93603583-2eac-4199-9e6c-b500f355252c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:51.133252 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a015b7-bfd7-4d4a-8e3f-983c59a11a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:51.134013 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a015b7-bfd7-4d4a-8e3f-983c59a11a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.134176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a015b7-bfd7-4d4a-8e3f-983c59a11a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.134455 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a015b7-bfd7-4d4a-8e3f-983c59a11a88 admin admin] PATH_INFO: `/v3/projects/28df32f2c28a4bff8fd66c307ad824f3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.145482 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a015b7-bfd7-4d4a-8e3f-983c59a11a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28df32f2c28a4bff8fd66c307ad824f3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:51.147535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a015b7-bfd7-4d4a-8e3f-983c59a11a88 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:51.202824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 912/1844] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:51.211752 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cd791-843b-4d57-afe0-d19d3a0250c3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.212038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cd791-843b-4d57-afe0-d19d3a0250c3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.212528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cd791-843b-4d57-afe0-d19d3a0250c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.234551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43a015b7-bfd7-4d4a-8e3f-983c59a11a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28df32f2c28a4bff8fd66c307ad824f3', 'request_id': 'req-43a015b7-bfd7-4d4a-8e3f-983c59a11a88'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:51.241933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43a015b7-bfd7-4d4a-8e3f-983c59a11a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28df32f2c28a4bff8fd66c307ad824f3', 'request_id': 'req-43a015b7-bfd7-4d4a-8e3f-983c59a11a88'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:51.247440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a65cd791-843b-4d57-afe0-d19d3a0250c3 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:51.249880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a65cd791-843b-4d57-afe0-d19d3a0250c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:51.253557 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43a015b7-bfd7-4d4a-8e3f-983c59a11a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28df32f2c28a4bff8fd66c307ad824f3', 'request_id': 'req-43a015b7-bfd7-4d4a-8e3f-983c59a11a88'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:51.269104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43a015b7-bfd7-4d4a-8e3f-983c59a11a88 admin admin] The token cache is being invalidate because project 28df32f2c28a4bff8fd66c307ad824f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:51.269393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43a015b7-bfd7-4d4a-8e3f-983c59a11a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:51.270063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43a015b7-bfd7-4d4a-8e3f-983c59a11a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:51.271585 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 933/1845] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:50 2022] DELETE /identity/v3/projects/28df32f2c28a4bff8fd66c307ad824f3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:51.278026 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c48199-7bbb-463d-aa86-7f13e1749a88 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.278971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c48199-7bbb-463d-aa86-7f13e1749a88 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.279822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c48199-7bbb-463d-aa86-7f13e1749a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.307265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-81c48199-7bbb-463d-aa86-7f13e1749a88 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:51.308559 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-81c48199-7bbb-463d-aa86-7f13e1749a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:51.355460 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 913/1846] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:25:51.361669 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cd791-843b-4d57-afe0-d19d3a0250c3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:51.373281 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cd791-843b-4d57-afe0-d19d3a0250c3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:51.384424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8d10f-fb29-42e4-bcf7-bc6c4b80109a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:51.386040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8d10f-fb29-42e4-bcf7-bc6c4b80109a admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.386676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8d10f-fb29-42e4-bcf7-bc6c4b80109a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.387395 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8d10f-fb29-42e4-bcf7-bc6c4b80109a admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.388284 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8d10f-fb29-42e4-bcf7-bc6c4b80109a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:51.389264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8d10f-fb29-42e4-bcf7-bc6c4b80109a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:51.391675 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8d10f-fb29-42e4-bcf7-bc6c4b80109a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:51.418437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 934/1847] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:51.418638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 914/1848] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:51.421235 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66a3d5-dbfe-42fc-af47-657da0f4f818 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.421536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66a3d5-dbfe-42fc-af47-657da0f4f818 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.421813 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66a3d5-dbfe-42fc-af47-657da0f4f818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.422108 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8d10f-fb29-42e4-bcf7-bc6c4b80109a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:51.441000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8d10f-fb29-42e4-bcf7-bc6c4b80109a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:51.449009 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da54ce-b2b9-4bb4-9567-1d9834fb5d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:51.449637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da54ce-b2b9-4bb4-9567-1d9834fb5d3b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.453027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da54ce-b2b9-4bb4-9567-1d9834fb5d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.453336 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da54ce-b2b9-4bb4-9567-1d9834fb5d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.454003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da54ce-b2b9-4bb4-9567-1d9834fb5d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:51.455930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da54ce-b2b9-4bb4-9567-1d9834fb5d3b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:51.458045 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-bd66a3d5-dbfe-42fc-af47-657da0f4f818 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:51.459528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bd66a3d5-dbfe-42fc-af47-657da0f4f818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:51.481684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 935/1849] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:51.482831 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66a3d5-dbfe-42fc-af47-657da0f4f818 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:51.497517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 915/1850] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:51 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:25:51.501049 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da54ce-b2b9-4bb4-9567-1d9834fb5d3b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:51.508009 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66a3d5-dbfe-42fc-af47-657da0f4f818 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:51.566224 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:51.581296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:51.602823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaed1a-bf21-4a24-a16b-c8f0d77a0a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:51.603453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaed1a-bf21-4a24-a16b-c8f0d77a0a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.604295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaed1a-bf21-4a24-a16b-c8f0d77a0a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.604295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaed1a-bf21-4a24-a16b-c8f0d77a0a64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.604718 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaed1a-bf21-4a24-a16b-c8f0d77a0a64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:51.605025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaed1a-bf21-4a24-a16b-c8f0d77a0a64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:51.606696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaed1a-bf21-4a24-a16b-c8f0d77a0a64 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:51.609717 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da54ce-b2b9-4bb4-9567-1d9834fb5d3b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:51.614699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa09cf-80c6-48c1-b15e-bedaeaa7ed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:51.615406 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa09cf-80c6-48c1-b15e-bedaeaa7ed57 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.616209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa09cf-80c6-48c1-b15e-bedaeaa7ed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.616323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa09cf-80c6-48c1-b15e-bedaeaa7ed57 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.617096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa09cf-80c6-48c1-b15e-bedaeaa7ed57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:51.619436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa09cf-80c6-48c1-b15e-bedaeaa7ed57 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:51.619569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 936/1851] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:25:51.624544 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaed1a-bf21-4a24-a16b-c8f0d77a0a64 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:51.634767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaed1a-bf21-4a24-a16b-c8f0d77a0a64 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:51.640621 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91695b2c-32f3-4fce-914c-724d11f6c7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:51.641357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91695b2c-32f3-4fce-914c-724d11f6c7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.641705 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91695b2c-32f3-4fce-914c-724d11f6c7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.642055 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91695b2c-32f3-4fce-914c-724d11f6c7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.642691 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91695b2c-32f3-4fce-914c-724d11f6c7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:51.644644 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91695b2c-32f3-4fce-914c-724d11f6c7a2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:51.648071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 916/1852] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:51 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:51.652066 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa09cf-80c6-48c1-b15e-bedaeaa7ed57 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:51.664506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa09cf-80c6-48c1-b15e-bedaeaa7ed57 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:51.670176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aad014-1e37-40c4-89fc-b19a5dd60ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:51.671349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aad014-1e37-40c4-89fc-b19a5dd60ace admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.671684 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aad014-1e37-40c4-89fc-b19a5dd60ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.672235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aad014-1e37-40c4-89fc-b19a5dd60ace admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.672923 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aad014-1e37-40c4-89fc-b19a5dd60ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:51.674550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aad014-1e37-40c4-89fc-b19a5dd60ace admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:51.682101 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 937/1853] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:51 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:51.683285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91695b2c-32f3-4fce-914c-724d11f6c7a2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:51.688871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 917/1854] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:25:51.693153 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aad014-1e37-40c4-89fc-b19a5dd60ace admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:51.705401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aad014-1e37-40c4-89fc-b19a5dd60ace admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:51.778238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d7196-0dd8-48e9-86c9-973e8ca8bb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:51.779492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d7196-0dd8-48e9-86c9-973e8ca8bb02 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.779914 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d7196-0dd8-48e9-86c9-973e8ca8bb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.780162 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91695b2c-32f3-4fce-914c-724d11f6c7a2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:51.780495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d7196-0dd8-48e9-86c9-973e8ca8bb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.781318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d7196-0dd8-48e9-86c9-973e8ca8bb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:51.783440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d7196-0dd8-48e9-86c9-973e8ca8bb02 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:51.788068 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9a73f-d16e-468a-b2c2-687dcac1db77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:51.788720 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9a73f-d16e-468a-b2c2-687dcac1db77 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.789016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9a73f-d16e-468a-b2c2-687dcac1db77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.789423 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9a73f-d16e-468a-b2c2-687dcac1db77 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.790064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9a73f-d16e-468a-b2c2-687dcac1db77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:51.792075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9a73f-d16e-468a-b2c2-687dcac1db77 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:51.801550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 918/1855] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:25:51.802948 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d7196-0dd8-48e9-86c9-973e8ca8bb02 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:51.819306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d7196-0dd8-48e9-86c9-973e8ca8bb02 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:51.824631 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 938/1856] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:51 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:25:51.826008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9a73f-d16e-468a-b2c2-687dcac1db77 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:51.826993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f55f3-e33b-48e9-b67f-d02ec85eefb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:51.827881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f55f3-e33b-48e9-b67f-d02ec85eefb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.828185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f55f3-e33b-48e9-b67f-d02ec85eefb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.828529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f55f3-e33b-48e9-b67f-d02ec85eefb5 admin admin] PATH_INFO: `/v3/projects/4ed72b5a288544d2ae157260ec2f39d6/users/ae0077a68ab24e8a90393b751d6e3edc/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.837251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9a73f-d16e-468a-b2c2-687dcac1db77 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:51.842532 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7fd09-6160-4626-aa28-669868211dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:51.843218 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7fd09-6160-4626-aa28-669868211dea admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.844138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7fd09-6160-4626-aa28-669868211dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.844684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7fd09-6160-4626-aa28-669868211dea admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.845235 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7fd09-6160-4626-aa28-669868211dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:51.847130 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7fd09-6160-4626-aa28-669868211dea admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:51.860813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f55f3-e33b-48e9-b67f-d02ec85eefb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed72b5a288544d2ae157260ec2f39d6, user_id=ae0077a68ab24e8a90393b751d6e3edc, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:51.860813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f55f3-e33b-48e9-b67f-d02ec85eefb5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:51.860988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 939/1857] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:51.863992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7fd09-6160-4626-aa28-669868211dea admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:51.876523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7fd09-6160-4626-aa28-669868211dea admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:51.883063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 919/1858] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:51 2022] PUT /identity/v3/projects/4ed72b5a288544d2ae157260ec2f39d6/users/ae0077a68ab24e8a90393b751d6e3edc/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:51.893934 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3864fb0-e6c0-4385-8156-ca97e57b1ae7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.894697 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3864fb0-e6c0-4385-8156-ca97e57b1ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.894986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3864fb0-e6c0-4385-8156-ca97e57b1ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.925534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d3864fb0-e6c0-4385-8156-ca97e57b1ae7 None None] MFA Rules not processed for user `ae0077a68ab24e8a90393b751d6e3edc`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:51.926979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d3864fb0-e6c0-4385-8156-ca97e57b1ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:51.957585 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e3c7b-7e19-4acb-a817-3df897379b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:51.958439 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e3c7b-7e19-4acb-a817-3df897379b9f admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.958787 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e3c7b-7e19-4acb-a817-3df897379b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.959130 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e3c7b-7e19-4acb-a817-3df897379b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:51.959878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e3c7b-7e19-4acb-a817-3df897379b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:51.961571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e3c7b-7e19-4acb-a817-3df897379b9f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:51.973468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 940/1859] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:25:51.977964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e3c7b-7e19-4acb-a817-3df897379b9f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:51.989764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e3c7b-7e19-4acb-a817-3df897379b9f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:51.994654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bade8-1562-443c-889a-2cd8f96906bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:51.995422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bade8-1562-443c-889a-2cd8f96906bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:51.995422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bade8-1562-443c-889a-2cd8f96906bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:51.995422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bade8-1562-443c-889a-2cd8f96906bc admin admin] PATH_INFO: `/v3/projects/d8f00d3136854f729b810361efc58fbc/users/dbac6b6c0da14d99939101a2def9552f/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:52.005011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 920/1860] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:25:52.012936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3864fb0-e6c0-4385-8156-ca97e57b1ae7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:52.014496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d3864fb0-e6c0-4385-8156-ca97e57b1ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:52.030075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bade8-1562-443c-889a-2cd8f96906bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f00d3136854f729b810361efc58fbc, user_id=dbac6b6c0da14d99939101a2def9552f, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:52.031897 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:52.034983 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bade8-1562-443c-889a-2cd8f96906bc admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:52.051450 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 941/1861] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:51 2022] PUT /identity/v3/projects/d8f00d3136854f729b810361efc58fbc/users/dbac6b6c0da14d99939101a2def9552f/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:52.062704 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79312c0-1b7d-4ee4-98a9-b2102ffc0ec1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:52.063083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79312c0-1b7d-4ee4-98a9-b2102ffc0ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:52.066228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79312c0-1b7d-4ee4-98a9-b2102ffc0ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:52.074836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:52.100470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3864fb0-e6c0-4385-8156-ca97e57b1ae7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:52.106888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f79312c0-1b7d-4ee4-98a9-b2102ffc0ec1 None None] MFA Rules not processed for user `dbac6b6c0da14d99939101a2def9552f`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:52.108912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f79312c0-1b7d-4ee4-98a9-b2102ffc0ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:52.194548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab2807-7f4c-4f9f-a3e5-cce524fa6cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:52.195297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab2807-7f4c-4f9f-a3e5-cce524fa6cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:52.195581 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab2807-7f4c-4f9f-a3e5-cce524fa6cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:52.195849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab2807-7f4c-4f9f-a3e5-cce524fa6cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:52.213759 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 942/1862] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:52.214818 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79312c0-1b7d-4ee4-98a9-b2102ffc0ec1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:52.216380 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f79312c0-1b7d-4ee4-98a9-b2102ffc0ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:52.268367 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab2807-7f4c-4f9f-a3e5-cce524fa6cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:52.274012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab2807-7f4c-4f9f-a3e5-cce524fa6cd2 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:52.290755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 921/1863] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:52.292384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab2807-7f4c-4f9f-a3e5-cce524fa6cd2 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:52.305281 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79312c0-1b7d-4ee4-98a9-b2102ffc0ec1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:52.306021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab2807-7f4c-4f9f-a3e5-cce524fa6cd2 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:52.311838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe09a9-e567-40bb-b5a7-293efd326e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:52.312281 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe09a9-e567-40bb-b5a7-293efd326e0b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:52.312667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe09a9-e567-40bb-b5a7-293efd326e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:52.313110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe09a9-e567-40bb-b5a7-293efd326e0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:52.313818 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe09a9-e567-40bb-b5a7-293efd326e0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:52.314242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830f481-c45e-4157-bb0d-821f40fd2d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:52.315083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830f481-c45e-4157-bb0d-821f40fd2d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:52.315559 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830f481-c45e-4157-bb0d-821f40fd2d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:52.315974 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe09a9-e567-40bb-b5a7-293efd326e0b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:52.316194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830f481-c45e-4157-bb0d-821f40fd2d88 admin admin] PATH_INFO: `/v3/users/2f7dd596252a43eb9fd3ab49b7cfb4c3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:52.317605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830f481-c45e-4157-bb0d-821f40fd2d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7dd596252a43eb9fd3ab49b7cfb4c3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:52.320470 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830f481-c45e-4157-bb0d-821f40fd2d88 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:52.396947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 922/1864] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:52 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:52.398408 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe09a9-e567-40bb-b5a7-293efd326e0b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:52.406125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6830f481-c45e-4157-bb0d-821f40fd2d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7dd596252a43eb9fd3ab49b7cfb4c3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:52.442027 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6830f481-c45e-4157-bb0d-821f40fd2d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7dd596252a43eb9fd3ab49b7cfb4c3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:52.452288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6830f481-c45e-4157-bb0d-821f40fd2d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7dd596252a43eb9fd3ab49b7cfb4c3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:52.462345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6830f481-c45e-4157-bb0d-821f40fd2d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7dd596252a43eb9fd3ab49b7cfb4c3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:52.463442 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6830f481-c45e-4157-bb0d-821f40fd2d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7dd596252a43eb9fd3ab49b7cfb4c3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:52.475958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 943/1865] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:52 2022] DELETE /identity/v3/users/2f7dd596252a43eb9fd3ab49b7cfb4c3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:52.477840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b34e0-747f-48ad-840a-3cfc2eaf8c06 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:52.479433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b34e0-747f-48ad-840a-3cfc2eaf8c06 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:52.479979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b34e0-747f-48ad-840a-3cfc2eaf8c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:52.508627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6a0b34e0-747f-48ad-840a-3cfc2eaf8c06 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:52.511065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6a0b34e0-747f-48ad-840a-3cfc2eaf8c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:52.522849 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:52.564789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:52.573352 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe09a9-e567-40bb-b5a7-293efd326e0b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:52.649269 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 944/1866] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:52.675503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9f92d-f0a5-41cc-b416-3f161656beea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:52.676437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9f92d-f0a5-41cc-b416-3f161656beea admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:52.677061 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9f92d-f0a5-41cc-b416-3f161656beea admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:52.677185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9f92d-f0a5-41cc-b416-3f161656beea admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:52.678179 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9f92d-f0a5-41cc-b416-3f161656beea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:52.680907 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9f92d-f0a5-41cc-b416-3f161656beea admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:52.682407 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b34e0-747f-48ad-840a-3cfc2eaf8c06 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:52.684426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6a0b34e0-747f-48ad-840a-3cfc2eaf8c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:52.707276 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 923/1867] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:52 2022] POST /identity/v3/users => generated 297 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:52.710992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9f92d-f0a5-41cc-b416-3f161656beea admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:52.713417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-40d9f92d-f0a5-41cc-b416-3f161656beea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:52.729465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9f92d-f0a5-41cc-b416-3f161656beea admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:52.757142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6019c4-543a-4a2e-925f-e70c7b82c547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:52.758414 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6019c4-543a-4a2e-925f-e70c7b82c547 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:52.759447 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6019c4-543a-4a2e-925f-e70c7b82c547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:52.760355 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6019c4-543a-4a2e-925f-e70c7b82c547 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:52.763139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6019c4-543a-4a2e-925f-e70c7b82c547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:52.767901 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6019c4-543a-4a2e-925f-e70c7b82c547 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:52.808868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 924/1868] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:52.814267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6019c4-543a-4a2e-925f-e70c7b82c547 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:52.840569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6019c4-543a-4a2e-925f-e70c7b82c547 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:52.867261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b5709-9629-4775-a0bb-9d762b065192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:52.867944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b5709-9629-4775-a0bb-9d762b065192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:52.868228 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b5709-9629-4775-a0bb-9d762b065192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:52.868508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b5709-9629-4775-a0bb-9d762b065192 admin admin] PATH_INFO: `/v3/projects/1acacec5254447fd95a6dad57dcbc3d6/users/a9d26ae336ff44da8c8050d633654018/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:52.881173 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b34e0-747f-48ad-840a-3cfc2eaf8c06 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:52.890799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865be12c-1b6f-49bc-a576-a12f76c2aca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:52.892202 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865be12c-1b6f-49bc-a576-a12f76c2aca7 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:52.892735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865be12c-1b6f-49bc-a576-a12f76c2aca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:52.893207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865be12c-1b6f-49bc-a576-a12f76c2aca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:52.909657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b5709-9629-4775-a0bb-9d762b065192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1acacec5254447fd95a6dad57dcbc3d6, user_id=a9d26ae336ff44da8c8050d633654018, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:52.912405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b5709-9629-4775-a0bb-9d762b065192 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:52.915084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865be12c-1b6f-49bc-a576-a12f76c2aca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:52.919004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865be12c-1b6f-49bc-a576-a12f76c2aca7 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:52.948859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 925/1869] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:52 2022] PUT /identity/v3/projects/1acacec5254447fd95a6dad57dcbc3d6/users/a9d26ae336ff44da8c8050d633654018/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:25:52.950304 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 945/1870] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:52.954624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b5709-9629-4775-a0bb-9d762b065192 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:53.074896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b5709-9629-4775-a0bb-9d762b065192 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:53.081480 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35040b-0ee7-44fa-93dd-bd67e8817d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:53.082396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35040b-0ee7-44fa-93dd-bd67e8817d77 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:53.082864 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35040b-0ee7-44fa-93dd-bd67e8817d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:53.083302 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35040b-0ee7-44fa-93dd-bd67e8817d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:53.084155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35040b-0ee7-44fa-93dd-bd67e8817d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:53.085887 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35040b-0ee7-44fa-93dd-bd67e8817d77 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:53.104416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 926/1871] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:53.112204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865be12c-1b6f-49bc-a576-a12f76c2aca7 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:53.144369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865be12c-1b6f-49bc-a576-a12f76c2aca7 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:53.149903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ae350-ce5b-498a-8e40-ba565465da97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:53.151302 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ae350-ce5b-498a-8e40-ba565465da97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:53.151644 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ae350-ce5b-498a-8e40-ba565465da97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:53.151986 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ae350-ce5b-498a-8e40-ba565465da97 admin admin] PATH_INFO: `/v3/projects/1acacec5254447fd95a6dad57dcbc3d6/users/a9d26ae336ff44da8c8050d633654018/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:53.154214 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ae350-ce5b-498a-8e40-ba565465da97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1acacec5254447fd95a6dad57dcbc3d6, user_id=a9d26ae336ff44da8c8050d633654018, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:53.158246 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ae350-ce5b-498a-8e40-ba565465da97 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:53.183497 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 946/1872] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:53 2022] PUT /identity/v3/projects/1acacec5254447fd95a6dad57dcbc3d6/users/a9d26ae336ff44da8c8050d633654018/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:53.184875 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fd93a-75be-413a-8724-3787594b1dbd None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:53.185953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fd93a-75be-413a-8724-3787594b1dbd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:53.186406 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fd93a-75be-413a-8724-3787594b1dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:53.249817 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0a1fd93a-75be-413a-8724-3787594b1dbd None None] MFA Rules not processed for user `a9d26ae336ff44da8c8050d633654018`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:53.254578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0a1fd93a-75be-413a-8724-3787594b1dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:53.353345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:53.384604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 927/1873] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:53.396770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ae350-ce5b-498a-8e40-ba565465da97 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:53.398411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c32ae350-ce5b-498a-8e40-ba565465da97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:53.550080 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ae350-ce5b-498a-8e40-ba565465da97 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:53.559653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12c110-4d49-4beb-a2c8-157111c0cced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:53.561004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12c110-4d49-4beb-a2c8-157111c0cced service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:53.561367 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12c110-4d49-4beb-a2c8-157111c0cced service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:53.561725 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12c110-4d49-4beb-a2c8-157111c0cced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:53.594540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12c110-4d49-4beb-a2c8-157111c0cced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:53.596482 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12c110-4d49-4beb-a2c8-157111c0cced service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:53.609221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 947/1874] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:53.757071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fd93a-75be-413a-8724-3787594b1dbd None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:53.771401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fd93a-75be-413a-8724-3787594b1dbd None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:53.774978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cf407-f99e-40c6-bfb2-7e6ed4c0aa3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:53.775588 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cf407-f99e-40c6-bfb2-7e6ed4c0aa3b service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:53.775868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cf407-f99e-40c6-bfb2-7e6ed4c0aa3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:53.776137 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cf407-f99e-40c6-bfb2-7e6ed4c0aa3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:53.777941 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fb3cf407-f99e-40c6-bfb2-7e6ed4c0aa3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:53.860117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cf407-f99e-40c6-bfb2-7e6ed4c0aa3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:53.862109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cf407-f99e-40c6-bfb2-7e6ed4c0aa3b service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:53.876774 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 928/1875] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:54.112699 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12c110-4d49-4beb-a2c8-157111c0cced service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:54.112699 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9a12c110-4d49-4beb-a2c8-157111c0cced service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:54.168994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:54.224682 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12c110-4d49-4beb-a2c8-157111c0cced service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:54.230423 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72e328-75cf-455d-be02-e848a83a4ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:54.231233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72e328-75cf-455d-be02-e848a83a4ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:54.231616 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72e328-75cf-455d-be02-e848a83a4ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:54.232258 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72e328-75cf-455d-be02-e848a83a4ad1 admin admin] PATH_INFO: `/v3/projects/c471205451b84a7e841ae4c7214eb05f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:54.245546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72e328-75cf-455d-be02-e848a83a4ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c471205451b84a7e841ae4c7214eb05f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:54.245546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72e328-75cf-455d-be02-e848a83a4ad1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:54.300617 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0d72e328-75cf-455d-be02-e848a83a4ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c471205451b84a7e841ae4c7214eb05f', 'request_id': 'req-0d72e328-75cf-455d-be02-e848a83a4ad1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:54.309964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0d72e328-75cf-455d-be02-e848a83a4ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c471205451b84a7e841ae4c7214eb05f', 'request_id': 'req-0d72e328-75cf-455d-be02-e848a83a4ad1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:54.318697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0d72e328-75cf-455d-be02-e848a83a4ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c471205451b84a7e841ae4c7214eb05f', 'request_id': 'req-0d72e328-75cf-455d-be02-e848a83a4ad1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:54.335224 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0d72e328-75cf-455d-be02-e848a83a4ad1 admin admin] The token cache is being invalidate because project c471205451b84a7e841ae4c7214eb05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:54.335721 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0d72e328-75cf-455d-be02-e848a83a4ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:54.336466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0d72e328-75cf-455d-be02-e848a83a4ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:54.338075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 948/1876] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:54 2022] DELETE /identity/v3/projects/c471205451b84a7e841ae4c7214eb05f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:54.342342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cf407-f99e-40c6-bfb2-7e6ed4c0aa3b service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:54.353800 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cf407-f99e-40c6-bfb2-7e6ed4c0aa3b service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:54.430118 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4646bba-558b-498c-b3d4-4212c97af4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:54.430759 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4646bba-558b-498c-b3d4-4212c97af4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:54.431067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4646bba-558b-498c-b3d4-4212c97af4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:54.431337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4646bba-558b-498c-b3d4-4212c97af4e3 admin admin] PATH_INFO: `/v3/users/c1bc567ceffc46f79c3bb0d15a17386d` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:54.432605 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4646bba-558b-498c-b3d4-4212c97af4e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1bc567ceffc46f79c3bb0d15a17386d)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:54.434703 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4646bba-558b-498c-b3d4-4212c97af4e3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:54.499896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c4646bba-558b-498c-b3d4-4212c97af4e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1bc567ceffc46f79c3bb0d15a17386d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:54.508945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c4646bba-558b-498c-b3d4-4212c97af4e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1bc567ceffc46f79c3bb0d15a17386d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:54.522496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c4646bba-558b-498c-b3d4-4212c97af4e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1bc567ceffc46f79c3bb0d15a17386d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:54.529793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c4646bba-558b-498c-b3d4-4212c97af4e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1bc567ceffc46f79c3bb0d15a17386d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:54.530561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c4646bba-558b-498c-b3d4-4212c97af4e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1bc567ceffc46f79c3bb0d15a17386d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:54.532400 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:54.538860 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 929/1877] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:54 2022] DELETE /identity/v3/users/c1bc567ceffc46f79c3bb0d15a17386d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:54.816885 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72e328-75cf-455d-be02-e848a83a4ad1 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:54.818732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0d72e328-75cf-455d-be02-e848a83a4ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:54.833311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72e328-75cf-455d-be02-e848a83a4ad1 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:54.905509 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53deadb9-bef7-40ee-89f2-381ec97056da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:54.906496 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deadb9-bef7-40ee-89f2-381ec97056da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:54.907146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deadb9-bef7-40ee-89f2-381ec97056da admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:54.907530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deadb9-bef7-40ee-89f2-381ec97056da admin admin] PATH_INFO: `/v3/users/01a3f2a85be54a2c99ec9154347041c9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:54.908864 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53deadb9-bef7-40ee-89f2-381ec97056da admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a3f2a85be54a2c99ec9154347041c9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:54.910948 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53deadb9-bef7-40ee-89f2-381ec97056da admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:54.950210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4646bba-558b-498c-b3d4-4212c97af4e3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:54.952211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c4646bba-558b-498c-b3d4-4212c97af4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:54.966383 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4646bba-558b-498c-b3d4-4212c97af4e3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:54.971292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dd8b1-a1ff-4a8e-80f9-aa4dc9d41f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:54.971929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dd8b1-a1ff-4a8e-80f9-aa4dc9d41f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:54.972208 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dd8b1-a1ff-4a8e-80f9-aa4dc9d41f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:54.972482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dd8b1-a1ff-4a8e-80f9-aa4dc9d41f3e admin admin] PATH_INFO: `/v3/projects/d979076962104285a96fb28898bc9722` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:54.973768 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dd8b1-a1ff-4a8e-80f9-aa4dc9d41f3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d979076962104285a96fb28898bc9722)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:54.975661 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dd8b1-a1ff-4a8e-80f9-aa4dc9d41f3e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:55.004858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-53deadb9-bef7-40ee-89f2-381ec97056da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a3f2a85be54a2c99ec9154347041c9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:55.011636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-53deadb9-bef7-40ee-89f2-381ec97056da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a3f2a85be54a2c99ec9154347041c9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:55.022896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-53deadb9-bef7-40ee-89f2-381ec97056da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a3f2a85be54a2c99ec9154347041c9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:55.029243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:55.033382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-53deadb9-bef7-40ee-89f2-381ec97056da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a3f2a85be54a2c99ec9154347041c9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:55.034768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-53deadb9-bef7-40ee-89f2-381ec97056da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a3f2a85be54a2c99ec9154347041c9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:55.047133 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 949/1878] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:54 2022] DELETE /identity/v3/users/01a3f2a85be54a2c99ec9154347041c9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:55.049175 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1f704-9b74-407a-a988-c1b45e6f0579 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:55.049931 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1f704-9b74-407a-a988-c1b45e6f0579 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:55.050320 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1f704-9b74-407a-a988-c1b45e6f0579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:55.056310 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a84dd8b1-a1ff-4a8e-80f9-aa4dc9d41f3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd979076962104285a96fb28898bc9722', 'request_id': 'req-a84dd8b1-a1ff-4a8e-80f9-aa4dc9d41f3e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:55.070252 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a84dd8b1-a1ff-4a8e-80f9-aa4dc9d41f3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd979076962104285a96fb28898bc9722', 'request_id': 'req-a84dd8b1-a1ff-4a8e-80f9-aa4dc9d41f3e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:55.072009 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-19d1f704-9b74-407a-a988-c1b45e6f0579 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:55.073402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-19d1f704-9b74-407a-a988-c1b45e6f0579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:55.079642 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a84dd8b1-a1ff-4a8e-80f9-aa4dc9d41f3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd979076962104285a96fb28898bc9722', 'request_id': 'req-a84dd8b1-a1ff-4a8e-80f9-aa4dc9d41f3e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:55.093788 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a84dd8b1-a1ff-4a8e-80f9-aa4dc9d41f3e admin admin] The token cache is being invalidate because project d979076962104285a96fb28898bc9722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:55.094191 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a84dd8b1-a1ff-4a8e-80f9-aa4dc9d41f3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:55.094958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a84dd8b1-a1ff-4a8e-80f9-aa4dc9d41f3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:55.100223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 930/1879] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:54 2022] DELETE /identity/v3/projects/d979076962104285a96fb28898bc9722 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:25:55.101705 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc916-3454-4f51-9e20-95f9d8ccbcd7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:55.102067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc916-3454-4f51-9e20-95f9d8ccbcd7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:55.102413 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc916-3454-4f51-9e20-95f9d8ccbcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:55.130323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-922cc916-3454-4f51-9e20-95f9d8ccbcd7 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:55.131634 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-922cc916-3454-4f51-9e20-95f9d8ccbcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:55.185645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 950/1880] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:55.196072 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1f704-9b74-407a-a988-c1b45e6f0579 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:55.198332 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-19d1f704-9b74-407a-a988-c1b45e6f0579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:55.221361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 931/1881] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:55.229377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7092bf4-5109-4edf-8e14-24ea3880b688 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:55.229678 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7092bf4-5109-4edf-8e14-24ea3880b688 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:55.230010 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7092bf4-5109-4edf-8e14-24ea3880b688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:55.270813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c7092bf4-5109-4edf-8e14-24ea3880b688 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:55.272042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c7092bf4-5109-4edf-8e14-24ea3880b688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:55.295867 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 932/1882] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:55.296789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7092bf4-5109-4edf-8e14-24ea3880b688 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:55.299249 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c7092bf4-5109-4edf-8e14-24ea3880b688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:55.315113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7092bf4-5109-4edf-8e14-24ea3880b688 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:55.321895 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa680e5-1261-4b43-a319-a3ee940d8982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:55.322667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa680e5-1261-4b43-a319-a3ee940d8982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:55.322946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa680e5-1261-4b43-a319-a3ee940d8982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:55.323397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa680e5-1261-4b43-a319-a3ee940d8982 admin admin] PATH_INFO: `/v3/users/ae0077a68ab24e8a90393b751d6e3edc` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:55.324611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa680e5-1261-4b43-a319-a3ee940d8982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae0077a68ab24e8a90393b751d6e3edc)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:55.327070 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa680e5-1261-4b43-a319-a3ee940d8982 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:55.359309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1f704-9b74-407a-a988-c1b45e6f0579 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:55.370378 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95c54a-2331-4ba3-b7a6-f33734a7ec52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:55.371145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95c54a-2331-4ba3-b7a6-f33734a7ec52 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:55.371941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95c54a-2331-4ba3-b7a6-f33734a7ec52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:55.373460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95c54a-2331-4ba3-b7a6-f33734a7ec52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:55.396133 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95c54a-2331-4ba3-b7a6-f33734a7ec52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:55.398986 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95c54a-2331-4ba3-b7a6-f33734a7ec52 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:55.416437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 951/1883] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:25:55.421388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95c54a-2331-4ba3-b7a6-f33734a7ec52 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:55.437197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-faa680e5-1261-4b43-a319-a3ee940d8982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae0077a68ab24e8a90393b751d6e3edc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:55.447551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95c54a-2331-4ba3-b7a6-f33734a7ec52 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:55.458719 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87568a-ef1c-4add-b29e-0dba581b1b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:55.459337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87568a-ef1c-4add-b29e-0dba581b1b7a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:55.459613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87568a-ef1c-4add-b29e-0dba581b1b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:55.459884 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87568a-ef1c-4add-b29e-0dba581b1b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:55.460407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-faa680e5-1261-4b43-a319-a3ee940d8982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae0077a68ab24e8a90393b751d6e3edc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:55.463856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87568a-ef1c-4add-b29e-0dba581b1b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:55.464178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87568a-ef1c-4add-b29e-0dba581b1b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:55.465882 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87568a-ef1c-4add-b29e-0dba581b1b7a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:55.489806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 952/1884] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:55.493702 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87568a-ef1c-4add-b29e-0dba581b1b7a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:55.497400 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:55.499589 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-faa680e5-1261-4b43-a319-a3ee940d8982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae0077a68ab24e8a90393b751d6e3edc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:55.517024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87568a-ef1c-4add-b29e-0dba581b1b7a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:55.517640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-faa680e5-1261-4b43-a319-a3ee940d8982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae0077a68ab24e8a90393b751d6e3edc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:55.518602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-faa680e5-1261-4b43-a319-a3ee940d8982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae0077a68ab24e8a90393b751d6e3edc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:55.529647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc0861-c956-4d9b-bd0c-11b1fafc72c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:55.530268 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc0861-c956-4d9b-bd0c-11b1fafc72c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:55.530546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc0861-c956-4d9b-bd0c-11b1fafc72c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:55.530880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc0861-c956-4d9b-bd0c-11b1fafc72c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:55.531430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc0861-c956-4d9b-bd0c-11b1fafc72c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:55.533552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 933/1885] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:55 2022] DELETE /identity/v3/users/ae0077a68ab24e8a90393b751d6e3edc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:55.538537 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc0861-c956-4d9b-bd0c-11b1fafc72c2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:55.539257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c34c3a-b391-4cea-ba56-3bb3c070beca None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:55.539654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c34c3a-b391-4cea-ba56-3bb3c070beca None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:55.540037 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c34c3a-b391-4cea-ba56-3bb3c070beca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:55.587962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c8c34c3a-b391-4cea-ba56-3bb3c070beca None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:55.595223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 953/1886] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:55 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:55.603038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c8c34c3a-b391-4cea-ba56-3bb3c070beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:55.609065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc0861-c956-4d9b-bd0c-11b1fafc72c2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:55.616429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5dfc0861-c956-4d9b-bd0c-11b1fafc72c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:55.760283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 934/1887] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:55.761908 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1774e1-4e86-455d-a219-34fbeb32f46e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:55.762809 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1774e1-4e86-455d-a219-34fbeb32f46e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:55.763776 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1774e1-4e86-455d-a219-34fbeb32f46e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:55.767120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 935/1888] 10.222.0.40 () {54 vars in 921 bytes} [Thu Aug 11 16:25:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:25:55.771827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1774e1-4e86-455d-a219-34fbeb32f46e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:55.775001 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2e1774e1-4e86-455d-a219-34fbeb32f46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:55.816124 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc0861-c956-4d9b-bd0c-11b1fafc72c2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:55.822861 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d7dfe-e69a-404d-aa11-2447ad3b6fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:55.823501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d7dfe-e69a-404d-aa11-2447ad3b6fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:55.823755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d7dfe-e69a-404d-aa11-2447ad3b6fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:55.824033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d7dfe-e69a-404d-aa11-2447ad3b6fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:55.824767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d7dfe-e69a-404d-aa11-2447ad3b6fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:55.826978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d7dfe-e69a-404d-aa11-2447ad3b6fa4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:55.838115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:55.862080 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 954/1889] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:55 2022] POST /identity/v3/users => generated 292 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:55.863905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5420bf-4ec1-42ce-b298-4bfc1978825b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:55.864223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5420bf-4ec1-42ce-b298-4bfc1978825b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:55.864720 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5420bf-4ec1-42ce-b298-4bfc1978825b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:55.883933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1774e1-4e86-455d-a219-34fbeb32f46e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:55.889800 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88d1ea-4827-4810-9d96-a91298a2ca0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:55.890448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88d1ea-4827-4810-9d96-a91298a2ca0b service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:55.890723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88d1ea-4827-4810-9d96-a91298a2ca0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:55.890990 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88d1ea-4827-4810-9d96-a91298a2ca0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:55.903081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5c5420bf-4ec1-42ce-b298-4bfc1978825b None None] MFA Rules not processed for user `4e91f3fbe098459dba0acf8ec1fb7098`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:55.906835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88d1ea-4827-4810-9d96-a91298a2ca0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:55.909267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88d1ea-4827-4810-9d96-a91298a2ca0b service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:55.917584 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5c5420bf-4ec1-42ce-b298-4bfc1978825b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:55.924329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 936/1890] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:55.926030 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88d1ea-4827-4810-9d96-a91298a2ca0b service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:55.939573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88d1ea-4827-4810-9d96-a91298a2ca0b service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:55.945974 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd1db2-296d-41e4-8bf5-17c61fae88be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:55.946583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd1db2-296d-41e4-8bf5-17c61fae88be admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:55.946858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd1db2-296d-41e4-8bf5-17c61fae88be admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:55.947126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd1db2-296d-41e4-8bf5-17c61fae88be admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:55.948021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd1db2-296d-41e4-8bf5-17c61fae88be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:55.950167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd1db2-296d-41e4-8bf5-17c61fae88be admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:55.970329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 937/1891] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:55.974309 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd1db2-296d-41e4-8bf5-17c61fae88be admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:55.994097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd1db2-296d-41e4-8bf5-17c61fae88be admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:56.020972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecf32d-4fc5-4357-96ad-2e4a1cc6255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:56.021590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecf32d-4fc5-4357-96ad-2e4a1cc6255d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:56.021868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecf32d-4fc5-4357-96ad-2e4a1cc6255d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:56.022141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecf32d-4fc5-4357-96ad-2e4a1cc6255d admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:56.022783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecf32d-4fc5-4357-96ad-2e4a1cc6255d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:56.024376 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecf32d-4fc5-4357-96ad-2e4a1cc6255d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:56.044049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 955/1892] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Aug 11 16:25:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:56.078166 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5420bf-4ec1-42ce-b298-4bfc1978825b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:56.078926 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 938/1893] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:56.095631 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5420bf-4ec1-42ce-b298-4bfc1978825b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:56.102161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabebf2-df9b-4624-bd2a-6743248fe84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:56.102894 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabebf2-df9b-4624-bd2a-6743248fe84a admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:56.104029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabebf2-df9b-4624-bd2a-6743248fe84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:56.104390 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabebf2-df9b-4624-bd2a-6743248fe84a admin admin] PATH_INFO: `/v3/projects/978bc74cf34647fb8c3016bf2386f057/users/53657f906452428a91e121f7f8da7902/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:56.127950 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabebf2-df9b-4624-bd2a-6743248fe84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=978bc74cf34647fb8c3016bf2386f057, user_id=53657f906452428a91e121f7f8da7902, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:56.131844 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabebf2-df9b-4624-bd2a-6743248fe84a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:56.158045 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 956/1894] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:56 2022] PUT /identity/v3/projects/978bc74cf34647fb8c3016bf2386f057/users/53657f906452428a91e121f7f8da7902/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:25:56.171849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc973-300d-412e-bb28-8349dc53c3a1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:56.172685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc973-300d-412e-bb28-8349dc53c3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:56.172685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc973-300d-412e-bb28-8349dc53c3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:56.223951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2f8dc973-300d-412e-bb28-8349dc53c3a1 None None] MFA Rules not processed for user `53657f906452428a91e121f7f8da7902`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:56.225259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2f8dc973-300d-412e-bb28-8349dc53c3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:56.300723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:56.306508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 939/1895] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:56.315140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabebf2-df9b-4624-bd2a-6743248fe84a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:56.356209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dc973-300d-412e-bb28-8349dc53c3a1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:56.358459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2f8dc973-300d-412e-bb28-8349dc53c3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:56.384931 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabebf2-df9b-4624-bd2a-6743248fe84a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:56.390135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd47bf-c0af-404a-9337-e68268e2bf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:56.390748 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd47bf-c0af-404a-9337-e68268e2bf66 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:56.391026 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd47bf-c0af-404a-9337-e68268e2bf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:56.391298 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd47bf-c0af-404a-9337-e68268e2bf66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:56.391929 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd47bf-c0af-404a-9337-e68268e2bf66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:56.393876 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd47bf-c0af-404a-9337-e68268e2bf66 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:56.445471 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 957/1896] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:56 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:56.447059 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd47bf-c0af-404a-9337-e68268e2bf66 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:56.498953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dc973-300d-412e-bb28-8349dc53c3a1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:56.542675 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:56.569510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4f1e2-6431-4467-af32-de1d40fc9928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:56.570200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd47bf-c0af-404a-9337-e68268e2bf66 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:56.570483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4f1e2-6431-4467-af32-de1d40fc9928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:56.570849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4f1e2-6431-4467-af32-de1d40fc9928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:56.571381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4f1e2-6431-4467-af32-de1d40fc9928 admin admin] PATH_INFO: `/v3/projects/800dadddfc854e2cbc5123d8a070a6f4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:56.572677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4f1e2-6431-4467-af32-de1d40fc9928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=800dadddfc854e2cbc5123d8a070a6f4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:56.574913 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4f1e2-6431-4467-af32-de1d40fc9928 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:56.578249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25509052-3264-4295-a52c-d4ce19ca5c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:56.578979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25509052-3264-4295-a52c-d4ce19ca5c9d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:56.579361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25509052-3264-4295-a52c-d4ce19ca5c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:56.579730 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25509052-3264-4295-a52c-d4ce19ca5c9d admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:56.580527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25509052-3264-4295-a52c-d4ce19ca5c9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:56.582751 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25509052-3264-4295-a52c-d4ce19ca5c9d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:56.617430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 958/1897] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:56 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:56.618483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25509052-3264-4295-a52c-d4ce19ca5c9d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:56.621168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-25509052-3264-4295-a52c-d4ce19ca5c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:56.641659 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8bd4f1e2-6431-4467-af32-de1d40fc9928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '800dadddfc854e2cbc5123d8a070a6f4', 'request_id': 'req-8bd4f1e2-6431-4467-af32-de1d40fc9928'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:56.651174 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8bd4f1e2-6431-4467-af32-de1d40fc9928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '800dadddfc854e2cbc5123d8a070a6f4', 'request_id': 'req-8bd4f1e2-6431-4467-af32-de1d40fc9928'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:56.660163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8bd4f1e2-6431-4467-af32-de1d40fc9928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '800dadddfc854e2cbc5123d8a070a6f4', 'request_id': 'req-8bd4f1e2-6431-4467-af32-de1d40fc9928'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:56.671992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8bd4f1e2-6431-4467-af32-de1d40fc9928 admin admin] The token cache is being invalidate because project 800dadddfc854e2cbc5123d8a070a6f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:56.672306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8bd4f1e2-6431-4467-af32-de1d40fc9928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:56.673099 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8bd4f1e2-6431-4467-af32-de1d40fc9928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:56.674859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 940/1898] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:56 2022] DELETE /identity/v3/projects/800dadddfc854e2cbc5123d8a070a6f4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:56.675378 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4f1e2-6431-4467-af32-de1d40fc9928 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:56.676690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8bd4f1e2-6431-4467-af32-de1d40fc9928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:56.715838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25509052-3264-4295-a52c-d4ce19ca5c9d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:56.720219 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:56.747201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4f1e2-6431-4467-af32-de1d40fc9928 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:56.751972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:56.756558 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:56.757024 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:56.757470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c admin admin] PATH_INFO: `/v3/projects/4ed72b5a288544d2ae157260ec2f39d6` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:56.758899 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ed72b5a288544d2ae157260ec2f39d6)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:56.761106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:56.790277 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecd2f1-fdd4-4cff-bb27-529b77c1deec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:56.790893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecd2f1-fdd4-4cff-bb27-529b77c1deec service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:56.791171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecd2f1-fdd4-4cff-bb27-529b77c1deec service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:56.791443 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecd2f1-fdd4-4cff-bb27-529b77c1deec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:56.793854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9eecd2f1-fdd4-4cff-bb27-529b77c1deec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:56.815573 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecd2f1-fdd4-4cff-bb27-529b77c1deec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:56.817488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ed72b5a288544d2ae157260ec2f39d6', 'request_id': 'req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:56.818089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecd2f1-fdd4-4cff-bb27-529b77c1deec service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:56.827825 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ed72b5a288544d2ae157260ec2f39d6', 'request_id': 'req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:56.837267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 959/1899] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:56.838365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecd2f1-fdd4-4cff-bb27-529b77c1deec service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:56.838950 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ed72b5a288544d2ae157260ec2f39d6', 'request_id': 'req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:56.842451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9eecd2f1-fdd4-4cff-bb27-529b77c1deec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:56.862606 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecd2f1-fdd4-4cff-bb27-529b77c1deec service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:56.866359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c admin admin] The token cache is being invalidate because project 4ed72b5a288544d2ae157260ec2f39d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:56.866735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:56.868093 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:56.871299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 941/1900] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:56 2022] DELETE /identity/v3/projects/4ed72b5a288544d2ae157260ec2f39d6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:56.875378 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:56.881689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:56.962357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:56.973334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b9ac7-975f-4d0c-b9c6-456c91691548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:56.974593 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b9ac7-975f-4d0c-b9c6-456c91691548 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:56.975144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b9ac7-975f-4d0c-b9c6-456c91691548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:56.975671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b9ac7-975f-4d0c-b9c6-456c91691548 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:56.976834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b9ac7-975f-4d0c-b9c6-456c91691548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:56.979238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b9ac7-975f-4d0c-b9c6-456c91691548 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:56.994227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 960/1901] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:56.996081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c789e-126e-42f6-a481-0daac51441ac None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:56.996728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c789e-126e-42f6-a481-0daac51441ac None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:56.997390 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c789e-126e-42f6-a481-0daac51441ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:57.031580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-240c789e-126e-42f6-a481-0daac51441ac None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:57.033763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-240c789e-126e-42f6-a481-0daac51441ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:57.045923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 961/1902] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:57.055659 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c789e-126e-42f6-a481-0daac51441ac None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:57.058876 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-240c789e-126e-42f6-a481-0daac51441ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:57.062907 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a96eb7-fdca-41ef-9da5-70137d5c8c1c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:57.073495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61a9ce-765b-4ac5-8591-4c9c5f8fcb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:57.074450 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61a9ce-765b-4ac5-8591-4c9c5f8fcb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:57.074911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61a9ce-765b-4ac5-8591-4c9c5f8fcb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:57.075257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61a9ce-765b-4ac5-8591-4c9c5f8fcb9c admin admin] PATH_INFO: `/v3/users/842895edbe2a4d8289c8cef8c4f7fa7e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:57.077229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c789e-126e-42f6-a481-0daac51441ac None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:57.077359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61a9ce-765b-4ac5-8591-4c9c5f8fcb9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=842895edbe2a4d8289c8cef8c4f7fa7e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:57.082190 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61a9ce-765b-4ac5-8591-4c9c5f8fcb9c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:57.090896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d961f-c2e3-420b-ad65-86c2f87ffb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:57.093194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d961f-c2e3-420b-ad65-86c2f87ffb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:57.093495 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d961f-c2e3-420b-ad65-86c2f87ffb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:57.094356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d961f-c2e3-420b-ad65-86c2f87ffb41 admin admin] PATH_INFO: `/v3/projects/88d72f929d5546df912129e60dd9d613/users/69a2bf01ff494e3ebd41a023cd360d3d/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:57.131383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d961f-c2e3-420b-ad65-86c2f87ffb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d72f929d5546df912129e60dd9d613, user_id=69a2bf01ff494e3ebd41a023cd360d3d, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:57.139732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d961f-c2e3-420b-ad65-86c2f87ffb41 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:57.175691 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 962/1903] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:57 2022] PUT /identity/v3/projects/88d72f929d5546df912129e60dd9d613/users/69a2bf01ff494e3ebd41a023cd360d3d/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:57.178731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82651e1d-665b-44c7-8117-2b6a8ea331be None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:57.178731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82651e1d-665b-44c7-8117-2b6a8ea331be None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:57.178731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82651e1d-665b-44c7-8117-2b6a8ea331be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:57.223990 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ed61a9ce-765b-4ac5-8591-4c9c5f8fcb9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842895edbe2a4d8289c8cef8c4f7fa7e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:57.235066 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-82651e1d-665b-44c7-8117-2b6a8ea331be None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:57.236395 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-82651e1d-665b-44c7-8117-2b6a8ea331be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:57.240555 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ed61a9ce-765b-4ac5-8591-4c9c5f8fcb9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842895edbe2a4d8289c8cef8c4f7fa7e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:57.261892 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:57.265879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ed61a9ce-765b-4ac5-8591-4c9c5f8fcb9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842895edbe2a4d8289c8cef8c4f7fa7e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:57.292085 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ed61a9ce-765b-4ac5-8591-4c9c5f8fcb9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842895edbe2a4d8289c8cef8c4f7fa7e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:57.293577 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ed61a9ce-765b-4ac5-8591-4c9c5f8fcb9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842895edbe2a4d8289c8cef8c4f7fa7e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:57.306817 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 942/1904] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:25:56 2022] DELETE /identity/v3/users/842895edbe2a4d8289c8cef8c4f7fa7e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:57.323497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61a9ce-765b-4ac5-8591-4c9c5f8fcb9c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:57.329321 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ed61a9ce-765b-4ac5-8591-4c9c5f8fcb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:57.438448 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 963/1905] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:57.446944 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82651e1d-665b-44c7-8117-2b6a8ea331be None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:57.462265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82651e1d-665b-44c7-8117-2b6a8ea331be None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:57.490061 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61a9ce-765b-4ac5-8591-4c9c5f8fcb9c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:57.495467 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be836443-b55d-4054-8d81-a43c92ac6660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:57.498152 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df85c28-d107-436e-bc19-775cdd13943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:57.507211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df85c28-d107-436e-bc19-775cdd13943b admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:57.507759 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df85c28-d107-436e-bc19-775cdd13943b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:57.508213 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df85c28-d107-436e-bc19-775cdd13943b admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:57.509620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df85c28-d107-436e-bc19-775cdd13943b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:57.510388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be836443-b55d-4054-8d81-a43c92ac6660 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:57.511685 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be836443-b55d-4054-8d81-a43c92ac6660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:57.512045 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be836443-b55d-4054-8d81-a43c92ac6660 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:57.513091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df85c28-d107-436e-bc19-775cdd13943b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:57.513912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be836443-b55d-4054-8d81-a43c92ac6660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:57.515549 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be836443-b55d-4054-8d81-a43c92ac6660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:57.518343 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be836443-b55d-4054-8d81-a43c92ac6660 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:57.530261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 943/1906] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:57.535477 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df85c28-d107-436e-bc19-775cdd13943b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:57.548575 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df85c28-d107-436e-bc19-775cdd13943b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:57.555984 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac002d-55cb-43a6-8058-63f54be87b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:57.557065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac002d-55cb-43a6-8058-63f54be87b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:57.557565 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac002d-55cb-43a6-8058-63f54be87b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:57.558048 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac002d-55cb-43a6-8058-63f54be87b3d admin admin] PATH_INFO: `/v3/projects/88d72f929d5546df912129e60dd9d613/users/69a2bf01ff494e3ebd41a023cd360d3d/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:57.562766 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac002d-55cb-43a6-8058-63f54be87b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d72f929d5546df912129e60dd9d613, user_id=69a2bf01ff494e3ebd41a023cd360d3d, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:57.566079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac002d-55cb-43a6-8058-63f54be87b3d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:57.566673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 964/1907] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:57.571996 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be836443-b55d-4054-8d81-a43c92ac6660 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:57.579958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 944/1908] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:57 2022] PUT /identity/v3/projects/88d72f929d5546df912129e60dd9d613/users/69a2bf01ff494e3ebd41a023cd360d3d/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:25:57.595454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1f88b-967b-4ee3-ab4c-0b7ac2664722 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:57.596705 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1f88b-967b-4ee3-ab4c-0b7ac2664722 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:57.597521 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1f88b-967b-4ee3-ab4c-0b7ac2664722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:57.609446 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be836443-b55d-4054-8d81-a43c92ac6660 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:57.671182 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-dea1f88b-967b-4ee3-ab4c-0b7ac2664722 None None] MFA Rules not processed for user `69a2bf01ff494e3ebd41a023cd360d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:57.672440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dea1f88b-967b-4ee3-ab4c-0b7ac2664722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:57.697720 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a25e78-c65e-4978-a046-1258cc633044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:57.698888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a25e78-c65e-4978-a046-1258cc633044 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:57.699165 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a25e78-c65e-4978-a046-1258cc633044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:57.699439 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a25e78-c65e-4978-a046-1258cc633044 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:57.701846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a25e78-c65e-4978-a046-1258cc633044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:57.704963 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a25e78-c65e-4978-a046-1258cc633044 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:57.783478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 965/1909] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:57 2022] POST /identity/v3/projects => generated 365 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:57.784924 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a25e78-c65e-4978-a046-1258cc633044 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:57.876063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 945/1910] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:57.883690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1f88b-967b-4ee3-ab4c-0b7ac2664722 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:57.884480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:57.886222 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dea1f88b-967b-4ee3-ab4c-0b7ac2664722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:57.913973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a25e78-c65e-4978-a046-1258cc633044 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:57.927375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38f6be-6c79-432e-96ac-16045d258d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:57.927375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38f6be-6c79-432e-96ac-16045d258d2d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:57.927375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38f6be-6c79-432e-96ac-16045d258d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:57.927375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38f6be-6c79-432e-96ac-16045d258d2d admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:57.927880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38f6be-6c79-432e-96ac-16045d258d2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:57.930767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38f6be-6c79-432e-96ac-16045d258d2d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:57.988773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 966/1911] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:57 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:57.992459 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38f6be-6c79-432e-96ac-16045d258d2d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:58.018018 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38f6be-6c79-432e-96ac-16045d258d2d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:58.026388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eebb51-1796-4a7e-b541-87861e13980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:58.026940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eebb51-1796-4a7e-b541-87861e13980b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:58.027387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eebb51-1796-4a7e-b541-87861e13980b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:58.027680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eebb51-1796-4a7e-b541-87861e13980b admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:58.028391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eebb51-1796-4a7e-b541-87861e13980b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:58.030478 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1f88b-967b-4ee3-ab4c-0b7ac2664722 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:58.035014 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eebb51-1796-4a7e-b541-87861e13980b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:58.039831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:58.058931 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 967/1912] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:58.064443 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eebb51-1796-4a7e-b541-87861e13980b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:58.067080 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-44eebb51-1796-4a7e-b541-87861e13980b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:58.087307 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eebb51-1796-4a7e-b541-87861e13980b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:58.096118 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2885259-6d51-4b50-8484-15e796e715f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:58.096833 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2885259-6d51-4b50-8484-15e796e715f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:58.097115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2885259-6d51-4b50-8484-15e796e715f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:58.097390 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2885259-6d51-4b50-8484-15e796e715f1 admin admin] PATH_INFO: `/v3/projects/f6174566ccbc43819df0ad9a1b6af55c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:58.103379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8268a7-54f0-40eb-aecf-a968f2c6385f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:58.103898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2885259-6d51-4b50-8484-15e796e715f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6174566ccbc43819df0ad9a1b6af55c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:58.104738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8268a7-54f0-40eb-aecf-a968f2c6385f service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:58.105228 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8268a7-54f0-40eb-aecf-a968f2c6385f service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:58.105672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8268a7-54f0-40eb-aecf-a968f2c6385f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:58.105931 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2885259-6d51-4b50-8484-15e796e715f1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:58.108061 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9f8268a7-54f0-40eb-aecf-a968f2c6385f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:58.183840 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8268a7-54f0-40eb-aecf-a968f2c6385f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:58.185885 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8268a7-54f0-40eb-aecf-a968f2c6385f service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:58.194557 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b2885259-6d51-4b50-8484-15e796e715f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6174566ccbc43819df0ad9a1b6af55c', 'request_id': 'req-b2885259-6d51-4b50-8484-15e796e715f1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:58.196927 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 946/1913] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:25:58.197803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8268a7-54f0-40eb-aecf-a968f2c6385f service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:58.203825 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b2885259-6d51-4b50-8484-15e796e715f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6174566ccbc43819df0ad9a1b6af55c', 'request_id': 'req-b2885259-6d51-4b50-8484-15e796e715f1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:58.213355 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8268a7-54f0-40eb-aecf-a968f2c6385f service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:58.219744 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b2885259-6d51-4b50-8484-15e796e715f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6174566ccbc43819df0ad9a1b6af55c', 'request_id': 'req-b2885259-6d51-4b50-8484-15e796e715f1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:58.233535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b2885259-6d51-4b50-8484-15e796e715f1 admin admin] The token cache is being invalidate because project f6174566ccbc43819df0ad9a1b6af55c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:25:58.233950 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b2885259-6d51-4b50-8484-15e796e715f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:58.234702 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b2885259-6d51-4b50-8484-15e796e715f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:25:58.236681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 968/1914] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:25:58 2022] DELETE /identity/v3/projects/f6174566ccbc43819df0ad9a1b6af55c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:58.241336 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b24575-3091-4d1b-a8eb-50aa66f072b4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:58.241782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b24575-3091-4d1b-a8eb-50aa66f072b4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:58.242153 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b24575-3091-4d1b-a8eb-50aa66f072b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:58.270409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-68b24575-3091-4d1b-a8eb-50aa66f072b4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:58.271802 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-68b24575-3091-4d1b-a8eb-50aa66f072b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:58.314172 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646acc6-d9a8-47e8-9ce6-2d5df0e3203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:58.314870 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646acc6-d9a8-47e8-9ce6-2d5df0e3203e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:58.315227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646acc6-d9a8-47e8-9ce6-2d5df0e3203e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:58.315718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646acc6-d9a8-47e8-9ce6-2d5df0e3203e admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:58.316558 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646acc6-d9a8-47e8-9ce6-2d5df0e3203e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:58.318422 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646acc6-d9a8-47e8-9ce6-2d5df0e3203e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:58.335629 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 947/1915] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:58.338245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646acc6-d9a8-47e8-9ce6-2d5df0e3203e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:58.340456 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6646acc6-d9a8-47e8-9ce6-2d5df0e3203e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:58.354949 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646acc6-d9a8-47e8-9ce6-2d5df0e3203e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:58.362290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcf132-6674-4b21-98ec-91c0b4c4447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:58.363236 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcf132-6674-4b21-98ec-91c0b4c4447f admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:58.364408 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcf132-6674-4b21-98ec-91c0b4c4447f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:58.364894 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcf132-6674-4b21-98ec-91c0b4c4447f admin admin] PATH_INFO: `/v3/projects/88766412e7ea477d8f255250b264b892/users/41411a04ebda4b01918afcaca2bb3fd4/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:58.391484 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcf132-6674-4b21-98ec-91c0b4c4447f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88766412e7ea477d8f255250b264b892, user_id=41411a04ebda4b01918afcaca2bb3fd4, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:58.395080 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcf132-6674-4b21-98ec-91c0b4c4447f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:58.397261 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 969/1916] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:25:58.409633 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945c948-8a64-4a28-98fb-05425febafd0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:58.410519 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945c948-8a64-4a28-98fb-05425febafd0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:58.411011 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945c948-8a64-4a28-98fb-05425febafd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:58.431872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 948/1917] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:58 2022] PUT /identity/v3/projects/88766412e7ea477d8f255250b264b892/users/41411a04ebda4b01918afcaca2bb3fd4/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:58.443568 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e01a8-08fd-4cc1-971e-b1aecbccbed2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:58.443568 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e01a8-08fd-4cc1-971e-b1aecbccbed2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:58.443568 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e01a8-08fd-4cc1-971e-b1aecbccbed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:58.457915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5945c948-8a64-4a28-98fb-05425febafd0 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:58.459260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5945c948-8a64-4a28-98fb-05425febafd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:58.510199 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-859e01a8-08fd-4cc1-971e-b1aecbccbed2 None None] MFA Rules not processed for user `41411a04ebda4b01918afcaca2bb3fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:58.511425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-859e01a8-08fd-4cc1-971e-b1aecbccbed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:58.542025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:58.556561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:58.597399 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 970/1918] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:58.600242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945c948-8a64-4a28-98fb-05425febafd0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:58.612021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945c948-8a64-4a28-98fb-05425febafd0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:58.617944 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3c5e4-ead4-41a7-b5db-93c81fbc5800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:58.618727 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3c5e4-ead4-41a7-b5db-93c81fbc5800 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:58.619009 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3c5e4-ead4-41a7-b5db-93c81fbc5800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:58.619342 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3c5e4-ead4-41a7-b5db-93c81fbc5800 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:58.620003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3c5e4-ead4-41a7-b5db-93c81fbc5800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:25:58.620306 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3c5e4-ead4-41a7-b5db-93c81fbc5800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:58.622394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3c5e4-ead4-41a7-b5db-93c81fbc5800 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:58.624671 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 949/1919] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:25:58.641202 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 971/1920] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:25:58.645539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e01a8-08fd-4cc1-971e-b1aecbccbed2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:58.658472 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e01a8-08fd-4cc1-971e-b1aecbccbed2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:58.658934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3c5e4-ead4-41a7-b5db-93c81fbc5800 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:58.660643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8db3c5e4-ead4-41a7-b5db-93c81fbc5800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:58.664653 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3893aed-aa65-4383-bcc0-8244dc8e4b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:58.665272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3893aed-aa65-4383-bcc0-8244dc8e4b5e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:58.665548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3893aed-aa65-4383-bcc0-8244dc8e4b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:58.665820 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3893aed-aa65-4383-bcc0-8244dc8e4b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:58.666510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3893aed-aa65-4383-bcc0-8244dc8e4b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:58.668462 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3893aed-aa65-4383-bcc0-8244dc8e4b5e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:58.706125 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 950/1921] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:58 2022] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:25:58.710779 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3893aed-aa65-4383-bcc0-8244dc8e4b5e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:58.747263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3c5e4-ead4-41a7-b5db-93c81fbc5800 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:58.810281 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3893aed-aa65-4383-bcc0-8244dc8e4b5e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:58.815867 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d21970-2371-445a-87d5-06b9c39223f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:58.816065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15f059-73c4-4b4a-a7d8-dc78c38c6d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:58.816474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d21970-2371-445a-87d5-06b9c39223f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:58.816709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15f059-73c4-4b4a-a7d8-dc78c38c6d4e service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:58.816822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d21970-2371-445a-87d5-06b9c39223f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:58.816985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15f059-73c4-4b4a-a7d8-dc78c38c6d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:58.817079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d21970-2371-445a-87d5-06b9c39223f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:58.817257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15f059-73c4-4b4a-a7d8-dc78c38c6d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:58.817643 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d21970-2371-445a-87d5-06b9c39223f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:58.819602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d21970-2371-445a-87d5-06b9c39223f1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:58.849725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 951/1922] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:58 2022] POST /identity/v3/users => generated 296 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:25:58.850757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d21970-2371-445a-87d5-06b9c39223f1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:58.864775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d21970-2371-445a-87d5-06b9c39223f1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:58.877292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8442da7-8705-4d42-a342-46c060a270dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:58.877292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8442da7-8705-4d42-a342-46c060a270dd admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:58.877292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8442da7-8705-4d42-a342-46c060a270dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:58.877292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8442da7-8705-4d42-a342-46c060a270dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:58.877610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8442da7-8705-4d42-a342-46c060a270dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:58.877610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8442da7-8705-4d42-a342-46c060a270dd admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:58.887999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 952/1923] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:58.892808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8442da7-8705-4d42-a342-46c060a270dd admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:58.914192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8442da7-8705-4d42-a342-46c060a270dd admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:58.919482 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15f059-73c4-4b4a-a7d8-dc78c38c6d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:58.920780 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fde95b-d5a5-4bb4-9172-89842a9bae8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:58.921647 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fde95b-d5a5-4bb4-9172-89842a9bae8c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:58.922134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fde95b-d5a5-4bb4-9172-89842a9bae8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:58.922460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15f059-73c4-4b4a-a7d8-dc78c38c6d4e service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:58.922871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fde95b-d5a5-4bb4-9172-89842a9bae8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:58.923766 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fde95b-d5a5-4bb4-9172-89842a9bae8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:58.925718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fde95b-d5a5-4bb4-9172-89842a9bae8c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:58.938204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 953/1924] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:58.942482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fde95b-d5a5-4bb4-9172-89842a9bae8c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:58.951501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 972/1925] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:25:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:25:58.956948 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fde95b-d5a5-4bb4-9172-89842a9bae8c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:58.962871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64e7cc-751b-4fe5-8835-14046f3ae332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:58.963838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64e7cc-751b-4fe5-8835-14046f3ae332 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:58.964159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64e7cc-751b-4fe5-8835-14046f3ae332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:58.964523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64e7cc-751b-4fe5-8835-14046f3ae332 admin admin] PATH_INFO: `/v3/projects/127fd21cb61d4acc98080909f0589491/users/a72364241177478bb3988a427fceaf22/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:58.986273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64e7cc-751b-4fe5-8835-14046f3ae332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127fd21cb61d4acc98080909f0589491, user_id=a72364241177478bb3988a427fceaf22, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:58.989481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64e7cc-751b-4fe5-8835-14046f3ae332 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:59.024951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 954/1926] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:58 2022] PUT /identity/v3/projects/127fd21cb61d4acc98080909f0589491/users/a72364241177478bb3988a427fceaf22/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:59.029020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66171af9-9761-487d-936a-cd8dd759157d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:59.029863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66171af9-9761-487d-936a-cd8dd759157d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:59.030323 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66171af9-9761-487d-936a-cd8dd759157d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:59.073418 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-66171af9-9761-487d-936a-cd8dd759157d None None] MFA Rules not processed for user `a72364241177478bb3988a427fceaf22`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:59.075514 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-66171af9-9761-487d-936a-cd8dd759157d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:25:59.103810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:59.216748 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 973/1927] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:25:59.223259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64e7cc-751b-4fe5-8835-14046f3ae332 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:59.348960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:25:59.409022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64e7cc-751b-4fe5-8835-14046f3ae332 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:59.424020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5d7ae-cecf-46b6-abfe-bad7c8536db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:59.424689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5d7ae-cecf-46b6-abfe-bad7c8536db0 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:59.425124 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5d7ae-cecf-46b6-abfe-bad7c8536db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:59.425532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5d7ae-cecf-46b6-abfe-bad7c8536db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:59.426165 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5d7ae-cecf-46b6-abfe-bad7c8536db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:59.428091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5d7ae-cecf-46b6-abfe-bad7c8536db0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:59.518922 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 955/1928] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:25:59 2022] POST /identity/v3/projects => generated 393 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:25:59.523849 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66171af9-9761-487d-936a-cd8dd759157d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:59.541145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66171af9-9761-487d-936a-cd8dd759157d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:59.618140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d90d1d-6ebb-45b8-be47-0fa3f95ba079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:59.618750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d90d1d-6ebb-45b8-be47-0fa3f95ba079 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:59.619030 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d90d1d-6ebb-45b8-be47-0fa3f95ba079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:59.619303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d90d1d-6ebb-45b8-be47-0fa3f95ba079 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:59.619928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d90d1d-6ebb-45b8-be47-0fa3f95ba079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:59.623554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d90d1d-6ebb-45b8-be47-0fa3f95ba079 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:59.648219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 974/1929] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:25:59 2022] POST /identity/v3/users => generated 303 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:25:59.649460 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5d7ae-cecf-46b6-abfe-bad7c8536db0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:59.660464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5d7ae-cecf-46b6-abfe-bad7c8536db0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:59.665412 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2e3f3-b72e-4080-b39c-72008419a447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:59.666040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2e3f3-b72e-4080-b39c-72008419a447 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:59.666348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2e3f3-b72e-4080-b39c-72008419a447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:59.666593 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2e3f3-b72e-4080-b39c-72008419a447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:59.667231 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2e3f3-b72e-4080-b39c-72008419a447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:59.668868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2e3f3-b72e-4080-b39c-72008419a447 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:59.680678 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 956/1930] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:25:59.685241 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d90d1d-6ebb-45b8-be47-0fa3f95ba079 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:59.696278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d90d1d-6ebb-45b8-be47-0fa3f95ba079 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:59.701137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d378de-cd9a-49de-ad05-00aa077aaa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:59.701864 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d378de-cd9a-49de-ad05-00aa077aaa25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:59.702152 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d378de-cd9a-49de-ad05-00aa077aaa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:59.702431 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d378de-cd9a-49de-ad05-00aa077aaa25 admin admin] PATH_INFO: `/v3/projects/1f55948940e04ab285bf499a3328a8d0/users/a6ac20955fc04366b3f25e42b680dcc2/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:59.718338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d378de-cd9a-49de-ad05-00aa077aaa25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f55948940e04ab285bf499a3328a8d0, user_id=a6ac20955fc04366b3f25e42b680dcc2, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:59.721089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d378de-cd9a-49de-ad05-00aa077aaa25 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:59.735721 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 975/1931] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:59 2022] PUT /identity/v3/projects/1f55948940e04ab285bf499a3328a8d0/users/a6ac20955fc04366b3f25e42b680dcc2/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:59.739862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2e3f3-b72e-4080-b39c-72008419a447 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:59.750709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2e3f3-b72e-4080-b39c-72008419a447 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:59.811623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7b152-1627-45e9-b03d-38536321ae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:59.812215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7b152-1627-45e9-b03d-38536321ae26 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:59.812496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7b152-1627-45e9-b03d-38536321ae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:59.812802 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7b152-1627-45e9-b03d-38536321ae26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:59.813445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7b152-1627-45e9-b03d-38536321ae26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:59.815042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7b152-1627-45e9-b03d-38536321ae26 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:59.825836 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 957/1932] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:25:59.829981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d378de-cd9a-49de-ad05-00aa077aaa25 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:25:59.842022 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d378de-cd9a-49de-ad05-00aa077aaa25 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:25:59.848465 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76050a1-3657-4d42-a0ad-d31f1b4514af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:25:59.849227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76050a1-3657-4d42-a0ad-d31f1b4514af admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:59.849585 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76050a1-3657-4d42-a0ad-d31f1b4514af admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:59.849786 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76050a1-3657-4d42-a0ad-d31f1b4514af admin admin] PATH_INFO: `/v3/projects/1f55948940e04ab285bf499a3328a8d0/users/a6ac20955fc04366b3f25e42b680dcc2/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:59.851738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76050a1-3657-4d42-a0ad-d31f1b4514af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f55948940e04ab285bf499a3328a8d0, user_id=a6ac20955fc04366b3f25e42b680dcc2, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:25:59.864905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76050a1-3657-4d42-a0ad-d31f1b4514af admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:25:59.868064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 976/1933] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:25:59 2022] PUT /identity/v3/projects/1f55948940e04ab285bf499a3328a8d0/users/a6ac20955fc04366b3f25e42b680dcc2/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:25:59.877940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50986-e1a3-4d8a-ba8d-76678ef45659 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:25:59.878229 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50986-e1a3-4d8a-ba8d-76678ef45659 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:25:59.878510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50986-e1a3-4d8a-ba8d-76678ef45659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:25:59.910949 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-83e50986-e1a3-4d8a-ba8d-76678ef45659 None None] MFA Rules not processed for user `a6ac20955fc04366b3f25e42b680dcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:25:59.912482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-83e50986-e1a3-4d8a-ba8d-76678ef45659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:00.006117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 958/1934] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:25:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:00.018998 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76050a1-3657-4d42-a0ad-d31f1b4514af admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:00.021494 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e76050a1-3657-4d42-a0ad-d31f1b4514af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:00.103314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76050a1-3657-4d42-a0ad-d31f1b4514af admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:00.106930 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5394c1c-27b3-4bbc-a706-9f9423270be6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:00.107534 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5394c1c-27b3-4bbc-a706-9f9423270be6 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:00.107807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5394c1c-27b3-4bbc-a706-9f9423270be6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:00.108072 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5394c1c-27b3-4bbc-a706-9f9423270be6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:00.117514 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5394c1c-27b3-4bbc-a706-9f9423270be6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:00.118906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5394c1c-27b3-4bbc-a706-9f9423270be6 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:00.129452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 977/1935] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:00 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:00.191452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50986-e1a3-4d8a-ba8d-76678ef45659 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:00.209372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50986-e1a3-4d8a-ba8d-76678ef45659 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:00.217990 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7977c8-cc30-4136-84be-b3a5388b9c61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:00.218830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7977c8-cc30-4136-84be-b3a5388b9c61 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:00.219280 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7977c8-cc30-4136-84be-b3a5388b9c61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:00.219800 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7977c8-cc30-4136-84be-b3a5388b9c61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:00.277384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:00.304765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7977c8-cc30-4136-84be-b3a5388b9c61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:00.306828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7977c8-cc30-4136-84be-b3a5388b9c61 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:00.317868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 959/1936] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:01.896646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5394c1c-27b3-4bbc-a706-9f9423270be6 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:01.898171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d5394c1c-27b3-4bbc-a706-9f9423270be6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:01.927778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:02.006661 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5394c1c-27b3-4bbc-a706-9f9423270be6 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:02.014980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0b4ea-ae44-4fda-97fa-c3411f791637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:02.016080 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0b4ea-ae44-4fda-97fa-c3411f791637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:02.016767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0b4ea-ae44-4fda-97fa-c3411f791637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:02.017365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0b4ea-ae44-4fda-97fa-c3411f791637 admin admin] PATH_INFO: `/v3/users/dbac6b6c0da14d99939101a2def9552f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:02.022272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0b4ea-ae44-4fda-97fa-c3411f791637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbac6b6c0da14d99939101a2def9552f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:02.024964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0b4ea-ae44-4fda-97fa-c3411f791637 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:02.104969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0cc0b4ea-ae44-4fda-97fa-c3411f791637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbac6b6c0da14d99939101a2def9552f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:02.120972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0cc0b4ea-ae44-4fda-97fa-c3411f791637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbac6b6c0da14d99939101a2def9552f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:02.133814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0cc0b4ea-ae44-4fda-97fa-c3411f791637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbac6b6c0da14d99939101a2def9552f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:02.146119 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0cc0b4ea-ae44-4fda-97fa-c3411f791637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbac6b6c0da14d99939101a2def9552f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:02.147445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0cc0b4ea-ae44-4fda-97fa-c3411f791637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbac6b6c0da14d99939101a2def9552f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:02.154944 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 978/1937] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:01 2022] DELETE /identity/v3/users/dbac6b6c0da14d99939101a2def9552f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:02.160297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfaa8b4-e3b5-4871-ab92-f8c6fe332f02 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:02.160834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfaa8b4-e3b5-4871-ab92-f8c6fe332f02 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:02.161033 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfaa8b4-e3b5-4871-ab92-f8c6fe332f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:02.181814 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9bfaa8b4-e3b5-4871-ab92-f8c6fe332f02 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:02.183005 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9bfaa8b4-e3b5-4871-ab92-f8c6fe332f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:02.276696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 960/1938] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:02.306685 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0b4ea-ae44-4fda-97fa-c3411f791637 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:02.309403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0cc0b4ea-ae44-4fda-97fa-c3411f791637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:02.403749 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0b4ea-ae44-4fda-97fa-c3411f791637 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:02.411105 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c823a-9b0d-4a79-be10-c5ccffcf1739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:02.411656 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c823a-9b0d-4a79-be10-c5ccffcf1739 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:02.411938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c823a-9b0d-4a79-be10-c5ccffcf1739 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:02.412215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c823a-9b0d-4a79-be10-c5ccffcf1739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:02.423974 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c823a-9b0d-4a79-be10-c5ccffcf1739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:02.426248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c823a-9b0d-4a79-be10-c5ccffcf1739 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:02.440768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 979/1939] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:03.014424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfaa8b4-e3b5-4871-ab92-f8c6fe332f02 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:03.015413 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9bfaa8b4-e3b5-4871-ab92-f8c6fe332f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:03.038661 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfaa8b4-e3b5-4871-ab92-f8c6fe332f02 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:03.051997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714744e7-7bcc-450e-a294-27a84b2cefbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:03.052691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714744e7-7bcc-450e-a294-27a84b2cefbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:03.052977 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714744e7-7bcc-450e-a294-27a84b2cefbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:03.053255 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714744e7-7bcc-450e-a294-27a84b2cefbf admin admin] PATH_INFO: `/v3/projects/d8f00d3136854f729b810361efc58fbc` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:03.060457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714744e7-7bcc-450e-a294-27a84b2cefbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f00d3136854f729b810361efc58fbc)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:03.062448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714744e7-7bcc-450e-a294-27a84b2cefbf admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:03.158035 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c823a-9b0d-4a79-be10-c5ccffcf1739 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:03.159778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ea6c823a-9b0d-4a79-be10-c5ccffcf1739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:03.212055 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-714744e7-7bcc-450e-a294-27a84b2cefbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f00d3136854f729b810361efc58fbc', 'request_id': 'req-714744e7-7bcc-450e-a294-27a84b2cefbf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:03.240452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-714744e7-7bcc-450e-a294-27a84b2cefbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f00d3136854f729b810361efc58fbc', 'request_id': 'req-714744e7-7bcc-450e-a294-27a84b2cefbf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:03.250317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-714744e7-7bcc-450e-a294-27a84b2cefbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f00d3136854f729b810361efc58fbc', 'request_id': 'req-714744e7-7bcc-450e-a294-27a84b2cefbf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:03.267976 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-714744e7-7bcc-450e-a294-27a84b2cefbf admin admin] The token cache is being invalidate because project d8f00d3136854f729b810361efc58fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:03.268319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-714744e7-7bcc-450e-a294-27a84b2cefbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:03.273357 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-714744e7-7bcc-450e-a294-27a84b2cefbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:03.275451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:03.278034 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 961/1940] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:03 2022] DELETE /identity/v3/projects/d8f00d3136854f729b810361efc58fbc => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:03.282866 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714744e7-7bcc-450e-a294-27a84b2cefbf admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:03.285629 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-714744e7-7bcc-450e-a294-27a84b2cefbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:03.290689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c823a-9b0d-4a79-be10-c5ccffcf1739 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:03.354297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174661e-8ac5-47d2-a1bb-793b84d01619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:03.355450 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174661e-8ac5-47d2-a1bb-793b84d01619 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:03.355933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174661e-8ac5-47d2-a1bb-793b84d01619 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:03.356295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174661e-8ac5-47d2-a1bb-793b84d01619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:03.359161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0174661e-8ac5-47d2-a1bb-793b84d01619 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:03.370678 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714744e7-7bcc-450e-a294-27a84b2cefbf admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:03.376816 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe421ff-e76b-4f65-8e0a-c54755b3bece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:03.377449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe421ff-e76b-4f65-8e0a-c54755b3bece admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:03.377797 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe421ff-e76b-4f65-8e0a-c54755b3bece admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:03.378070 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe421ff-e76b-4f65-8e0a-c54755b3bece admin admin] PATH_INFO: `/v3/users/a9d26ae336ff44da8c8050d633654018` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:03.379251 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe421ff-e76b-4f65-8e0a-c54755b3bece admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d26ae336ff44da8c8050d633654018)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:03.381486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe421ff-e76b-4f65-8e0a-c54755b3bece admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:03.387228 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:03.448877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1fe421ff-e76b-4f65-8e0a-c54755b3bece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d26ae336ff44da8c8050d633654018'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:03.452743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174661e-8ac5-47d2-a1bb-793b84d01619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:03.455440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174661e-8ac5-47d2-a1bb-793b84d01619 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:03.458784 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1fe421ff-e76b-4f65-8e0a-c54755b3bece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d26ae336ff44da8c8050d633654018'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:03.465836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 980/1941] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:03.477083 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1fe421ff-e76b-4f65-8e0a-c54755b3bece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d26ae336ff44da8c8050d633654018'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:03.488795 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1fe421ff-e76b-4f65-8e0a-c54755b3bece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d26ae336ff44da8c8050d633654018'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:03.489536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1fe421ff-e76b-4f65-8e0a-c54755b3bece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d26ae336ff44da8c8050d633654018'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:03.497922 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 962/1942] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:03 2022] DELETE /identity/v3/users/a9d26ae336ff44da8c8050d633654018 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:03.802235 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174661e-8ac5-47d2-a1bb-793b84d01619 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:03.830584 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174661e-8ac5-47d2-a1bb-793b84d01619 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:03.901732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25559de2-c409-4b77-b330-f45e79eb9291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:03.902960 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25559de2-c409-4b77-b330-f45e79eb9291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:03.903466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25559de2-c409-4b77-b330-f45e79eb9291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:03.904691 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25559de2-c409-4b77-b330-f45e79eb9291 admin admin] PATH_INFO: `/v3/projects/1acacec5254447fd95a6dad57dcbc3d6` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:03.906206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25559de2-c409-4b77-b330-f45e79eb9291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1acacec5254447fd95a6dad57dcbc3d6)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:03.908671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25559de2-c409-4b77-b330-f45e79eb9291 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:03.964898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-25559de2-c409-4b77-b330-f45e79eb9291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1acacec5254447fd95a6dad57dcbc3d6', 'request_id': 'req-25559de2-c409-4b77-b330-f45e79eb9291'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:03.966724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:03.973035 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-25559de2-c409-4b77-b330-f45e79eb9291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1acacec5254447fd95a6dad57dcbc3d6', 'request_id': 'req-25559de2-c409-4b77-b330-f45e79eb9291'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:03.982080 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-25559de2-c409-4b77-b330-f45e79eb9291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1acacec5254447fd95a6dad57dcbc3d6', 'request_id': 'req-25559de2-c409-4b77-b330-f45e79eb9291'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:03.996401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-25559de2-c409-4b77-b330-f45e79eb9291 admin admin] The token cache is being invalidate because project 1acacec5254447fd95a6dad57dcbc3d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:03.996731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-25559de2-c409-4b77-b330-f45e79eb9291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:03.997418 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-25559de2-c409-4b77-b330-f45e79eb9291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:03.998920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 981/1943] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:03 2022] DELETE /identity/v3/projects/1acacec5254447fd95a6dad57dcbc3d6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:04.003882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de421eb-c43d-4cbb-8f48-9c975aa741f9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:04.004173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de421eb-c43d-4cbb-8f48-9c975aa741f9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:04.004456 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de421eb-c43d-4cbb-8f48-9c975aa741f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:04.025156 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3de421eb-c43d-4cbb-8f48-9c975aa741f9 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:04.026378 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3de421eb-c43d-4cbb-8f48-9c975aa741f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:04.096054 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 963/1944] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:04.104714 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2b09e-3a65-4d8e-b490-1d13be9bd3c9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:04.105216 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2b09e-3a65-4d8e-b490-1d13be9bd3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:04.105831 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2b09e-3a65-4d8e-b490-1d13be9bd3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:04.128206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f3e2b09e-3a65-4d8e-b490-1d13be9bd3c9 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:04.129868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f3e2b09e-3a65-4d8e-b490-1d13be9bd3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:04.143516 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 982/1945] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:04.144967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de421eb-c43d-4cbb-8f48-9c975aa741f9 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:04.155961 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de421eb-c43d-4cbb-8f48-9c975aa741f9 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:04.172078 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28addbc-2502-4df7-8c7c-2ed5dbc2fe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:04.173340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28addbc-2502-4df7-8c7c-2ed5dbc2fe2e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:04.173813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28addbc-2502-4df7-8c7c-2ed5dbc2fe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:04.174223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28addbc-2502-4df7-8c7c-2ed5dbc2fe2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:04.177824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28addbc-2502-4df7-8c7c-2ed5dbc2fe2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:04.178268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28addbc-2502-4df7-8c7c-2ed5dbc2fe2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:04.180126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28addbc-2502-4df7-8c7c-2ed5dbc2fe2e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:04.200139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 964/1946] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:26:04.201267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2b09e-3a65-4d8e-b490-1d13be9bd3c9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:04.227852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2b09e-3a65-4d8e-b490-1d13be9bd3c9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:04.242102 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd649d-4621-4229-89aa-5cd1525231c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:04.244215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd649d-4621-4229-89aa-5cd1525231c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:04.244536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd649d-4621-4229-89aa-5cd1525231c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:04.244854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd649d-4621-4229-89aa-5cd1525231c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:04.249577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd649d-4621-4229-89aa-5cd1525231c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:04.253441 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd649d-4621-4229-89aa-5cd1525231c1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:04.323796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 983/1947] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:04 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:04.329689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28addbc-2502-4df7-8c7c-2ed5dbc2fe2e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:04.351449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28addbc-2502-4df7-8c7c-2ed5dbc2fe2e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:04.457305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308eb36-f2f1-4a13-a6c5-d93b29638d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:04.458858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308eb36-f2f1-4a13-a6c5-d93b29638d82 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:04.459359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308eb36-f2f1-4a13-a6c5-d93b29638d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:04.459839 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308eb36-f2f1-4a13-a6c5-d93b29638d82 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:04.460721 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308eb36-f2f1-4a13-a6c5-d93b29638d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:04.471367 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308eb36-f2f1-4a13-a6c5-d93b29638d82 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:04.502620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:04.511715 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 965/1948] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:04 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:04.516615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd649d-4621-4229-89aa-5cd1525231c1 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:04.532001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd649d-4621-4229-89aa-5cd1525231c1 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:04.542836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4753a0-9abe-4db0-a919-c1aeafebfd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:04.543488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4753a0-9abe-4db0-a919-c1aeafebfd22 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:04.543763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4753a0-9abe-4db0-a919-c1aeafebfd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:04.544046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4753a0-9abe-4db0-a919-c1aeafebfd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:04.545413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4753a0-9abe-4db0-a919-c1aeafebfd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:04.547071 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4753a0-9abe-4db0-a919-c1aeafebfd22 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:04.563352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 984/1949] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:04.566820 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308eb36-f2f1-4a13-a6c5-d93b29638d82 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:04.582666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308eb36-f2f1-4a13-a6c5-d93b29638d82 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:04.588306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e896fc-905d-4696-a9f1-0d6602995405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:04.589210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e896fc-905d-4696-a9f1-0d6602995405 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:04.589393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e896fc-905d-4696-a9f1-0d6602995405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:04.589678 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e896fc-905d-4696-a9f1-0d6602995405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:04.590331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e896fc-905d-4696-a9f1-0d6602995405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:04.592105 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e896fc-905d-4696-a9f1-0d6602995405 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:04.608239 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 966/1950] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:04.614460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4753a0-9abe-4db0-a919-c1aeafebfd22 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:04.617506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5f4753a0-9abe-4db0-a919-c1aeafebfd22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:04.620244 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e896fc-905d-4696-a9f1-0d6602995405 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:04.641020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e896fc-905d-4696-a9f1-0d6602995405 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:04.643468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4753a0-9abe-4db0-a919-c1aeafebfd22 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:04.653124 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3fdbf-3efb-4eb4-ad35-45dc0928974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:04.653831 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3fdbf-3efb-4eb4-ad35-45dc0928974c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:04.654097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3fdbf-3efb-4eb4-ad35-45dc0928974c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:04.654375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3fdbf-3efb-4eb4-ad35-45dc0928974c admin admin] PATH_INFO: `/v3/users/a72364241177478bb3988a427fceaf22` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:04.656055 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b0734-4d1e-4679-8751-0b3be804ed28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:04.657008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b0734-4d1e-4679-8751-0b3be804ed28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:04.657294 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b0734-4d1e-4679-8751-0b3be804ed28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:04.657567 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b0734-4d1e-4679-8751-0b3be804ed28 admin admin] PATH_INFO: `/v3/projects/e67995ba16ae4698961ea3c2faeaf4df/users/8b41b02287714024a6a757ee92a9bbf1/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:04.659128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3fdbf-3efb-4eb4-ad35-45dc0928974c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72364241177478bb3988a427fceaf22)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:04.661947 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3fdbf-3efb-4eb4-ad35-45dc0928974c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:04.711162 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b0734-4d1e-4679-8751-0b3be804ed28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e67995ba16ae4698961ea3c2faeaf4df, user_id=8b41b02287714024a6a757ee92a9bbf1, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:04.713882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b0734-4d1e-4679-8751-0b3be804ed28 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:04.741270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 967/1951] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:04 2022] PUT /identity/v3/projects/e67995ba16ae4698961ea3c2faeaf4df/users/8b41b02287714024a6a757ee92a9bbf1/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:04.744086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d2f69-b6e8-48c5-9e04-3233832229f4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:04.744377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d2f69-b6e8-48c5-9e04-3233832229f4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:04.744959 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d2f69-b6e8-48c5-9e04-3233832229f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:04.758487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19f3fdbf-3efb-4eb4-ad35-45dc0928974c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72364241177478bb3988a427fceaf22'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:04.784368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19f3fdbf-3efb-4eb4-ad35-45dc0928974c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72364241177478bb3988a427fceaf22'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:04.789846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b38d2f69-b6e8-48c5-9e04-3233832229f4 None None] MFA Rules not processed for user `8b41b02287714024a6a757ee92a9bbf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:04.792155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b38d2f69-b6e8-48c5-9e04-3233832229f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:04.816732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19f3fdbf-3efb-4eb4-ad35-45dc0928974c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72364241177478bb3988a427fceaf22'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:04.823943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19f3fdbf-3efb-4eb4-ad35-45dc0928974c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72364241177478bb3988a427fceaf22'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:04.825148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19f3fdbf-3efb-4eb4-ad35-45dc0928974c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72364241177478bb3988a427fceaf22'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:04.835303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 985/1952] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:04 2022] DELETE /identity/v3/users/a72364241177478bb3988a427fceaf22 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:04.839338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b055a4a-ba04-4260-8dbf-ff0a0c294e2e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:04.839735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b055a4a-ba04-4260-8dbf-ff0a0c294e2e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:04.840338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b055a4a-ba04-4260-8dbf-ff0a0c294e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:04.873108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8b055a4a-ba04-4260-8dbf-ff0a0c294e2e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:04.881086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8b055a4a-ba04-4260-8dbf-ff0a0c294e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:04.892302 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 968/1953] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:04.893742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d2f69-b6e8-48c5-9e04-3233832229f4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:04.896177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b38d2f69-b6e8-48c5-9e04-3233832229f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:04.988877 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 986/1954] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:05.001446 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b055a4a-ba04-4260-8dbf-ff0a0c294e2e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:05.004136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d2f69-b6e8-48c5-9e04-3233832229f4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:05.006826 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8b055a4a-ba04-4260-8dbf-ff0a0c294e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:05.010696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb590e81-ebed-4b01-b694-658eac735847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:05.011340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb590e81-ebed-4b01-b694-658eac735847 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:05.011626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb590e81-ebed-4b01-b694-658eac735847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:05.011907 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb590e81-ebed-4b01-b694-658eac735847 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:05.012551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb590e81-ebed-4b01-b694-658eac735847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:05.018183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb590e81-ebed-4b01-b694-658eac735847 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:05.045693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:05.080899 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 969/1955] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:04 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:05.085528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb590e81-ebed-4b01-b694-658eac735847 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:05.155612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b055a4a-ba04-4260-8dbf-ff0a0c294e2e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:05.186314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:05.224761 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb590e81-ebed-4b01-b694-658eac735847 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:05.231547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca1fda-9ca3-467e-80ef-c013ee01d50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:05.232956 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca1fda-9ca3-467e-80ef-c013ee01d50b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:05.233241 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca1fda-9ca3-467e-80ef-c013ee01d50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:05.233691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca1fda-9ca3-467e-80ef-c013ee01d50b admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:05.234883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca1fda-9ca3-467e-80ef-c013ee01d50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:05.238192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca1fda-9ca3-467e-80ef-c013ee01d50b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:05.270614 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 970/1956] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:05 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:05.274922 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e63fdd-fc98-4eaa-95cf-33e54660bb2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:05.275501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e63fdd-fc98-4eaa-95cf-33e54660bb2d service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:05.275783 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e63fdd-fc98-4eaa-95cf-33e54660bb2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:05.276057 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e63fdd-fc98-4eaa-95cf-33e54660bb2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:05.277475 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca1fda-9ca3-467e-80ef-c013ee01d50b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:05.298449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e63fdd-fc98-4eaa-95cf-33e54660bb2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:05.309989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e63fdd-fc98-4eaa-95cf-33e54660bb2d service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:05.318135 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca1fda-9ca3-467e-80ef-c013ee01d50b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:05.325221 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e50700-a23f-4603-8027-1665e22bfa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:05.326772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e50700-a23f-4603-8027-1665e22bfa30 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:05.327124 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e50700-a23f-4603-8027-1665e22bfa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:05.327469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e50700-a23f-4603-8027-1665e22bfa30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:05.328439 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e50700-a23f-4603-8027-1665e22bfa30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:05.330704 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e50700-a23f-4603-8027-1665e22bfa30 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:05.346006 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 987/1957] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:05.346353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 971/1958] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:05.355578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e63fdd-fc98-4eaa-95cf-33e54660bb2d service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:05.367509 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e63fdd-fc98-4eaa-95cf-33e54660bb2d service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:05.374420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2454a8-5863-4642-97c3-fd2e51a80dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:05.375285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2454a8-5863-4642-97c3-fd2e51a80dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:05.375717 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2454a8-5863-4642-97c3-fd2e51a80dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:05.376180 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2454a8-5863-4642-97c3-fd2e51a80dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:05.377232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2454a8-5863-4642-97c3-fd2e51a80dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:05.379381 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2454a8-5863-4642-97c3-fd2e51a80dbb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:05.391462 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 988/1959] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:05.395765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e50700-a23f-4603-8027-1665e22bfa30 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:05.411956 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e50700-a23f-4603-8027-1665e22bfa30 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:05.421747 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98b222-fcf8-42ea-aa17-d1a8c3fc32e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:05.422905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98b222-fcf8-42ea-aa17-d1a8c3fc32e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:05.423495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98b222-fcf8-42ea-aa17-d1a8c3fc32e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:05.424089 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98b222-fcf8-42ea-aa17-d1a8c3fc32e9 admin admin] PATH_INFO: `/v3/projects/9a2192fd7b4c49cea1b4f58d01e327e1/users/09d51bfb29a040efb3b5848d7850797b/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:05.456891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98b222-fcf8-42ea-aa17-d1a8c3fc32e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2192fd7b4c49cea1b4f58d01e327e1, user_id=09d51bfb29a040efb3b5848d7850797b, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:05.460914 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98b222-fcf8-42ea-aa17-d1a8c3fc32e9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:05.494496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 972/1960] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:05 2022] PUT /identity/v3/projects/9a2192fd7b4c49cea1b4f58d01e327e1/users/09d51bfb29a040efb3b5848d7850797b/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:05.505882 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68fc6e-2d05-47fa-9a37-5defc06c8e07 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:05.506299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68fc6e-2d05-47fa-9a37-5defc06c8e07 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:05.506510 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68fc6e-2d05-47fa-9a37-5defc06c8e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:05.555317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8c68fc6e-2d05-47fa-9a37-5defc06c8e07 None None] MFA Rules not processed for user `09d51bfb29a040efb3b5848d7850797b`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:05.556909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8c68fc6e-2d05-47fa-9a37-5defc06c8e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:05.655568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 989/1961] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:05.660679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98b222-fcf8-42ea-aa17-d1a8c3fc32e9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:05.738911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98b222-fcf8-42ea-aa17-d1a8c3fc32e9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:05.747385 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2952b5-9863-4e09-b8ce-975ac10eae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:05.749539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2952b5-9863-4e09-b8ce-975ac10eae3e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:05.749881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2952b5-9863-4e09-b8ce-975ac10eae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:05.750177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2952b5-9863-4e09-b8ce-975ac10eae3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:05.752939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2952b5-9863-4e09-b8ce-975ac10eae3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:05.753393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2952b5-9863-4e09-b8ce-975ac10eae3e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:05.791491 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 973/1962] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:05 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:05.792697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68fc6e-2d05-47fa-9a37-5defc06c8e07 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:05.808116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68fc6e-2d05-47fa-9a37-5defc06c8e07 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:05.954299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:05.959532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2952b5-9863-4e09-b8ce-975ac10eae3e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:05.961479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8f2952b5-9863-4e09-b8ce-975ac10eae3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:05.988542 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503a75a-4ffe-4359-9714-f6e79d9df4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:05.989278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a75a-4ffe-4359-9714-f6e79d9df4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:05.989624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a75a-4ffe-4359-9714-f6e79d9df4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:05.989969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a75a-4ffe-4359-9714-f6e79d9df4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:05.990682 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503a75a-4ffe-4359-9714-f6e79d9df4c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:05.994627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503a75a-4ffe-4359-9714-f6e79d9df4c1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:06.049136 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 990/1963] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:05 2022] POST /identity/v3/users => generated 296 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:06.050544 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503a75a-4ffe-4359-9714-f6e79d9df4c1 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:06.068797 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503a75a-4ffe-4359-9714-f6e79d9df4c1 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:06.082506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94c37a-81f8-4136-9e1d-80d375f9862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:06.083593 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94c37a-81f8-4136-9e1d-80d375f9862a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:06.084022 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94c37a-81f8-4136-9e1d-80d375f9862a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:06.084473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94c37a-81f8-4136-9e1d-80d375f9862a admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:06.085294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94c37a-81f8-4136-9e1d-80d375f9862a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:06.087146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94c37a-81f8-4136-9e1d-80d375f9862a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:06.115681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 991/1964] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:06.116861 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94c37a-81f8-4136-9e1d-80d375f9862a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:06.126868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2952b5-9863-4e09-b8ce-975ac10eae3e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:06.145750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94c37a-81f8-4136-9e1d-80d375f9862a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:06.158684 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ffd7b-413c-4bad-964c-c0bea1df636d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:06.160013 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ffd7b-413c-4bad-964c-c0bea1df636d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:06.160617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ffd7b-413c-4bad-964c-c0bea1df636d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:06.160899 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ffd7b-413c-4bad-964c-c0bea1df636d admin admin] PATH_INFO: `/v3/projects/127fd21cb61d4acc98080909f0589491` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:06.161985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892cb98-a330-428d-ad5e-9785af2149f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:06.165311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892cb98-a330-428d-ad5e-9785af2149f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:06.165730 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892cb98-a330-428d-ad5e-9785af2149f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:06.165827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892cb98-a330-428d-ad5e-9785af2149f0 admin admin] PATH_INFO: `/v3/projects/f9e16aaebfc04fb88179c5b9f2c0e475/users/559378c95266494eaff2f4067abd7609/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:06.166392 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ffd7b-413c-4bad-964c-c0bea1df636d admin admin] RBAC: Authorizing `identity:delete_project(project_id=127fd21cb61d4acc98080909f0589491)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:06.176291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ffd7b-413c-4bad-964c-c0bea1df636d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:06.213867 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892cb98-a330-428d-ad5e-9785af2149f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e16aaebfc04fb88179c5b9f2c0e475, user_id=559378c95266494eaff2f4067abd7609, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:06.218666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892cb98-a330-428d-ad5e-9785af2149f0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:06.254933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:06.257982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 992/1965] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:06 2022] PUT /identity/v3/projects/f9e16aaebfc04fb88179c5b9f2c0e475/users/559378c95266494eaff2f4067abd7609/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:06.259060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892cb98-a330-428d-ad5e-9785af2149f0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:06.286416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-372ffd7b-413c-4bad-964c-c0bea1df636d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127fd21cb61d4acc98080909f0589491', 'request_id': 'req-372ffd7b-413c-4bad-964c-c0bea1df636d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:06.302065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-372ffd7b-413c-4bad-964c-c0bea1df636d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127fd21cb61d4acc98080909f0589491', 'request_id': 'req-372ffd7b-413c-4bad-964c-c0bea1df636d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:06.314756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-372ffd7b-413c-4bad-964c-c0bea1df636d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127fd21cb61d4acc98080909f0589491', 'request_id': 'req-372ffd7b-413c-4bad-964c-c0bea1df636d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:06.353677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-372ffd7b-413c-4bad-964c-c0bea1df636d admin admin] The token cache is being invalidate because project 127fd21cb61d4acc98080909f0589491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:06.355029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-372ffd7b-413c-4bad-964c-c0bea1df636d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:06.356251 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-372ffd7b-413c-4bad-964c-c0bea1df636d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:06.363635 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 974/1966] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:05 2022] DELETE /identity/v3/projects/127fd21cb61d4acc98080909f0589491 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:06.364775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ffd7b-413c-4bad-964c-c0bea1df636d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:06.368946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-372ffd7b-413c-4bad-964c-c0bea1df636d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:06.435786 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892cb98-a330-428d-ad5e-9785af2149f0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:06.487041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ffd7b-413c-4bad-964c-c0bea1df636d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:06.499246 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdc4b0-bcf5-4e22-834e-111e08f1072b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:06.499660 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdc4b0-bcf5-4e22-834e-111e08f1072b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:06.499936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdc4b0-bcf5-4e22-834e-111e08f1072b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:06.500213 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdc4b0-bcf5-4e22-834e-111e08f1072b admin admin] PATH_INFO: `/v3/users/a6ac20955fc04366b3f25e42b680dcc2` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:06.506799 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdc4b0-bcf5-4e22-834e-111e08f1072b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ac20955fc04366b3f25e42b680dcc2)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:06.511650 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdc4b0-bcf5-4e22-834e-111e08f1072b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:06.610949 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155f02e-32c0-4a4e-8e79-16cae8fdf3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:06.612332 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155f02e-32c0-4a4e-8e79-16cae8fdf3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:06.613620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155f02e-32c0-4a4e-8e79-16cae8fdf3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:06.614448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-23fdc4b0-bcf5-4e22-834e-111e08f1072b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ac20955fc04366b3f25e42b680dcc2'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:06.614592 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155f02e-32c0-4a4e-8e79-16cae8fdf3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:06.618455 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155f02e-32c0-4a4e-8e79-16cae8fdf3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:06.619650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155f02e-32c0-4a4e-8e79-16cae8fdf3a8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:06.640900 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-23fdc4b0-bcf5-4e22-834e-111e08f1072b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ac20955fc04366b3f25e42b680dcc2'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:06.662325 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 993/1967] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:06.671238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155f02e-32c0-4a4e-8e79-16cae8fdf3a8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:06.671959 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-23fdc4b0-bcf5-4e22-834e-111e08f1072b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ac20955fc04366b3f25e42b680dcc2'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:06.675294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b155f02e-32c0-4a4e-8e79-16cae8fdf3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:06.691268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-23fdc4b0-bcf5-4e22-834e-111e08f1072b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ac20955fc04366b3f25e42b680dcc2'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:06.692981 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-23fdc4b0-bcf5-4e22-834e-111e08f1072b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ac20955fc04366b3f25e42b680dcc2'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:06.704181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155f02e-32c0-4a4e-8e79-16cae8fdf3a8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:06.708807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 975/1968] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:06 2022] DELETE /identity/v3/users/a6ac20955fc04366b3f25e42b680dcc2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:06.769955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:06.784645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e562d-c49e-4110-a1cf-a0e9cb6237a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:06.785309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e562d-c49e-4110-a1cf-a0e9cb6237a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:06.785588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e562d-c49e-4110-a1cf-a0e9cb6237a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:06.785861 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e562d-c49e-4110-a1cf-a0e9cb6237a6 admin admin] PATH_INFO: `/v3/projects/f9e16aaebfc04fb88179c5b9f2c0e475/users/559378c95266494eaff2f4067abd7609/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:06.787750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e562d-c49e-4110-a1cf-a0e9cb6237a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e16aaebfc04fb88179c5b9f2c0e475, user_id=559378c95266494eaff2f4067abd7609, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:06.790477 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e562d-c49e-4110-a1cf-a0e9cb6237a6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:06.801816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 994/1969] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:06 2022] PUT /identity/v3/projects/f9e16aaebfc04fb88179c5b9f2c0e475/users/559378c95266494eaff2f4067abd7609/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:06.813525 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869b098-7b5f-4f8a-84f8-47375d66397e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:06.813942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869b098-7b5f-4f8a-84f8-47375d66397e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:06.814333 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869b098-7b5f-4f8a-84f8-47375d66397e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:06.846212 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c869b098-7b5f-4f8a-84f8-47375d66397e None None] MFA Rules not processed for user `559378c95266494eaff2f4067abd7609`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:06.847520 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c869b098-7b5f-4f8a-84f8-47375d66397e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:06.864768 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:06.928539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 976/1970] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:06.940403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e562d-c49e-4110-a1cf-a0e9cb6237a6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:06.942072 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b85e562d-c49e-4110-a1cf-a0e9cb6237a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:07.010526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e562d-c49e-4110-a1cf-a0e9cb6237a6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:07.015536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a764370-2d61-4f4c-8331-8a7df9af53b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:07.016506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a764370-2d61-4f4c-8331-8a7df9af53b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:07.016963 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a764370-2d61-4f4c-8331-8a7df9af53b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:07.017340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a764370-2d61-4f4c-8331-8a7df9af53b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:07.030171 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869b098-7b5f-4f8a-84f8-47375d66397e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:07.032098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c869b098-7b5f-4f8a-84f8-47375d66397e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:07.048246 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a764370-2d61-4f4c-8331-8a7df9af53b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:07.049399 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a764370-2d61-4f4c-8331-8a7df9af53b9 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:07.062324 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 995/1971] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:07.119656 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a764370-2d61-4f4c-8331-8a7df9af53b9 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:07.121663 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9a764370-2d61-4f4c-8331-8a7df9af53b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:07.132069 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869b098-7b5f-4f8a-84f8-47375d66397e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:07.134332 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a764370-2d61-4f4c-8331-8a7df9af53b9 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:07.138636 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44febc09-7007-4720-84a4-dcc4d70d981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:07.138943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a73c3-8aae-45e6-914f-bbc0292fa9f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:07.139694 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a73c3-8aae-45e6-914f-bbc0292fa9f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:07.139828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44febc09-7007-4720-84a4-dcc4d70d981e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:07.139908 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a73c3-8aae-45e6-914f-bbc0292fa9f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:07.139979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44febc09-7007-4720-84a4-dcc4d70d981e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:07.140126 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a73c3-8aae-45e6-914f-bbc0292fa9f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:07.140356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44febc09-7007-4720-84a4-dcc4d70d981e admin admin] PATH_INFO: `/v3/projects/1f55948940e04ab285bf499a3328a8d0` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:07.141721 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44febc09-7007-4720-84a4-dcc4d70d981e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f55948940e04ab285bf499a3328a8d0)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:07.142339 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-897a73c3-8aae-45e6-914f-bbc0292fa9f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:07.144291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44febc09-7007-4720-84a4-dcc4d70d981e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:07.201688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-44febc09-7007-4720-84a4-dcc4d70d981e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f55948940e04ab285bf499a3328a8d0', 'request_id': 'req-44febc09-7007-4720-84a4-dcc4d70d981e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:07.210637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-44febc09-7007-4720-84a4-dcc4d70d981e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f55948940e04ab285bf499a3328a8d0', 'request_id': 'req-44febc09-7007-4720-84a4-dcc4d70d981e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:07.213318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a73c3-8aae-45e6-914f-bbc0292fa9f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:07.214945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a73c3-8aae-45e6-914f-bbc0292fa9f7 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:07.219132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-44febc09-7007-4720-84a4-dcc4d70d981e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f55948940e04ab285bf499a3328a8d0', 'request_id': 'req-44febc09-7007-4720-84a4-dcc4d70d981e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:07.226370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 996/1972] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:07.233052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-44febc09-7007-4720-84a4-dcc4d70d981e admin admin] The token cache is being invalidate because project 1f55948940e04ab285bf499a3328a8d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:07.233423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-44febc09-7007-4720-84a4-dcc4d70d981e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:07.234111 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-44febc09-7007-4720-84a4-dcc4d70d981e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:07.235659 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 977/1973] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:07 2022] DELETE /identity/v3/projects/1f55948940e04ab285bf499a3328a8d0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:07.240915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb3aa5-5851-4886-91b7-079730d98aec None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:07.242081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb3aa5-5851-4886-91b7-079730d98aec None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:07.242081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb3aa5-5851-4886-91b7-079730d98aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:07.276071 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-02eb3aa5-5851-4886-91b7-079730d98aec None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:07.277624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-02eb3aa5-5851-4886-91b7-079730d98aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:07.350925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 997/1974] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:07.358935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2289aac-3150-4a61-bf3c-d44c52f742f0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:07.359501 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2289aac-3150-4a61-bf3c-d44c52f742f0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:07.359501 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2289aac-3150-4a61-bf3c-d44c52f742f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:07.388228 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b2289aac-3150-4a61-bf3c-d44c52f742f0 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:07.389472 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b2289aac-3150-4a61-bf3c-d44c52f742f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:07.400026 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 978/1975] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:07.404001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb3aa5-5851-4886-91b7-079730d98aec None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:07.415139 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb3aa5-5851-4886-91b7-079730d98aec None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:07.420480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13041871-769a-425f-947d-6d08a4dec67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:07.421189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13041871-769a-425f-947d-6d08a4dec67a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:07.421464 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13041871-769a-425f-947d-6d08a4dec67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:07.421731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13041871-769a-425f-947d-6d08a4dec67a admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:07.422378 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13041871-769a-425f-947d-6d08a4dec67a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:07.422675 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13041871-769a-425f-947d-6d08a4dec67a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:07.424260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13041871-769a-425f-947d-6d08a4dec67a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:07.437892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 998/1976] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:26:07.442168 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2289aac-3150-4a61-bf3c-d44c52f742f0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:07.451519 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2289aac-3150-4a61-bf3c-d44c52f742f0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:07.457512 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5285a-c86e-42cd-94e2-d0bd6afafd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:07.458646 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5285a-c86e-42cd-94e2-d0bd6afafd11 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:07.458646 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5285a-c86e-42cd-94e2-d0bd6afafd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:07.458851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5285a-c86e-42cd-94e2-d0bd6afafd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:07.459412 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5285a-c86e-42cd-94e2-d0bd6afafd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:07.461355 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5285a-c86e-42cd-94e2-d0bd6afafd11 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:07.516065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 979/1977] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:07 2022] POST /identity/v3/projects => generated 397 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:07.519758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13041871-769a-425f-947d-6d08a4dec67a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:07.531393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13041871-769a-425f-947d-6d08a4dec67a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:07.537616 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:07.596064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f35bf-ab82-4717-acda-0c1d021e0521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:07.596868 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f35bf-ab82-4717-acda-0c1d021e0521 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:07.597208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f35bf-ab82-4717-acda-0c1d021e0521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:07.597552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f35bf-ab82-4717-acda-0c1d021e0521 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:07.598252 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f35bf-ab82-4717-acda-0c1d021e0521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:07.600307 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f35bf-ab82-4717-acda-0c1d021e0521 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:07.633220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 999/1978] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:07 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:07.634425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5285a-c86e-42cd-94e2-d0bd6afafd11 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:07.664130 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5285a-c86e-42cd-94e2-d0bd6afafd11 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:07.688347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e4f47-0431-4b93-acda-5785354dc2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:07.691638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e4f47-0431-4b93-acda-5785354dc2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:07.693716 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e4f47-0431-4b93-acda-5785354dc2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:07.695763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e4f47-0431-4b93-acda-5785354dc2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:07.696627 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e4f47-0431-4b93-acda-5785354dc2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:07.723853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e4f47-0431-4b93-acda-5785354dc2f0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:07.769696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 980/1979] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:07.771743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f35bf-ab82-4717-acda-0c1d021e0521 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:07.790171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f35bf-ab82-4717-acda-0c1d021e0521 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:07.806718 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09ebcf-6ac6-49c6-9088-64671a4d187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:07.808002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09ebcf-6ac6-49c6-9088-64671a4d187c admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:07.808002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09ebcf-6ac6-49c6-9088-64671a4d187c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:07.808002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09ebcf-6ac6-49c6-9088-64671a4d187c admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:07.808519 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09ebcf-6ac6-49c6-9088-64671a4d187c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:07.810326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09ebcf-6ac6-49c6-9088-64671a4d187c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:07.835478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1000/1980] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:07.838497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e4f47-0431-4b93-acda-5785354dc2f0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:07.848451 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:07.853058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e4f47-0431-4b93-acda-5785354dc2f0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:07.865280 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd49750-133e-45d4-8108-0b98886b40c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:07.867112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd49750-133e-45d4-8108-0b98886b40c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:07.867542 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd49750-133e-45d4-8108-0b98886b40c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:07.868731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd49750-133e-45d4-8108-0b98886b40c3 admin admin] PATH_INFO: `/v3/projects/12c109bde0cc473b8efc24309dda01ce/users/aff43b267a694a3fb4ad3b2e4a6495e4/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:07.895704 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd49750-133e-45d4-8108-0b98886b40c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c109bde0cc473b8efc24309dda01ce, user_id=aff43b267a694a3fb4ad3b2e4a6495e4, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:07.900375 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd49750-133e-45d4-8108-0b98886b40c3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:07.938677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 981/1981] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:07 2022] PUT /identity/v3/projects/12c109bde0cc473b8efc24309dda01ce/users/aff43b267a694a3fb4ad3b2e4a6495e4/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:07.949342 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfb58f-b217-4979-9eb9-33b62cf065f9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:07.949636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfb58f-b217-4979-9eb9-33b62cf065f9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:07.949897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfb58f-b217-4979-9eb9-33b62cf065f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:08.017270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2fdfb58f-b217-4979-9eb9-33b62cf065f9 None None] MFA Rules not processed for user `aff43b267a694a3fb4ad3b2e4a6495e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:08.018949 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2fdfb58f-b217-4979-9eb9-33b62cf065f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:08.167387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1001/1982] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:08.173267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd49750-133e-45d4-8108-0b98886b40c3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:08.266112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd49750-133e-45d4-8108-0b98886b40c3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:08.272745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea39239-f12a-4ef4-8c7c-ccbbf1dde1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:08.273395 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea39239-f12a-4ef4-8c7c-ccbbf1dde1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:08.273675 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea39239-f12a-4ef4-8c7c-ccbbf1dde1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:08.273946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea39239-f12a-4ef4-8c7c-ccbbf1dde1d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:08.274728 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea39239-f12a-4ef4-8c7c-ccbbf1dde1d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:08.289026 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea39239-f12a-4ef4-8c7c-ccbbf1dde1d2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:08.314221 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 982/1983] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:08 2022] POST /identity/v3/projects => generated 399 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:08.319327 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfb58f-b217-4979-9eb9-33b62cf065f9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:08.333841 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfb58f-b217-4979-9eb9-33b62cf065f9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:08.411883 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c330472-3946-43c6-9571-aabc2686a9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:08.412550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c330472-3946-43c6-9571-aabc2686a9ac admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:08.412928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c330472-3946-43c6-9571-aabc2686a9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:08.413247 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c330472-3946-43c6-9571-aabc2686a9ac admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:08.413937 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c330472-3946-43c6-9571-aabc2686a9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:08.415860 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c330472-3946-43c6-9571-aabc2686a9ac admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:08.443624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1002/1984] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:08 2022] POST /identity/v3/users => generated 306 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:08.447302 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea39239-f12a-4ef4-8c7c-ccbbf1dde1d2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:08.460074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea39239-f12a-4ef4-8c7c-ccbbf1dde1d2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:08.466540 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f7c4f-6253-46a7-8482-e3c6562d836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:08.467229 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f7c4f-6253-46a7-8482-e3c6562d836e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:08.467662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f7c4f-6253-46a7-8482-e3c6562d836e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:08.468095 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f7c4f-6253-46a7-8482-e3c6562d836e admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:08.468859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f7c4f-6253-46a7-8482-e3c6562d836e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:08.470544 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f7c4f-6253-46a7-8482-e3c6562d836e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:08.482892 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 983/1985] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:08.487094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c330472-3946-43c6-9571-aabc2686a9ac admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:08.501113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c330472-3946-43c6-9571-aabc2686a9ac admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:08.507666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480db360-9291-47ec-a414-59a4fa68ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:08.508445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480db360-9291-47ec-a414-59a4fa68ee6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:08.508788 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480db360-9291-47ec-a414-59a4fa68ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:08.509027 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480db360-9291-47ec-a414-59a4fa68ee6e admin admin] PATH_INFO: `/v3/projects/38dcfbab09584de1aa96a25cd1cf5815/users/5d2fb8ad83be4686aee2085e73d787e0/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:08.511864 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:08.549736 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480db360-9291-47ec-a414-59a4fa68ee6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=38dcfbab09584de1aa96a25cd1cf5815, user_id=5d2fb8ad83be4686aee2085e73d787e0, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:08.555263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480db360-9291-47ec-a414-59a4fa68ee6e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:08.576065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1003/1986] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:08 2022] PUT /identity/v3/projects/38dcfbab09584de1aa96a25cd1cf5815/users/5d2fb8ad83be4686aee2085e73d787e0/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:08.580728 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f7c4f-6253-46a7-8482-e3c6562d836e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:08.592072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f7c4f-6253-46a7-8482-e3c6562d836e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:08.658394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba695e-a31c-484b-8d80-6932b5038bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:08.659007 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba695e-a31c-484b-8d80-6932b5038bae admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:08.659330 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba695e-a31c-484b-8d80-6932b5038bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:08.659597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba695e-a31c-484b-8d80-6932b5038bae admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:08.660282 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba695e-a31c-484b-8d80-6932b5038bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:08.662023 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba695e-a31c-484b-8d80-6932b5038bae admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:08.672791 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 984/1987] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:08.676558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480db360-9291-47ec-a414-59a4fa68ee6e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:08.686810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480db360-9291-47ec-a414-59a4fa68ee6e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:08.691391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803be7fb-76b5-498f-b9e1-1f4fac47c338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:08.692075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803be7fb-76b5-498f-b9e1-1f4fac47c338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:08.692362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803be7fb-76b5-498f-b9e1-1f4fac47c338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:08.692670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803be7fb-76b5-498f-b9e1-1f4fac47c338 admin admin] PATH_INFO: `/v3/projects/38dcfbab09584de1aa96a25cd1cf5815/users/5d2fb8ad83be4686aee2085e73d787e0/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:08.694569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803be7fb-76b5-498f-b9e1-1f4fac47c338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38dcfbab09584de1aa96a25cd1cf5815, user_id=5d2fb8ad83be4686aee2085e73d787e0, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:08.697263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803be7fb-76b5-498f-b9e1-1f4fac47c338 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:08.707743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1004/1988] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:08 2022] PUT /identity/v3/projects/38dcfbab09584de1aa96a25cd1cf5815/users/5d2fb8ad83be4686aee2085e73d787e0/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:08.719465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594845a-87a2-4cb7-9cb7-ab7360fc5b0b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:08.720155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594845a-87a2-4cb7-9cb7-ab7360fc5b0b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:08.720155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594845a-87a2-4cb7-9cb7-ab7360fc5b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:08.750946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4594845a-87a2-4cb7-9cb7-ab7360fc5b0b None None] MFA Rules not processed for user `5d2fb8ad83be4686aee2085e73d787e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:08.752412 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4594845a-87a2-4cb7-9cb7-ab7360fc5b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:08.803016 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:08.848703 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 985/1989] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:08 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:08.868499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803be7fb-76b5-498f-b9e1-1f4fac47c338 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:08.872941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-803be7fb-76b5-498f-b9e1-1f4fac47c338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:08.975775 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803be7fb-76b5-498f-b9e1-1f4fac47c338 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:08.981319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01ed9b-c3f3-4058-b85c-5c9e871b0141 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:08.982230 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01ed9b-c3f3-4058-b85c-5c9e871b0141 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:08.982580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01ed9b-c3f3-4058-b85c-5c9e871b0141 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:08.982919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01ed9b-c3f3-4058-b85c-5c9e871b0141 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:09.009254 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01ed9b-c3f3-4058-b85c-5c9e871b0141 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:09.012024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01ed9b-c3f3-4058-b85c-5c9e871b0141 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:09.041113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1005/1990] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:08 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:09.148139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594845a-87a2-4cb7-9cb7-ab7360fc5b0b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:09.162387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594845a-87a2-4cb7-9cb7-ab7360fc5b0b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:09.166072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070abae0-e1e8-4e85-9bc8-71ade0f3b358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:09.166692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070abae0-e1e8-4e85-9bc8-71ade0f3b358 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:09.166970 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070abae0-e1e8-4e85-9bc8-71ade0f3b358 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:09.167241 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070abae0-e1e8-4e85-9bc8-71ade0f3b358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:09.215773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01ed9b-c3f3-4058-b85c-5c9e871b0141 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:09.217212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2b01ed9b-c3f3-4058-b85c-5c9e871b0141 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:09.238412 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070abae0-e1e8-4e85-9bc8-71ade0f3b358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:09.240983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070abae0-e1e8-4e85-9bc8-71ade0f3b358 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:09.260977 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 986/1991] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:09 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:09.306359 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01ed9b-c3f3-4058-b85c-5c9e871b0141 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:09.316439 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d46b65-c9a8-4d01-828f-0d8fc71a26ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:09.316439 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d46b65-c9a8-4d01-828f-0d8fc71a26ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:09.316732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d46b65-c9a8-4d01-828f-0d8fc71a26ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:09.317131 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d46b65-c9a8-4d01-828f-0d8fc71a26ed admin admin] PATH_INFO: `/v3/users/53657f906452428a91e121f7f8da7902` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:09.318654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d46b65-c9a8-4d01-828f-0d8fc71a26ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=53657f906452428a91e121f7f8da7902)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:09.322397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d46b65-c9a8-4d01-828f-0d8fc71a26ed admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:09.423583 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-30d46b65-c9a8-4d01-828f-0d8fc71a26ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53657f906452428a91e121f7f8da7902'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:09.454535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-30d46b65-c9a8-4d01-828f-0d8fc71a26ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53657f906452428a91e121f7f8da7902'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:09.481176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-30d46b65-c9a8-4d01-828f-0d8fc71a26ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53657f906452428a91e121f7f8da7902'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:09.484889 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:09.504863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-30d46b65-c9a8-4d01-828f-0d8fc71a26ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53657f906452428a91e121f7f8da7902'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:09.504863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-30d46b65-c9a8-4d01-828f-0d8fc71a26ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53657f906452428a91e121f7f8da7902'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:09.510696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1006/1992] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:09 2022] DELETE /identity/v3/users/53657f906452428a91e121f7f8da7902 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:09.515633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7341a-b0c6-486b-afd3-d46c6d5e69a3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:09.516129 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7341a-b0c6-486b-afd3-d46c6d5e69a3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:09.516619 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7341a-b0c6-486b-afd3-d46c6d5e69a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:09.545553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-06b7341a-b0c6-486b-afd3-d46c6d5e69a3 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:09.546825 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-06b7341a-b0c6-486b-afd3-d46c6d5e69a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:09.626006 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 987/1993] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:09.638739 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d46b65-c9a8-4d01-828f-0d8fc71a26ed admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:09.641016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-30d46b65-c9a8-4d01-828f-0d8fc71a26ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:09.780830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d46b65-c9a8-4d01-828f-0d8fc71a26ed admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:09.786821 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000034e5-c086-4290-8823-d5938b25d5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:09.787529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000034e5-c086-4290-8823-d5938b25d5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:09.787909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000034e5-c086-4290-8823-d5938b25d5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:09.788270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000034e5-c086-4290-8823-d5938b25d5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:09.798320 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000034e5-c086-4290-8823-d5938b25d5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:09.799892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000034e5-c086-4290-8823-d5938b25d5a6 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:09.816774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1007/1994] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:10.110079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7341a-b0c6-486b-afd3-d46c6d5e69a3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:10.112021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-06b7341a-b0c6-486b-afd3-d46c6d5e69a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:10.124427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7341a-b0c6-486b-afd3-d46c6d5e69a3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:10.129452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da704b9e-f7e1-4b23-ac11-203624ff6663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:10.130102 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704b9e-f7e1-4b23-ac11-203624ff6663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:10.130466 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704b9e-f7e1-4b23-ac11-203624ff6663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:10.130698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704b9e-f7e1-4b23-ac11-203624ff6663 admin admin] PATH_INFO: `/v3/projects/978bc74cf34647fb8c3016bf2386f057` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:10.131837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da704b9e-f7e1-4b23-ac11-203624ff6663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978bc74cf34647fb8c3016bf2386f057)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:10.133842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da704b9e-f7e1-4b23-ac11-203624ff6663 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:10.191301 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-da704b9e-f7e1-4b23-ac11-203624ff6663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978bc74cf34647fb8c3016bf2386f057', 'request_id': 'req-da704b9e-f7e1-4b23-ac11-203624ff6663'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:10.200257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-da704b9e-f7e1-4b23-ac11-203624ff6663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978bc74cf34647fb8c3016bf2386f057', 'request_id': 'req-da704b9e-f7e1-4b23-ac11-203624ff6663'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:10.208363 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-da704b9e-f7e1-4b23-ac11-203624ff6663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978bc74cf34647fb8c3016bf2386f057', 'request_id': 'req-da704b9e-f7e1-4b23-ac11-203624ff6663'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:10.217050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:10.222970 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-da704b9e-f7e1-4b23-ac11-203624ff6663 admin admin] The token cache is being invalidate because project 978bc74cf34647fb8c3016bf2386f057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:10.224014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-da704b9e-f7e1-4b23-ac11-203624ff6663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:10.225662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-da704b9e-f7e1-4b23-ac11-203624ff6663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:10.226989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 988/1995] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:10 2022] DELETE /identity/v3/projects/978bc74cf34647fb8c3016bf2386f057 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:10.233316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000034e5-c086-4290-8823-d5938b25d5a6 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:10.243676 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000034e5-c086-4290-8823-d5938b25d5a6 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:10.303216 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2989d3-af38-48e9-99a1-e1cc71b590be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:10.303853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2989d3-af38-48e9-99a1-e1cc71b590be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:10.304128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2989d3-af38-48e9-99a1-e1cc71b590be admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:10.304417 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2989d3-af38-48e9-99a1-e1cc71b590be admin admin] PATH_INFO: `/v3/users/69a2bf01ff494e3ebd41a023cd360d3d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:10.305577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2989d3-af38-48e9-99a1-e1cc71b590be admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a2bf01ff494e3ebd41a023cd360d3d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:10.307487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2989d3-af38-48e9-99a1-e1cc71b590be admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:10.354025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3c2989d3-af38-48e9-99a1-e1cc71b590be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a2bf01ff494e3ebd41a023cd360d3d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:10.367541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3c2989d3-af38-48e9-99a1-e1cc71b590be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a2bf01ff494e3ebd41a023cd360d3d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:10.374842 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3c2989d3-af38-48e9-99a1-e1cc71b590be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a2bf01ff494e3ebd41a023cd360d3d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:10.382152 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3c2989d3-af38-48e9-99a1-e1cc71b590be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a2bf01ff494e3ebd41a023cd360d3d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:10.383276 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3c2989d3-af38-48e9-99a1-e1cc71b590be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a2bf01ff494e3ebd41a023cd360d3d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:10.389396 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1008/1996] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:10 2022] DELETE /identity/v3/users/69a2bf01ff494e3ebd41a023cd360d3d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:10.515183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da704b9e-f7e1-4b23-ac11-203624ff6663 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:10.517698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-da704b9e-f7e1-4b23-ac11-203624ff6663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:10.536855 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da704b9e-f7e1-4b23-ac11-203624ff6663 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:10.620302 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1c636-8c12-4750-bbed-07e8e07e7470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:10.621594 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1c636-8c12-4750-bbed-07e8e07e7470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:10.622722 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1c636-8c12-4750-bbed-07e8e07e7470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:10.623116 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1c636-8c12-4750-bbed-07e8e07e7470 admin admin] PATH_INFO: `/v3/users/8b41b02287714024a6a757ee92a9bbf1` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:10.626683 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1c636-8c12-4750-bbed-07e8e07e7470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b41b02287714024a6a757ee92a9bbf1)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:10.629464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1c636-8c12-4750-bbed-07e8e07e7470 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:10.697964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f6f1c636-8c12-4750-bbed-07e8e07e7470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b41b02287714024a6a757ee92a9bbf1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:10.707812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f6f1c636-8c12-4750-bbed-07e8e07e7470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b41b02287714024a6a757ee92a9bbf1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:10.732368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f6f1c636-8c12-4750-bbed-07e8e07e7470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b41b02287714024a6a757ee92a9bbf1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:10.745468 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f6f1c636-8c12-4750-bbed-07e8e07e7470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b41b02287714024a6a757ee92a9bbf1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:10.746308 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f6f1c636-8c12-4750-bbed-07e8e07e7470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b41b02287714024a6a757ee92a9bbf1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:10.757657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 989/1997] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:10 2022] DELETE /identity/v3/users/8b41b02287714024a6a757ee92a9bbf1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:10.762333 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb9a92-1e09-42d0-b345-cdcfb8672aac None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:10.763657 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb9a92-1e09-42d0-b345-cdcfb8672aac None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:10.763951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb9a92-1e09-42d0-b345-cdcfb8672aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:10.787560 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-76bb9a92-1e09-42d0-b345-cdcfb8672aac None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:10.788915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-76bb9a92-1e09-42d0-b345-cdcfb8672aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:10.812332 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:10.925909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1009/1998] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:10.963112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1c636-8c12-4750-bbed-07e8e07e7470 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:10.966664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f6f1c636-8c12-4750-bbed-07e8e07e7470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:11.127262 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1c636-8c12-4750-bbed-07e8e07e7470 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:11.133549 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfe140-13f0-40f3-9f6b-11721ef9aa9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:11.134046 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfe140-13f0-40f3-9f6b-11721ef9aa9f service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:11.134547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfe140-13f0-40f3-9f6b-11721ef9aa9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:11.134823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfe140-13f0-40f3-9f6b-11721ef9aa9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:11.149743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb9a92-1e09-42d0-b345-cdcfb8672aac None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:11.151438 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-76bb9a92-1e09-42d0-b345-cdcfb8672aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:11.160227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfe140-13f0-40f3-9f6b-11721ef9aa9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:11.162414 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfe140-13f0-40f3-9f6b-11721ef9aa9f service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:11.174913 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 990/1999] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:11.176915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb9a92-1e09-42d0-b345-cdcfb8672aac None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:11.183347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20abfe-b02d-485e-ae27-fe9439154367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:11.184124 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20abfe-b02d-485e-ae27-fe9439154367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:11.184416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20abfe-b02d-485e-ae27-fe9439154367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:11.185295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20abfe-b02d-485e-ae27-fe9439154367 admin admin] PATH_INFO: `/v3/projects/88d72f929d5546df912129e60dd9d613` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:11.186517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20abfe-b02d-485e-ae27-fe9439154367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88d72f929d5546df912129e60dd9d613)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:11.188573 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20abfe-b02d-485e-ae27-fe9439154367 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:11.255666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ae20abfe-b02d-485e-ae27-fe9439154367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d72f929d5546df912129e60dd9d613', 'request_id': 'req-ae20abfe-b02d-485e-ae27-fe9439154367'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:11.264626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ae20abfe-b02d-485e-ae27-fe9439154367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d72f929d5546df912129e60dd9d613', 'request_id': 'req-ae20abfe-b02d-485e-ae27-fe9439154367'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:11.275471 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ae20abfe-b02d-485e-ae27-fe9439154367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d72f929d5546df912129e60dd9d613', 'request_id': 'req-ae20abfe-b02d-485e-ae27-fe9439154367'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:11.291809 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ae20abfe-b02d-485e-ae27-fe9439154367 admin admin] The token cache is being invalidate because project 88d72f929d5546df912129e60dd9d613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:11.292275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ae20abfe-b02d-485e-ae27-fe9439154367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:11.293664 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ae20abfe-b02d-485e-ae27-fe9439154367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:11.302222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1010/2000] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:11 2022] DELETE /identity/v3/projects/88d72f929d5546df912129e60dd9d613 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:11.302378 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586fc89-fdc0-4485-9e33-5de2d178d8b1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:11.302521 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586fc89-fdc0-4485-9e33-5de2d178d8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:11.302852 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586fc89-fdc0-4485-9e33-5de2d178d8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:11.339777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d586fc89-fdc0-4485-9e33-5de2d178d8b1 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:11.341671 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d586fc89-fdc0-4485-9e33-5de2d178d8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:11.361703 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:11.430330 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 991/2001] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:11.432441 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb83ca3-898d-412d-8b57-23fee05f506b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:11.432832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb83ca3-898d-412d-8b57-23fee05f506b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:11.433180 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb83ca3-898d-412d-8b57-23fee05f506b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:11.458678 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ddb83ca3-898d-412d-8b57-23fee05f506b None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:11.459931 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ddb83ca3-898d-412d-8b57-23fee05f506b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:11.472547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1011/2002] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:11.473981 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586fc89-fdc0-4485-9e33-5de2d178d8b1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:11.487041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586fc89-fdc0-4485-9e33-5de2d178d8b1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:11.492823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cff88c-d5f2-4a8b-b8d8-5baae157b10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:11.493702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cff88c-d5f2-4a8b-b8d8-5baae157b10d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:11.494056 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cff88c-d5f2-4a8b-b8d8-5baae157b10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:11.494336 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cff88c-d5f2-4a8b-b8d8-5baae157b10d admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:11.495124 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cff88c-d5f2-4a8b-b8d8-5baae157b10d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:11.495498 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cff88c-d5f2-4a8b-b8d8-5baae157b10d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:11.497900 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cff88c-d5f2-4a8b-b8d8-5baae157b10d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:11.511301 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 992/2003] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:26:11.515982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb83ca3-898d-412d-8b57-23fee05f506b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:11.525971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb83ca3-898d-412d-8b57-23fee05f506b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:11.531912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9fd21-56a0-45ef-a060-e2ea00233c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:11.532541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9fd21-56a0-45ef-a060-e2ea00233c5a admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:11.532858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9fd21-56a0-45ef-a060-e2ea00233c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:11.533124 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9fd21-56a0-45ef-a060-e2ea00233c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:11.533788 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9fd21-56a0-45ef-a060-e2ea00233c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:11.535693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9fd21-56a0-45ef-a060-e2ea00233c5a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:11.568064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1012/2004] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:11 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:11.572195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cff88c-d5f2-4a8b-b8d8-5baae157b10d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:11.582402 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cff88c-d5f2-4a8b-b8d8-5baae157b10d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:11.644198 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d39ab-19c0-4fca-862a-c65cc483bf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:11.644973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d39ab-19c0-4fca-862a-c65cc483bf59 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:11.645261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d39ab-19c0-4fca-862a-c65cc483bf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:11.645474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d39ab-19c0-4fca-862a-c65cc483bf59 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:11.646106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d39ab-19c0-4fca-862a-c65cc483bf59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:11.648270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d39ab-19c0-4fca-862a-c65cc483bf59 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:11.675764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 993/2005] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:11 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:11.679481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9fd21-56a0-45ef-a060-e2ea00233c5a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:11.690222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9fd21-56a0-45ef-a060-e2ea00233c5a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:11.695605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40db11-f8f4-474f-bd8e-6dd140e2c779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:11.696326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40db11-f8f4-474f-bd8e-6dd140e2c779 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:11.696730 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40db11-f8f4-474f-bd8e-6dd140e2c779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:11.697099 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40db11-f8f4-474f-bd8e-6dd140e2c779 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:11.697858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40db11-f8f4-474f-bd8e-6dd140e2c779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:11.699649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40db11-f8f4-474f-bd8e-6dd140e2c779 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:11.711928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1013/2006] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:11.727696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d39ab-19c0-4fca-862a-c65cc483bf59 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:11.742435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d39ab-19c0-4fca-862a-c65cc483bf59 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:11.747751 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f59676-0839-4e29-acfe-40b715d96470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:11.748384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f59676-0839-4e29-acfe-40b715d96470 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:11.748870 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f59676-0839-4e29-acfe-40b715d96470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:11.749008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f59676-0839-4e29-acfe-40b715d96470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:11.749648 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f59676-0839-4e29-acfe-40b715d96470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:11.751261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f59676-0839-4e29-acfe-40b715d96470 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:11.763640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 994/2007] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:11.767733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40db11-f8f4-474f-bd8e-6dd140e2c779 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:11.778124 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40db11-f8f4-474f-bd8e-6dd140e2c779 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:11.784606 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c53b75-9bf1-4b72-833d-0cbd3ae73f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:11.785387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c53b75-9bf1-4b72-833d-0cbd3ae73f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:11.785742 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c53b75-9bf1-4b72-833d-0cbd3ae73f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:11.786087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c53b75-9bf1-4b72-833d-0cbd3ae73f88 admin admin] PATH_INFO: `/v3/projects/66878032a9104a75a24f7327bbd1d9c9/users/74ca833f8e1d4274a3f4cd83dfb7b69a/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:11.801322 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c53b75-9bf1-4b72-833d-0cbd3ae73f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66878032a9104a75a24f7327bbd1d9c9, user_id=74ca833f8e1d4274a3f4cd83dfb7b69a, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:11.804083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c53b75-9bf1-4b72-833d-0cbd3ae73f88 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:11.819415 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1014/2008] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:11 2022] PUT /identity/v3/projects/66878032a9104a75a24f7327bbd1d9c9/users/74ca833f8e1d4274a3f4cd83dfb7b69a/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:11.832362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d32482-3a8f-44fc-a89f-e091beab9206 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:11.832713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d32482-3a8f-44fc-a89f-e091beab9206 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:11.832933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d32482-3a8f-44fc-a89f-e091beab9206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:11.873242 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-08d32482-3a8f-44fc-a89f-e091beab9206 None None] MFA Rules not processed for user `74ca833f8e1d4274a3f4cd83dfb7b69a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:11.874566 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-08d32482-3a8f-44fc-a89f-e091beab9206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:11.966586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 995/2009] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:11.971191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c53b75-9bf1-4b72-833d-0cbd3ae73f88 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:12.015347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:12.053564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c53b75-9bf1-4b72-833d-0cbd3ae73f88 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:12.058330 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a2d0e-573a-4870-9ea6-998ce2131d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:12.059043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a2d0e-573a-4870-9ea6-998ce2131d35 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:12.059391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a2d0e-573a-4870-9ea6-998ce2131d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:12.060296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a2d0e-573a-4870-9ea6-998ce2131d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:12.061019 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a2d0e-573a-4870-9ea6-998ce2131d35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:12.063426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a2d0e-573a-4870-9ea6-998ce2131d35 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:12.102281 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1015/2010] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:11 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:12.103860 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d32482-3a8f-44fc-a89f-e091beab9206 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:12.136991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d32482-3a8f-44fc-a89f-e091beab9206 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:12.159958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:12.240703 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ec238-9d93-4821-9857-42d5c3a68373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:12.253808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ec238-9d93-4821-9857-42d5c3a68373 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:12.254104 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ec238-9d93-4821-9857-42d5c3a68373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:12.264725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ec238-9d93-4821-9857-42d5c3a68373 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:12.269392 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ec238-9d93-4821-9857-42d5c3a68373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:12.274298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ec238-9d93-4821-9857-42d5c3a68373 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:12.292350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a2d0e-573a-4870-9ea6-998ce2131d35 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:12.298345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ce9a2d0e-573a-4870-9ea6-998ce2131d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:12.305270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 996/2011] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:12 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:12.310214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ec238-9d93-4821-9857-42d5c3a68373 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:12.330905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ec238-9d93-4821-9857-42d5c3a68373 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:12.339873 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22018bff-051f-4ebf-9131-50c16c30e26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:12.341589 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a2d0e-573a-4870-9ea6-998ce2131d35 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:12.351507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22018bff-051f-4ebf-9131-50c16c30e26e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:12.351980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22018bff-051f-4ebf-9131-50c16c30e26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:12.352395 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22018bff-051f-4ebf-9131-50c16c30e26e admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:12.353289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22018bff-051f-4ebf-9131-50c16c30e26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:12.355853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22018bff-051f-4ebf-9131-50c16c30e26e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:12.364107 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9320a-da37-43fc-ae38-5e575a6d2099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:12.364775 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9320a-da37-43fc-ae38-5e575a6d2099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:12.365060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9320a-da37-43fc-ae38-5e575a6d2099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:12.365345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9320a-da37-43fc-ae38-5e575a6d2099 admin admin] PATH_INFO: `/v3/projects/e67995ba16ae4698961ea3c2faeaf4df` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:12.367357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9320a-da37-43fc-ae38-5e575a6d2099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e67995ba16ae4698961ea3c2faeaf4df)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:12.370861 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9320a-da37-43fc-ae38-5e575a6d2099 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:12.423652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 997/2012] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:12.431443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22018bff-051f-4ebf-9131-50c16c30e26e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:12.450938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22018bff-051f-4ebf-9131-50c16c30e26e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:12.456709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb136cc2-098e-4788-9fb4-9e8af5e09f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:12.457327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb136cc2-098e-4788-9fb4-9e8af5e09f3e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:12.457621 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb136cc2-098e-4788-9fb4-9e8af5e09f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:12.457890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb136cc2-098e-4788-9fb4-9e8af5e09f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:12.458566 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb136cc2-098e-4788-9fb4-9e8af5e09f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:12.460502 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb136cc2-098e-4788-9fb4-9e8af5e09f3e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:12.472984 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19f9320a-da37-43fc-ae38-5e575a6d2099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e67995ba16ae4698961ea3c2faeaf4df', 'request_id': 'req-19f9320a-da37-43fc-ae38-5e575a6d2099'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:12.478909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19f9320a-da37-43fc-ae38-5e575a6d2099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e67995ba16ae4698961ea3c2faeaf4df', 'request_id': 'req-19f9320a-da37-43fc-ae38-5e575a6d2099'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:12.488666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 998/2013] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:12.489772 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19f9320a-da37-43fc-ae38-5e575a6d2099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e67995ba16ae4698961ea3c2faeaf4df', 'request_id': 'req-19f9320a-da37-43fc-ae38-5e575a6d2099'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:12.492933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb136cc2-098e-4788-9fb4-9e8af5e09f3e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:12.505323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb136cc2-098e-4788-9fb4-9e8af5e09f3e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:12.514643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19f9320a-da37-43fc-ae38-5e575a6d2099 admin admin] The token cache is being invalidate because project e67995ba16ae4698961ea3c2faeaf4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:12.515150 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19f9320a-da37-43fc-ae38-5e575a6d2099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:12.515771 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19f9320a-da37-43fc-ae38-5e575a6d2099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:12.517531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1016/2014] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:12 2022] DELETE /identity/v3/projects/e67995ba16ae4698961ea3c2faeaf4df => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:12.522470 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9320a-da37-43fc-ae38-5e575a6d2099 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:12.524910 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-19f9320a-da37-43fc-ae38-5e575a6d2099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:12.599737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45a988-ea07-4bb4-8b49-1e63d3468d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:12.600431 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a988-ea07-4bb4-8b49-1e63d3468d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:12.600734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a988-ea07-4bb4-8b49-1e63d3468d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:12.601013 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a988-ea07-4bb4-8b49-1e63d3468d9c admin admin] PATH_INFO: `/v3/projects/393aed16522a449da4ffdff4ac93f87c/users/93fda6eb69a8491e89bc2c2f40e38db4/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:12.618120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45a988-ea07-4bb4-8b49-1e63d3468d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=393aed16522a449da4ffdff4ac93f87c, user_id=93fda6eb69a8491e89bc2c2f40e38db4, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:12.620881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45a988-ea07-4bb4-8b49-1e63d3468d9c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:12.640033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9320a-da37-43fc-ae38-5e575a6d2099 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:12.643133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 999/2015] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:12 2022] PUT /identity/v3/projects/393aed16522a449da4ffdff4ac93f87c/users/93fda6eb69a8491e89bc2c2f40e38db4/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:12.654977 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51386ef8-57d3-4e62-806c-0d65273fe7e4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:12.655354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51386ef8-57d3-4e62-806c-0d65273fe7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:12.655532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51386ef8-57d3-4e62-806c-0d65273fe7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:12.697752 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-51386ef8-57d3-4e62-806c-0d65273fe7e4 None None] MFA Rules not processed for user `93fda6eb69a8491e89bc2c2f40e38db4`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:12.699015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-51386ef8-57d3-4e62-806c-0d65273fe7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:12.699996 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:12.736638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3464aa0-155f-4dce-921e-713fcdeb5884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:12.737285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3464aa0-155f-4dce-921e-713fcdeb5884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:12.737562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3464aa0-155f-4dce-921e-713fcdeb5884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:12.737829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3464aa0-155f-4dce-921e-713fcdeb5884 admin admin] PATH_INFO: `/v3/users/09d51bfb29a040efb3b5848d7850797b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:12.739120 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3464aa0-155f-4dce-921e-713fcdeb5884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d51bfb29a040efb3b5848d7850797b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:12.741065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3464aa0-155f-4dce-921e-713fcdeb5884 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:12.797582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:12.812805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1000/2016] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:12.817762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d3464aa0-155f-4dce-921e-713fcdeb5884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d51bfb29a040efb3b5848d7850797b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:12.822850 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51386ef8-57d3-4e62-806c-0d65273fe7e4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:12.824690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-51386ef8-57d3-4e62-806c-0d65273fe7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:12.839871 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d3464aa0-155f-4dce-921e-713fcdeb5884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d51bfb29a040efb3b5848d7850797b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:12.854945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d3464aa0-155f-4dce-921e-713fcdeb5884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d51bfb29a040efb3b5848d7850797b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:12.879422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d3464aa0-155f-4dce-921e-713fcdeb5884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d51bfb29a040efb3b5848d7850797b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:12.880199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d3464aa0-155f-4dce-921e-713fcdeb5884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d51bfb29a040efb3b5848d7850797b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:12.886808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51386ef8-57d3-4e62-806c-0d65273fe7e4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:12.892629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1017/2017] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:12 2022] DELETE /identity/v3/users/09d51bfb29a040efb3b5848d7850797b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:12.898802 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23daa-347d-4c17-b351-60804bb36cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:12.899834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23daa-347d-4c17-b351-60804bb36cce admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:12.900949 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23daa-347d-4c17-b351-60804bb36cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:12.901476 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23daa-347d-4c17-b351-60804bb36cce admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:12.902313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e23daa-347d-4c17-b351-60804bb36cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:12.907540 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e23daa-347d-4c17-b351-60804bb36cce admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:12.966669 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1001/2018] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:12 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:12.967816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3464aa0-155f-4dce-921e-713fcdeb5884 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:12.969649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d3464aa0-155f-4dce-921e-713fcdeb5884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:13.054603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3464aa0-155f-4dce-921e-713fcdeb5884 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:13.116331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848ab99-0a64-4575-b2a6-88471463d281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:13.117010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848ab99-0a64-4575-b2a6-88471463d281 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:13.117380 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848ab99-0a64-4575-b2a6-88471463d281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:13.117618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848ab99-0a64-4575-b2a6-88471463d281 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:13.118217 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848ab99-0a64-4575-b2a6-88471463d281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:13.120193 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848ab99-0a64-4575-b2a6-88471463d281 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:13.144025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1018/2019] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:12 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:13.147953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23daa-347d-4c17-b351-60804bb36cce admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:13.161953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23daa-347d-4c17-b351-60804bb36cce admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:13.167021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017293ef-6386-41eb-8ed7-9084482733a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:13.167631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017293ef-6386-41eb-8ed7-9084482733a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:13.167909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017293ef-6386-41eb-8ed7-9084482733a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:13.168183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017293ef-6386-41eb-8ed7-9084482733a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:13.168923 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017293ef-6386-41eb-8ed7-9084482733a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:13.173378 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017293ef-6386-41eb-8ed7-9084482733a8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:13.191754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848ab99-0a64-4575-b2a6-88471463d281 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:13.191849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1002/2020] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:13.198448 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:13.212832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848ab99-0a64-4575-b2a6-88471463d281 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:13.221402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4ea4e-7a8e-4ca7-9196-c46124a216a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:13.222222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4ea4e-7a8e-4ca7-9196-c46124a216a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:13.222749 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4ea4e-7a8e-4ca7-9196-c46124a216a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:13.222859 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4ea4e-7a8e-4ca7-9196-c46124a216a6 admin admin] PATH_INFO: `/v3/projects/43ba33d6a3454c91a6b57830b91568e6/users/c834ce9d518546fa8b507e6ece0728ff/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:13.251361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4ea4e-7a8e-4ca7-9196-c46124a216a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ba33d6a3454c91a6b57830b91568e6, user_id=c834ce9d518546fa8b507e6ece0728ff, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:13.255393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4ea4e-7a8e-4ca7-9196-c46124a216a6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:13.279520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1019/2021] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:13 2022] PUT /identity/v3/projects/43ba33d6a3454c91a6b57830b91568e6/users/c834ce9d518546fa8b507e6ece0728ff/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:13.283788 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017293ef-6386-41eb-8ed7-9084482733a8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:13.294752 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017293ef-6386-41eb-8ed7-9084482733a8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:13.320403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4ea4e-7a8e-4ca7-9196-c46124a216a6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:13.322573 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d2f4ea4e-7a8e-4ca7-9196-c46124a216a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:13.393101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6150c96-e3f5-4022-a74d-35c2b2cacbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:13.393960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6150c96-e3f5-4022-a74d-35c2b2cacbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:13.394294 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6150c96-e3f5-4022-a74d-35c2b2cacbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:13.394578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6150c96-e3f5-4022-a74d-35c2b2cacbf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:13.395222 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6150c96-e3f5-4022-a74d-35c2b2cacbf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:13.397068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6150c96-e3f5-4022-a74d-35c2b2cacbf6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:13.403485 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4ea4e-7a8e-4ca7-9196-c46124a216a6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:13.407677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1003/2022] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:13.408890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7911ba-7b4f-48bc-b153-028933249f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:13.409534 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7911ba-7b4f-48bc-b153-028933249f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:13.409812 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7911ba-7b4f-48bc-b153-028933249f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:13.410715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7911ba-7b4f-48bc-b153-028933249f0a admin admin] PATH_INFO: `/v3/projects/9a2192fd7b4c49cea1b4f58d01e327e1` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:13.412359 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7911ba-7b4f-48bc-b153-028933249f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a2192fd7b4c49cea1b4f58d01e327e1)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:13.414304 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7911ba-7b4f-48bc-b153-028933249f0a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:13.417487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6150c96-e3f5-4022-a74d-35c2b2cacbf6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:13.429702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6150c96-e3f5-4022-a74d-35c2b2cacbf6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:13.435400 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98483b-dffa-447e-b064-198289e27446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:13.436084 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98483b-dffa-447e-b064-198289e27446 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:13.436450 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98483b-dffa-447e-b064-198289e27446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:13.436784 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98483b-dffa-447e-b064-198289e27446 admin admin] PATH_INFO: `/v3/projects/43ba33d6a3454c91a6b57830b91568e6/users/c834ce9d518546fa8b507e6ece0728ff/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:13.438826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98483b-dffa-447e-b064-198289e27446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ba33d6a3454c91a6b57830b91568e6, user_id=c834ce9d518546fa8b507e6ece0728ff, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:13.441426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98483b-dffa-447e-b064-198289e27446 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:13.454882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1004/2023] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:13 2022] PUT /identity/v3/projects/43ba33d6a3454c91a6b57830b91568e6/users/c834ce9d518546fa8b507e6ece0728ff/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:13.466448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f731d-68ac-49fa-8dc2-309943be6f4b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:13.466739 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f731d-68ac-49fa-8dc2-309943be6f4b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:13.467015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f731d-68ac-49fa-8dc2-309943be6f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:13.469791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7a7911ba-7b4f-48bc-b153-028933249f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a2192fd7b4c49cea1b4f58d01e327e1', 'request_id': 'req-7a7911ba-7b4f-48bc-b153-028933249f0a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:13.479819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7a7911ba-7b4f-48bc-b153-028933249f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a2192fd7b4c49cea1b4f58d01e327e1', 'request_id': 'req-7a7911ba-7b4f-48bc-b153-028933249f0a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:13.489539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7a7911ba-7b4f-48bc-b153-028933249f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a2192fd7b4c49cea1b4f58d01e327e1', 'request_id': 'req-7a7911ba-7b4f-48bc-b153-028933249f0a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:13.502794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d08f731d-68ac-49fa-8dc2-309943be6f4b None None] MFA Rules not processed for user `c834ce9d518546fa8b507e6ece0728ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:13.503563 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7a7911ba-7b4f-48bc-b153-028933249f0a admin admin] The token cache is being invalidate because project 9a2192fd7b4c49cea1b4f58d01e327e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:13.503850 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7a7911ba-7b4f-48bc-b153-028933249f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:13.504241 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d08f731d-68ac-49fa-8dc2-309943be6f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:13.504875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7a7911ba-7b4f-48bc-b153-028933249f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:13.507708 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1020/2024] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:13 2022] DELETE /identity/v3/projects/9a2192fd7b4c49cea1b4f58d01e327e1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:13.511594 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7911ba-7b4f-48bc-b153-028933249f0a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:13.514453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7a7911ba-7b4f-48bc-b153-028933249f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:13.620149 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7911ba-7b4f-48bc-b153-028933249f0a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:13.633384 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaaada-a480-432c-85a5-cf576d46c5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:13.634000 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaaada-a480-432c-85a5-cf576d46c5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:13.634242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaaada-a480-432c-85a5-cf576d46c5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:13.634514 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaaada-a480-432c-85a5-cf576d46c5c3 admin admin] PATH_INFO: `/v3/users/559378c95266494eaff2f4067abd7609` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:13.635732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aaaada-a480-432c-85a5-cf576d46c5c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=559378c95266494eaff2f4067abd7609)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:13.637842 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aaaada-a480-432c-85a5-cf576d46c5c3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:13.642194 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1005/2025] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:13.654989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f731d-68ac-49fa-8dc2-309943be6f4b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:13.657226 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d08f731d-68ac-49fa-8dc2-309943be6f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:13.664106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:13.699713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:13.717790 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-63aaaada-a480-432c-85a5-cf576d46c5c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559378c95266494eaff2f4067abd7609'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:13.728489 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f731d-68ac-49fa-8dc2-309943be6f4b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:13.729850 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-63aaaada-a480-432c-85a5-cf576d46c5c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559378c95266494eaff2f4067abd7609'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:13.732751 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ddefb-8206-4075-ab2f-77c626a39644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:13.733361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ddefb-8206-4075-ab2f-77c626a39644 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:13.733638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ddefb-8206-4075-ab2f-77c626a39644 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:13.733909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ddefb-8206-4075-ab2f-77c626a39644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:13.735896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-219ddefb-8206-4075-ab2f-77c626a39644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:13.739231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-63aaaada-a480-432c-85a5-cf576d46c5c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559378c95266494eaff2f4067abd7609'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:13.746653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-63aaaada-a480-432c-85a5-cf576d46c5c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559378c95266494eaff2f4067abd7609'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:13.747977 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-63aaaada-a480-432c-85a5-cf576d46c5c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559378c95266494eaff2f4067abd7609'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:13.753907 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1021/2026] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:13 2022] DELETE /identity/v3/users/559378c95266494eaff2f4067abd7609 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:13.801547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ddefb-8206-4075-ab2f-77c626a39644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:13.803080 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ddefb-8206-4075-ab2f-77c626a39644 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:13.813365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1006/2027] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:14.086883 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaaada-a480-432c-85a5-cf576d46c5c3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:14.088681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-63aaaada-a480-432c-85a5-cf576d46c5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:14.193955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaaada-a480-432c-85a5-cf576d46c5c3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:14.202240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410e74d-41b9-4966-a12e-c3b89b54bd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:14.204120 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410e74d-41b9-4966-a12e-c3b89b54bd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:14.205359 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410e74d-41b9-4966-a12e-c3b89b54bd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:14.206477 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410e74d-41b9-4966-a12e-c3b89b54bd92 admin admin] PATH_INFO: `/v3/projects/f9e16aaebfc04fb88179c5b9f2c0e475` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:14.208746 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410e74d-41b9-4966-a12e-c3b89b54bd92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e16aaebfc04fb88179c5b9f2c0e475)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:14.211951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410e74d-41b9-4966-a12e-c3b89b54bd92 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:14.269296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b410e74d-41b9-4966-a12e-c3b89b54bd92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e16aaebfc04fb88179c5b9f2c0e475', 'request_id': 'req-b410e74d-41b9-4966-a12e-c3b89b54bd92'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:14.275237 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b410e74d-41b9-4966-a12e-c3b89b54bd92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e16aaebfc04fb88179c5b9f2c0e475', 'request_id': 'req-b410e74d-41b9-4966-a12e-c3b89b54bd92'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:14.280291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ddefb-8206-4075-ab2f-77c626a39644 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:14.282143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-219ddefb-8206-4075-ab2f-77c626a39644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:14.283806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b410e74d-41b9-4966-a12e-c3b89b54bd92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e16aaebfc04fb88179c5b9f2c0e475', 'request_id': 'req-b410e74d-41b9-4966-a12e-c3b89b54bd92'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:14.295918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ddefb-8206-4075-ab2f-77c626a39644 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:14.296167 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b410e74d-41b9-4966-a12e-c3b89b54bd92 admin admin] The token cache is being invalidate because project f9e16aaebfc04fb88179c5b9f2c0e475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:14.296331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b410e74d-41b9-4966-a12e-c3b89b54bd92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:14.296966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b410e74d-41b9-4966-a12e-c3b89b54bd92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:14.298478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1022/2028] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:14 2022] DELETE /identity/v3/projects/f9e16aaebfc04fb88179c5b9f2c0e475 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:14.304484 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dcc4e-244c-4138-b029-4fd173e292a2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:14.304912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dcc4e-244c-4138-b029-4fd173e292a2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:14.305291 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dcc4e-244c-4138-b029-4fd173e292a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:14.327983 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-703dcc4e-244c-4138-b029-4fd173e292a2 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:14.329217 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-703dcc4e-244c-4138-b029-4fd173e292a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:14.342149 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:14.362233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d8db3-817e-4c85-b9fc-fa8ef43b48d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:14.362875 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d8db3-817e-4c85-b9fc-fa8ef43b48d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:14.363152 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d8db3-817e-4c85-b9fc-fa8ef43b48d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:14.363428 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d8db3-817e-4c85-b9fc-fa8ef43b48d0 admin admin] PATH_INFO: `/v3/users/aff43b267a694a3fb4ad3b2e4a6495e4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:14.364570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d8db3-817e-4c85-b9fc-fa8ef43b48d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff43b267a694a3fb4ad3b2e4a6495e4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:14.366692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d8db3-817e-4c85-b9fc-fa8ef43b48d0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:14.401837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1023/2029] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:14.413348 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d20af-995e-4352-8036-bb492149b46c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:14.413760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d20af-995e-4352-8036-bb492149b46c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:14.414749 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d20af-995e-4352-8036-bb492149b46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:14.435388 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ac2d8db3-817e-4c85-b9fc-fa8ef43b48d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff43b267a694a3fb4ad3b2e4a6495e4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:14.448225 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ac2d8db3-817e-4c85-b9fc-fa8ef43b48d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff43b267a694a3fb4ad3b2e4a6495e4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:14.456421 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-fc8d20af-995e-4352-8036-bb492149b46c None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:14.458224 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fc8d20af-995e-4352-8036-bb492149b46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:14.462448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ac2d8db3-817e-4c85-b9fc-fa8ef43b48d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff43b267a694a3fb4ad3b2e4a6495e4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:14.468630 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1024/2030] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:14.480493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ac2d8db3-817e-4c85-b9fc-fa8ef43b48d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff43b267a694a3fb4ad3b2e4a6495e4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:14.482518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ac2d8db3-817e-4c85-b9fc-fa8ef43b48d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff43b267a694a3fb4ad3b2e4a6495e4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:14.491226 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d20af-995e-4352-8036-bb492149b46c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:14.492148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1007/2031] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:14 2022] DELETE /identity/v3/users/aff43b267a694a3fb4ad3b2e4a6495e4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:14.496479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e298b0-3f05-449c-b539-06254154c92a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:14.496811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e298b0-3f05-449c-b539-06254154c92a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:14.497801 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e298b0-3f05-449c-b539-06254154c92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:14.506959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d20af-995e-4352-8036-bb492149b46c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:14.507789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:14.522878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-55e298b0-3f05-449c-b539-06254154c92a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:14.524092 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-55e298b0-3f05-449c-b539-06254154c92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:14.595906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c5502-e31f-4b4a-bcd8-713f76d2bcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:14.596698 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c5502-e31f-4b4a-bcd8-713f76d2bcae admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:14.597042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c5502-e31f-4b4a-bcd8-713f76d2bcae admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:14.597380 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c5502-e31f-4b4a-bcd8-713f76d2bcae admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:14.598176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c5502-e31f-4b4a-bcd8-713f76d2bcae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:14.598545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c5502-e31f-4b4a-bcd8-713f76d2bcae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:14.609625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c5502-e31f-4b4a-bcd8-713f76d2bcae admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:14.629308 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1025/2032] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:26:14.634126 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c5502-e31f-4b4a-bcd8-713f76d2bcae admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:14.635875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c07c5502-e31f-4b4a-bcd8-713f76d2bcae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:14.651038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1008/2033] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:14.655307 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c5502-e31f-4b4a-bcd8-713f76d2bcae admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:14.660461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6311ade-18b2-4500-bf1c-c435ab557e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:14.661104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6311ade-18b2-4500-bf1c-c435ab557e58 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:14.661642 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6311ade-18b2-4500-bf1c-c435ab557e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:14.661917 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6311ade-18b2-4500-bf1c-c435ab557e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:14.662537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e298b0-3f05-449c-b539-06254154c92a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:14.662638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6311ade-18b2-4500-bf1c-c435ab557e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:14.664424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6311ade-18b2-4500-bf1c-c435ab557e58 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:14.665777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-55e298b0-3f05-449c-b539-06254154c92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:14.705819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1026/2034] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:14 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:14.708204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6311ade-18b2-4500-bf1c-c435ab557e58 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:14.740294 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e298b0-3f05-449c-b539-06254154c92a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:14.786596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6311ade-18b2-4500-bf1c-c435ab557e58 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:14.791585 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960aee0-9611-4d56-b189-dd2ee572b788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:14.792277 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960aee0-9611-4d56-b189-dd2ee572b788 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:14.792623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960aee0-9611-4d56-b189-dd2ee572b788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:14.792969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960aee0-9611-4d56-b189-dd2ee572b788 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:14.793770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960aee0-9611-4d56-b189-dd2ee572b788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:14.796199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960aee0-9611-4d56-b189-dd2ee572b788 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:14.797125 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d56679-bd5b-40f3-94a8-9f848b3816f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:14.797886 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d56679-bd5b-40f3-94a8-9f848b3816f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:14.798279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d56679-bd5b-40f3-94a8-9f848b3816f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:14.798800 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d56679-bd5b-40f3-94a8-9f848b3816f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:14.811099 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d56679-bd5b-40f3-94a8-9f848b3816f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:14.812917 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d56679-bd5b-40f3-94a8-9f848b3816f9 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:14.826542 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1009/2035] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:14.828649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1027/2036] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:14 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:14.830987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d56679-bd5b-40f3-94a8-9f848b3816f9 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:14.841131 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d56679-bd5b-40f3-94a8-9f848b3816f9 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:14.845778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b42de6-6cc4-475a-87cc-209dbd8e2a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:14.846366 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b42de6-6cc4-475a-87cc-209dbd8e2a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:14.846641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b42de6-6cc4-475a-87cc-209dbd8e2a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:14.846907 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b42de6-6cc4-475a-87cc-209dbd8e2a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:14.847652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b42de6-6cc4-475a-87cc-209dbd8e2a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:14.849284 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b42de6-6cc4-475a-87cc-209dbd8e2a52 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:14.863599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1010/2037] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:14.865169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960aee0-9611-4d56-b189-dd2ee572b788 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:14.876064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960aee0-9611-4d56-b189-dd2ee572b788 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:14.881231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5da7f-993c-4a15-8393-e0805e40807f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:14.881830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5da7f-993c-4a15-8393-e0805e40807f admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:14.882112 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5da7f-993c-4a15-8393-e0805e40807f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:14.882423 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5da7f-993c-4a15-8393-e0805e40807f admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:14.883106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5da7f-993c-4a15-8393-e0805e40807f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:14.884785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5da7f-993c-4a15-8393-e0805e40807f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:14.895752 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1028/2038] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:14.899823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b42de6-6cc4-475a-87cc-209dbd8e2a52 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:14.911164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b42de6-6cc4-475a-87cc-209dbd8e2a52 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:14.916148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be6311-cf1c-487e-b854-674ce914e2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:14.916823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be6311-cf1c-487e-b854-674ce914e2d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:14.917125 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be6311-cf1c-487e-b854-674ce914e2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:14.917402 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be6311-cf1c-487e-b854-674ce914e2d5 admin admin] PATH_INFO: `/v3/projects/fee6d585b49d4db29cec24f0b123c501/users/7723e46eba014884998e5a3830b1fb14/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:14.933872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be6311-cf1c-487e-b854-674ce914e2d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee6d585b49d4db29cec24f0b123c501, user_id=7723e46eba014884998e5a3830b1fb14, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:14.937065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be6311-cf1c-487e-b854-674ce914e2d5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:14.951855 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1011/2039] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:14 2022] PUT /identity/v3/projects/fee6d585b49d4db29cec24f0b123c501/users/7723e46eba014884998e5a3830b1fb14/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:14.968645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56145155-1b04-42ce-801c-5b18295f3356 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:14.968645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56145155-1b04-42ce-801c-5b18295f3356 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:14.968645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56145155-1b04-42ce-801c-5b18295f3356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:14.983318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:15.007839 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-56145155-1b04-42ce-801c-5b18295f3356 None None] MFA Rules not processed for user `7723e46eba014884998e5a3830b1fb14`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:15.009205 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-56145155-1b04-42ce-801c-5b18295f3356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:15.091995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1029/2040] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:15.096538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be6311-cf1c-487e-b854-674ce914e2d5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:15.121086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56145155-1b04-42ce-801c-5b18295f3356 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:15.122524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-56145155-1b04-42ce-801c-5b18295f3356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:15.141111 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:15.186436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be6311-cf1c-487e-b854-674ce914e2d5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:15.191553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254592f-0cdb-4323-a26a-936984b7f9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:15.192157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254592f-0cdb-4323-a26a-936984b7f9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:15.192438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254592f-0cdb-4323-a26a-936984b7f9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:15.192749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254592f-0cdb-4323-a26a-936984b7f9f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:15.193387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254592f-0cdb-4323-a26a-936984b7f9f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:15.195302 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254592f-0cdb-4323-a26a-936984b7f9f2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:15.204419 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56145155-1b04-42ce-801c-5b18295f3356 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:15.212641 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecfe22-7968-4d09-b579-0476d3bb81f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:15.213427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecfe22-7968-4d09-b579-0476d3bb81f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:15.214100 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecfe22-7968-4d09-b579-0476d3bb81f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:15.214100 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecfe22-7968-4d09-b579-0476d3bb81f0 admin admin] PATH_INFO: `/v3/projects/12c109bde0cc473b8efc24309dda01ce` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:15.216348 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecfe22-7968-4d09-b579-0476d3bb81f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c109bde0cc473b8efc24309dda01ce)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:15.218702 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecfe22-7968-4d09-b579-0476d3bb81f0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:15.231699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1012/2041] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:15 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:15.232616 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254592f-0cdb-4323-a26a-936984b7f9f2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:15.273872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f9ecfe22-7968-4d09-b579-0476d3bb81f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c109bde0cc473b8efc24309dda01ce', 'request_id': 'req-f9ecfe22-7968-4d09-b579-0476d3bb81f0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:15.280264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f9ecfe22-7968-4d09-b579-0476d3bb81f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c109bde0cc473b8efc24309dda01ce', 'request_id': 'req-f9ecfe22-7968-4d09-b579-0476d3bb81f0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:15.289809 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f9ecfe22-7968-4d09-b579-0476d3bb81f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c109bde0cc473b8efc24309dda01ce', 'request_id': 'req-f9ecfe22-7968-4d09-b579-0476d3bb81f0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:15.311589 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f9ecfe22-7968-4d09-b579-0476d3bb81f0 admin admin] The token cache is being invalidate because project 12c109bde0cc473b8efc24309dda01ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:15.312741 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f9ecfe22-7968-4d09-b579-0476d3bb81f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:15.313906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f9ecfe22-7968-4d09-b579-0476d3bb81f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:15.316002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1030/2042] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:15 2022] DELETE /identity/v3/projects/12c109bde0cc473b8efc24309dda01ce => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:15.320220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecfe22-7968-4d09-b579-0476d3bb81f0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:15.321679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f9ecfe22-7968-4d09-b579-0476d3bb81f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:15.328880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254592f-0cdb-4323-a26a-936984b7f9f2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:15.352522 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:15.394048 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee0a8e-ee5b-485a-b1b8-6b48025bf374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:15.394735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0a8e-ee5b-485a-b1b8-6b48025bf374 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:15.395017 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0a8e-ee5b-485a-b1b8-6b48025bf374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:15.395292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0a8e-ee5b-485a-b1b8-6b48025bf374 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:15.395925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee0a8e-ee5b-485a-b1b8-6b48025bf374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:15.398171 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee0a8e-ee5b-485a-b1b8-6b48025bf374 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:15.405614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecfe22-7968-4d09-b579-0476d3bb81f0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:15.410864 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fc587-3e7d-42b7-8df0-0bd1b8bc52d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:15.411727 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fc587-3e7d-42b7-8df0-0bd1b8bc52d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:15.411985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fc587-3e7d-42b7-8df0-0bd1b8bc52d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:15.412362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fc587-3e7d-42b7-8df0-0bd1b8bc52d0 admin admin] PATH_INFO: `/v3/users/5d2fb8ad83be4686aee2085e73d787e0` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:15.413650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fc587-3e7d-42b7-8df0-0bd1b8bc52d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d2fb8ad83be4686aee2085e73d787e0)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:15.415606 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fc587-3e7d-42b7-8df0-0bd1b8bc52d0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:15.424351 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1013/2043] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:15 2022] POST /identity/v3/users => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:15.428528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee0a8e-ee5b-485a-b1b8-6b48025bf374 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:15.430712 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b7ee0a8e-ee5b-485a-b1b8-6b48025bf374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:15.443315 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee0a8e-ee5b-485a-b1b8-6b48025bf374 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:15.448938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fa14a-982a-469c-9009-93dc4a916484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:15.449846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fa14a-982a-469c-9009-93dc4a916484 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:15.450176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fa14a-982a-469c-9009-93dc4a916484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:15.450453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fa14a-982a-469c-9009-93dc4a916484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:15.451174 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fa14a-982a-469c-9009-93dc4a916484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:15.453385 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fa14a-982a-469c-9009-93dc4a916484 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:15.472710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1014/2044] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:15.472710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fa14a-982a-469c-9009-93dc4a916484 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:15.477417 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-889fc587-3e7d-42b7-8df0-0bd1b8bc52d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d2fb8ad83be4686aee2085e73d787e0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:15.485022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fa14a-982a-469c-9009-93dc4a916484 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:15.490264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacb31e-a9ff-4503-bdd9-d30e5e145f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:15.491121 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacb31e-a9ff-4503-bdd9-d30e5e145f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:15.491403 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacb31e-a9ff-4503-bdd9-d30e5e145f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:15.491678 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacb31e-a9ff-4503-bdd9-d30e5e145f4d admin admin] PATH_INFO: `/v3/projects/5989e8a3c4604b0fb39eda52363f7b9e/users/07151aa6c32f4872be458e5d102a3bcb/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:15.499535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-889fc587-3e7d-42b7-8df0-0bd1b8bc52d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d2fb8ad83be4686aee2085e73d787e0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:15.507415 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-889fc587-3e7d-42b7-8df0-0bd1b8bc52d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d2fb8ad83be4686aee2085e73d787e0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:15.512778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacb31e-a9ff-4503-bdd9-d30e5e145f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5989e8a3c4604b0fb39eda52363f7b9e, user_id=07151aa6c32f4872be458e5d102a3bcb, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:15.515417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacb31e-a9ff-4503-bdd9-d30e5e145f4d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:15.517126 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-889fc587-3e7d-42b7-8df0-0bd1b8bc52d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d2fb8ad83be4686aee2085e73d787e0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:15.517808 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-889fc587-3e7d-42b7-8df0-0bd1b8bc52d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d2fb8ad83be4686aee2085e73d787e0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:15.525313 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1031/2045] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:15 2022] DELETE /identity/v3/users/5d2fb8ad83be4686aee2085e73d787e0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:15.532622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1015/2046] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:15 2022] PUT /identity/v3/projects/5989e8a3c4604b0fb39eda52363f7b9e/users/07151aa6c32f4872be458e5d102a3bcb/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:15.535832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fc587-3e7d-42b7-8df0-0bd1b8bc52d0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:15.537444 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-889fc587-3e7d-42b7-8df0-0bd1b8bc52d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:15.618002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacb31e-a9ff-4503-bdd9-d30e5e145f4d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:15.619710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6cacb31e-a9ff-4503-bdd9-d30e5e145f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:15.621310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fc587-3e7d-42b7-8df0-0bd1b8bc52d0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:15.628624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0260b-cf80-42b2-87da-68fe3d5c58b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:15.629302 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0260b-cf80-42b2-87da-68fe3d5c58b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:15.629784 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0260b-cf80-42b2-87da-68fe3d5c58b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:15.630409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0260b-cf80-42b2-87da-68fe3d5c58b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:15.631217 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0260b-cf80-42b2-87da-68fe3d5c58b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:15.632914 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0260b-cf80-42b2-87da-68fe3d5c58b5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:15.645317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:15.649155 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1032/2047] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:15.653001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0260b-cf80-42b2-87da-68fe3d5c58b5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:15.671439 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0260b-cf80-42b2-87da-68fe3d5c58b5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:15.678341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b2a3f-866f-4890-9bee-ad2a1f75820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:15.679076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b2a3f-866f-4890-9bee-ad2a1f75820e admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:15.679591 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b2a3f-866f-4890-9bee-ad2a1f75820e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:15.679972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b2a3f-866f-4890-9bee-ad2a1f75820e admin admin] PATH_INFO: `/v3/projects/5989e8a3c4604b0fb39eda52363f7b9e/users/07151aa6c32f4872be458e5d102a3bcb/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:15.682945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b2a3f-866f-4890-9bee-ad2a1f75820e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5989e8a3c4604b0fb39eda52363f7b9e, user_id=07151aa6c32f4872be458e5d102a3bcb, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:15.686518 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b2a3f-866f-4890-9bee-ad2a1f75820e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:15.701635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1033/2048] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:15 2022] PUT /identity/v3/projects/5989e8a3c4604b0fb39eda52363f7b9e/users/07151aa6c32f4872be458e5d102a3bcb/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:15.716435 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d95c7f-fa84-4952-9fbc-aa71a80babec None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:15.716765 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d95c7f-fa84-4952-9fbc-aa71a80babec None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:15.717032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d95c7f-fa84-4952-9fbc-aa71a80babec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:15.723414 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacb31e-a9ff-4503-bdd9-d30e5e145f4d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:15.748458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c5d95c7f-fa84-4952-9fbc-aa71a80babec None None] MFA Rules not processed for user `07151aa6c32f4872be458e5d102a3bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:15.750138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c5d95c7f-fa84-4952-9fbc-aa71a80babec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:15.773115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:15.812910 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369e7f5-3c7c-479e-bb0e-3191ee302cf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:15.813786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369e7f5-3c7c-479e-bb0e-3191ee302cf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:15.814359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369e7f5-3c7c-479e-bb0e-3191ee302cf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:15.814864 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369e7f5-3c7c-479e-bb0e-3191ee302cf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:15.819903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f369e7f5-3c7c-479e-bb0e-3191ee302cf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:15.873254 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1034/2049] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:15.884106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d95c7f-fa84-4952-9fbc-aa71a80babec None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:15.892061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c5d95c7f-fa84-4952-9fbc-aa71a80babec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:15.911499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d95c7f-fa84-4952-9fbc-aa71a80babec None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:15.916920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf64166-a4dd-4b6b-b670-a448aef9428a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:15.917686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf64166-a4dd-4b6b-b670-a448aef9428a service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:15.918063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf64166-a4dd-4b6b-b670-a448aef9428a service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:15.918467 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf64166-a4dd-4b6b-b670-a448aef9428a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:15.926181 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369e7f5-3c7c-479e-bb0e-3191ee302cf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:15.928230 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369e7f5-3c7c-479e-bb0e-3191ee302cf3 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:15.932349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf64166-a4dd-4b6b-b670-a448aef9428a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:15.934490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf64166-a4dd-4b6b-b670-a448aef9428a service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:15.964756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1035/2051] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:15.972289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1016/2051] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:15.983851 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf64166-a4dd-4b6b-b670-a448aef9428a service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:15.994832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9cf64166-a4dd-4b6b-b670-a448aef9428a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:16.089359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369e7f5-3c7c-479e-bb0e-3191ee302cf3 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:16.100407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369e7f5-3c7c-479e-bb0e-3191ee302cf3 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:16.104417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8626d8-2b47-4586-9efd-d236ccd53c4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:16.105055 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8626d8-2b47-4586-9efd-d236ccd53c4c service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:16.105330 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8626d8-2b47-4586-9efd-d236ccd53c4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:16.105611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8626d8-2b47-4586-9efd-d236ccd53c4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:16.107163 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf64166-a4dd-4b6b-b670-a448aef9428a service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:16.107658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cf8626d8-2b47-4586-9efd-d236ccd53c4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:16.112131 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485f133-24ec-4bb9-8965-8175466a3f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:16.112794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485f133-24ec-4bb9-8965-8175466a3f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:16.113076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485f133-24ec-4bb9-8965-8175466a3f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:16.113351 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485f133-24ec-4bb9-8965-8175466a3f5a admin admin] PATH_INFO: `/v3/projects/38dcfbab09584de1aa96a25cd1cf5815` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:16.115390 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485f133-24ec-4bb9-8965-8175466a3f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=38dcfbab09584de1aa96a25cd1cf5815)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:16.117202 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485f133-24ec-4bb9-8965-8175466a3f5a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:16.195617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8626d8-2b47-4586-9efd-d236ccd53c4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:16.197289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8626d8-2b47-4586-9efd-d236ccd53c4c service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:16.203579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9485f133-24ec-4bb9-8965-8175466a3f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38dcfbab09584de1aa96a25cd1cf5815', 'request_id': 'req-9485f133-24ec-4bb9-8965-8175466a3f5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:16.212305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9485f133-24ec-4bb9-8965-8175466a3f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38dcfbab09584de1aa96a25cd1cf5815', 'request_id': 'req-9485f133-24ec-4bb9-8965-8175466a3f5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:16.215296 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1017/2052] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:16.232245 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9485f133-24ec-4bb9-8965-8175466a3f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38dcfbab09584de1aa96a25cd1cf5815', 'request_id': 'req-9485f133-24ec-4bb9-8965-8175466a3f5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:16.268957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9485f133-24ec-4bb9-8965-8175466a3f5a admin admin] The token cache is being invalidate because project 38dcfbab09584de1aa96a25cd1cf5815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:16.269290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9485f133-24ec-4bb9-8965-8175466a3f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:16.270154 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9485f133-24ec-4bb9-8965-8175466a3f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:16.272505 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1036/2053] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:15 2022] DELETE /identity/v3/projects/38dcfbab09584de1aa96a25cd1cf5815 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:16.278706 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285bc01-d376-4a1d-94e4-0fe0a1e41b59 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:16.279446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285bc01-d376-4a1d-94e4-0fe0a1e41b59 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:16.280094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285bc01-d376-4a1d-94e4-0fe0a1e41b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:16.308390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c285bc01-d376-4a1d-94e4-0fe0a1e41b59 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:16.310438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c285bc01-d376-4a1d-94e4-0fe0a1e41b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:16.351905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:16.422892 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1018/2054] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:16.430502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e639e-85e1-42df-9860-21a86bed62a1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:16.431031 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e639e-85e1-42df-9860-21a86bed62a1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:16.431673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e639e-85e1-42df-9860-21a86bed62a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:16.473788 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ca2e639e-85e1-42df-9860-21a86bed62a1 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:16.475572 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ca2e639e-85e1-42df-9860-21a86bed62a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:16.493472 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285bc01-d376-4a1d-94e4-0fe0a1e41b59 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:16.495403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1037/2055] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:16.508297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285bc01-d376-4a1d-94e4-0fe0a1e41b59 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:16.519941 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad5969-5672-46d7-a98b-46b51aaf3ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:16.521125 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad5969-5672-46d7-a98b-46b51aaf3ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:16.521361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad5969-5672-46d7-a98b-46b51aaf3ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:16.521791 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad5969-5672-46d7-a98b-46b51aaf3ba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:16.522549 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad5969-5672-46d7-a98b-46b51aaf3ba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:16.522961 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad5969-5672-46d7-a98b-46b51aaf3ba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:16.525034 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad5969-5672-46d7-a98b-46b51aaf3ba2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:16.539616 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1019/2056] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:26:16.548526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e639e-85e1-42df-9860-21a86bed62a1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:16.560149 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e639e-85e1-42df-9860-21a86bed62a1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:16.570483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b2817-daf4-4c25-b310-e1b39afbcf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:16.571448 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b2817-daf4-4c25-b310-e1b39afbcf0f admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:16.571732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b2817-daf4-4c25-b310-e1b39afbcf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:16.572018 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b2817-daf4-4c25-b310-e1b39afbcf0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:16.573038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b2817-daf4-4c25-b310-e1b39afbcf0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:16.575292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b2817-daf4-4c25-b310-e1b39afbcf0f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:16.619348 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:16.638302 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1038/2057] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:16 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:16.639003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad5969-5672-46d7-a98b-46b51aaf3ba2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:16.653940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad5969-5672-46d7-a98b-46b51aaf3ba2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:16.699667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b2817-daf4-4c25-b310-e1b39afbcf0f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:16.702334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c74b2817-daf4-4c25-b310-e1b39afbcf0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:16.756074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40324575-676f-42ef-b96f-0b541715d2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:16.757299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40324575-676f-42ef-b96f-0b541715d2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:16.757973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40324575-676f-42ef-b96f-0b541715d2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:16.758095 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40324575-676f-42ef-b96f-0b541715d2f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:16.758676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40324575-676f-42ef-b96f-0b541715d2f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:16.761446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40324575-676f-42ef-b96f-0b541715d2f9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:16.797571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1020/2058] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:16 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:16.799028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b2817-daf4-4c25-b310-e1b39afbcf0f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:16.802210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40324575-676f-42ef-b96f-0b541715d2f9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:16.804907 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-40324575-676f-42ef-b96f-0b541715d2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:16.807669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9af7f8-e515-42b9-8a3b-50592355b7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:16.808555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9af7f8-e515-42b9-8a3b-50592355b7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:16.808925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9af7f8-e515-42b9-8a3b-50592355b7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:16.809838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9af7f8-e515-42b9-8a3b-50592355b7c2 admin admin] PATH_INFO: `/v3/users/7723e46eba014884998e5a3830b1fb14` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:16.811334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9af7f8-e515-42b9-8a3b-50592355b7c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7723e46eba014884998e5a3830b1fb14)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:16.813885 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9af7f8-e515-42b9-8a3b-50592355b7c2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:16.874224 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8e9af7f8-e515-42b9-8a3b-50592355b7c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7723e46eba014884998e5a3830b1fb14'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:16.881886 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40324575-676f-42ef-b96f-0b541715d2f9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:16.885991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c0f1b-71ae-4839-90b0-1827f6d9ada0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:16.886591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c0f1b-71ae-4839-90b0-1827f6d9ada0 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:16.886866 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c0f1b-71ae-4839-90b0-1827f6d9ada0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:16.887136 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8e9af7f8-e515-42b9-8a3b-50592355b7c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7723e46eba014884998e5a3830b1fb14'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:16.887265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c0f1b-71ae-4839-90b0-1827f6d9ada0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:16.889416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-295c0f1b-71ae-4839-90b0-1827f6d9ada0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:16.896207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8e9af7f8-e515-42b9-8a3b-50592355b7c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7723e46eba014884998e5a3830b1fb14'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:16.911189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8e9af7f8-e515-42b9-8a3b-50592355b7c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7723e46eba014884998e5a3830b1fb14'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:16.911963 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8e9af7f8-e515-42b9-8a3b-50592355b7c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7723e46eba014884998e5a3830b1fb14'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:16.919409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1039/2059] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:16 2022] DELETE /identity/v3/users/7723e46eba014884998e5a3830b1fb14 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:16.920197 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9af7f8-e515-42b9-8a3b-50592355b7c2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:16.921549 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8e9af7f8-e515-42b9-8a3b-50592355b7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:16.967414 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:16.995034 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c0f1b-71ae-4839-90b0-1827f6d9ada0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:16.998225 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c0f1b-71ae-4839-90b0-1827f6d9ada0 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:17.017204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9af7f8-e515-42b9-8a3b-50592355b7c2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:17.024156 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1021/2060] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:17.026060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b73ac-0732-48b5-9a7c-17c5f19caacd None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:17.026179 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850e3b8-8cfe-4b40-af1d-587f4155dbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:17.026459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b73ac-0732-48b5-9a7c-17c5f19caacd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:17.026841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b73ac-0732-48b5-9a7c-17c5f19caacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:17.037050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850e3b8-8cfe-4b40-af1d-587f4155dbfc admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:17.037438 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850e3b8-8cfe-4b40-af1d-587f4155dbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:17.037719 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850e3b8-8cfe-4b40-af1d-587f4155dbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:17.042678 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850e3b8-8cfe-4b40-af1d-587f4155dbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:17.047979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850e3b8-8cfe-4b40-af1d-587f4155dbfc admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:17.058778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-899b73ac-0732-48b5-9a7c-17c5f19caacd None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:17.060479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-899b73ac-0732-48b5-9a7c-17c5f19caacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:17.073477 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1040/2061] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:17.078212 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1022/2062] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:17.080859 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850e3b8-8cfe-4b40-af1d-587f4155dbfc admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:17.088072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b73ac-0732-48b5-9a7c-17c5f19caacd None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:17.093172 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-899b73ac-0732-48b5-9a7c-17c5f19caacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:17.102006 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850e3b8-8cfe-4b40-af1d-587f4155dbfc admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:17.109269 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04f474-cf75-4145-b039-77a70685f4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:17.110158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04f474-cf75-4145-b039-77a70685f4ae admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:17.110913 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04f474-cf75-4145-b039-77a70685f4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:17.111270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04f474-cf75-4145-b039-77a70685f4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:17.114431 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04f474-cf75-4145-b039-77a70685f4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:17.119594 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04f474-cf75-4145-b039-77a70685f4ae admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:17.141751 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1041/2063] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:17.146817 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04f474-cf75-4145-b039-77a70685f4ae admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:17.154002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:17.158648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04f474-cf75-4145-b039-77a70685f4ae admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:17.164855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c46c21-04ba-4ade-a055-6c8b0bbaaa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:17.165596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c46c21-04ba-4ade-a055-6c8b0bbaaa6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:17.165942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c46c21-04ba-4ade-a055-6c8b0bbaaa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:17.166334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c46c21-04ba-4ade-a055-6c8b0bbaaa6e admin admin] PATH_INFO: `/v3/projects/5b3e1c134820437c8deac4786b91ba43/users/b003596a02c7468b8c0003b651c9d857/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:17.188270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b73ac-0732-48b5-9a7c-17c5f19caacd None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:17.207603 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e54e6c-f10c-40e3-be7a-2629dd501ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:17.208249 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e54e6c-f10c-40e3-be7a-2629dd501ecf service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:17.210022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e54e6c-f10c-40e3-be7a-2629dd501ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:17.210372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e54e6c-f10c-40e3-be7a-2629dd501ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:17.211098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c46c21-04ba-4ade-a055-6c8b0bbaaa6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3e1c134820437c8deac4786b91ba43, user_id=b003596a02c7468b8c0003b651c9d857, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:17.214660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c46c21-04ba-4ade-a055-6c8b0bbaaa6e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:17.223667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e54e6c-f10c-40e3-be7a-2629dd501ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:17.225426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e54e6c-f10c-40e3-be7a-2629dd501ecf service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:17.232988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1042/2064] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:17 2022] PUT /identity/v3/projects/5b3e1c134820437c8deac4786b91ba43/users/b003596a02c7468b8c0003b651c9d857/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:17.237369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1023/2065] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:17.245878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b7c4e-958a-4406-a525-747a14113016 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:17.246236 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b7c4e-958a-4406-a525-747a14113016 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:17.246621 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b7c4e-958a-4406-a525-747a14113016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:17.278736 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-282b7c4e-958a-4406-a525-747a14113016 None None] MFA Rules not processed for user `b003596a02c7468b8c0003b651c9d857`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:17.283239 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-282b7c4e-958a-4406-a525-747a14113016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:17.411936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1043/2066] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:17.417478 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e54e6c-f10c-40e3-be7a-2629dd501ecf service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:17.428944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e54e6c-f10c-40e3-be7a-2629dd501ecf service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:17.520381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baf93d-3aa2-4b3b-b240-e09f63f181eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:17.521037 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baf93d-3aa2-4b3b-b240-e09f63f181eb admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:17.521314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baf93d-3aa2-4b3b-b240-e09f63f181eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:17.521626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baf93d-3aa2-4b3b-b240-e09f63f181eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:17.522990 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baf93d-3aa2-4b3b-b240-e09f63f181eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:17.524953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baf93d-3aa2-4b3b-b240-e09f63f181eb admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:17.563093 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1024/2067] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:17 2022] POST /identity/v3/projects => generated 389 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:17.569354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b7c4e-958a-4406-a525-747a14113016 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:17.582840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b7c4e-958a-4406-a525-747a14113016 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:17.665385 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe40933-8f83-49a2-99ec-8ca58f48263d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:17.666074 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe40933-8f83-49a2-99ec-8ca58f48263d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:17.666444 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe40933-8f83-49a2-99ec-8ca58f48263d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:17.666659 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe40933-8f83-49a2-99ec-8ca58f48263d admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:17.668663 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe40933-8f83-49a2-99ec-8ca58f48263d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:17.669904 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe40933-8f83-49a2-99ec-8ca58f48263d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:17.699441 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1044/2068] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:17 2022] POST /identity/v3/users => generated 301 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:17.704042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baf93d-3aa2-4b3b-b240-e09f63f181eb admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:17.716169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe40933-8f83-49a2-99ec-8ca58f48263d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:17.719456 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baf93d-3aa2-4b3b-b240-e09f63f181eb admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:17.721080 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-abe40933-8f83-49a2-99ec-8ca58f48263d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:17.731744 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e08c7-4d23-4464-89a1-b0465d40fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:17.731744 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e08c7-4d23-4464-89a1-b0465d40fae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:17.731744 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e08c7-4d23-4464-89a1-b0465d40fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:17.731744 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e08c7-4d23-4464-89a1-b0465d40fae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:17.732425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e08c7-4d23-4464-89a1-b0465d40fae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:17.736120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e08c7-4d23-4464-89a1-b0465d40fae6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:17.738854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe40933-8f83-49a2-99ec-8ca58f48263d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:17.743598 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f479313-7073-4add-be87-2ddc53999da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:17.744239 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f479313-7073-4add-be87-2ddc53999da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:17.744545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f479313-7073-4add-be87-2ddc53999da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:17.744854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f479313-7073-4add-be87-2ddc53999da0 admin admin] PATH_INFO: `/v3/projects/fee6d585b49d4db29cec24f0b123c501` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:17.749363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f479313-7073-4add-be87-2ddc53999da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee6d585b49d4db29cec24f0b123c501)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:17.757519 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f479313-7073-4add-be87-2ddc53999da0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:17.762345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1025/2069] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:17.764056 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e08c7-4d23-4464-89a1-b0465d40fae6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:17.776420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e08c7-4d23-4464-89a1-b0465d40fae6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:17.787731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc79603-8ff8-408e-bd56-81570189e90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:17.788708 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc79603-8ff8-408e-bd56-81570189e90c admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:17.789089 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc79603-8ff8-408e-bd56-81570189e90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:17.789466 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc79603-8ff8-408e-bd56-81570189e90c admin admin] PATH_INFO: `/v3/projects/ec89e20b091a4431aba73e3c026b219c/users/fa79e2e228a244f4be4d31df6bdab690/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:17.808603 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc79603-8ff8-408e-bd56-81570189e90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec89e20b091a4431aba73e3c026b219c, user_id=fa79e2e228a244f4be4d31df6bdab690, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:17.811602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc79603-8ff8-408e-bd56-81570189e90c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:17.821495 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f479313-7073-4add-be87-2ddc53999da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee6d585b49d4db29cec24f0b123c501', 'request_id': 'req-4f479313-7073-4add-be87-2ddc53999da0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:17.826891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:17.830329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f479313-7073-4add-be87-2ddc53999da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee6d585b49d4db29cec24f0b123c501', 'request_id': 'req-4f479313-7073-4add-be87-2ddc53999da0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:17.831401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1026/2070] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:17 2022] PUT /identity/v3/projects/ec89e20b091a4431aba73e3c026b219c/users/fa79e2e228a244f4be4d31df6bdab690/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:17.832532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc79603-8ff8-408e-bd56-81570189e90c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:17.842405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f479313-7073-4add-be87-2ddc53999da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee6d585b49d4db29cec24f0b123c501', 'request_id': 'req-4f479313-7073-4add-be87-2ddc53999da0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:17.857002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f479313-7073-4add-be87-2ddc53999da0 admin admin] The token cache is being invalidate because project fee6d585b49d4db29cec24f0b123c501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:17.857389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f479313-7073-4add-be87-2ddc53999da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:17.858122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f479313-7073-4add-be87-2ddc53999da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:17.860556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1045/2071] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:17 2022] DELETE /identity/v3/projects/fee6d585b49d4db29cec24f0b123c501 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:17.864371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f479313-7073-4add-be87-2ddc53999da0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:17.866060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4f479313-7073-4add-be87-2ddc53999da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:17.891233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:17.919205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc79603-8ff8-408e-bd56-81570189e90c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:17.925067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ca8e3-7be6-49a7-9a01-7b5147eb64fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:17.925688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ca8e3-7be6-49a7-9a01-7b5147eb64fc admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:17.925969 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ca8e3-7be6-49a7-9a01-7b5147eb64fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:17.926243 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ca8e3-7be6-49a7-9a01-7b5147eb64fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:17.927032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ca8e3-7be6-49a7-9a01-7b5147eb64fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:17.928789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ca8e3-7be6-49a7-9a01-7b5147eb64fc admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:17.944429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1027/2072] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:17.945626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ca8e3-7be6-49a7-9a01-7b5147eb64fc admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:17.946369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f479313-7073-4add-be87-2ddc53999da0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:17.947866 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-685ca8e3-7be6-49a7-9a01-7b5147eb64fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:17.951617 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdbbb8-e1e9-4717-95a4-87447e19fdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:17.952247 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdbbb8-e1e9-4717-95a4-87447e19fdbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:17.952521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdbbb8-e1e9-4717-95a4-87447e19fdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:17.952837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdbbb8-e1e9-4717-95a4-87447e19fdbd admin admin] PATH_INFO: `/v3/users/07151aa6c32f4872be458e5d102a3bcb` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:17.953965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdbbb8-e1e9-4717-95a4-87447e19fdbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=07151aa6c32f4872be458e5d102a3bcb)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:17.955920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdbbb8-e1e9-4717-95a4-87447e19fdbd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:17.961604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ca8e3-7be6-49a7-9a01-7b5147eb64fc admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:17.968515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fd4fb-61f7-4e1f-b6dd-4e74c28eb210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:17.969334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fd4fb-61f7-4e1f-b6dd-4e74c28eb210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:17.969739 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fd4fb-61f7-4e1f-b6dd-4e74c28eb210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:17.970055 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fd4fb-61f7-4e1f-b6dd-4e74c28eb210 admin admin] PATH_INFO: `/v3/projects/ec89e20b091a4431aba73e3c026b219c/users/fa79e2e228a244f4be4d31df6bdab690/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:17.972248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fd4fb-61f7-4e1f-b6dd-4e74c28eb210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec89e20b091a4431aba73e3c026b219c, user_id=fa79e2e228a244f4be4d31df6bdab690, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:17.975192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fd4fb-61f7-4e1f-b6dd-4e74c28eb210 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:17.988359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1028/2073] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:17 2022] PUT /identity/v3/projects/ec89e20b091a4431aba73e3c026b219c/users/fa79e2e228a244f4be4d31df6bdab690/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:17.999987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b336f-a234-4211-a2c8-1b650254c819 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:18.000381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b336f-a234-4211-a2c8-1b650254c819 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:18.000782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b336f-a234-4211-a2c8-1b650254c819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:18.032497 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67fdbbb8-e1e9-4717-95a4-87447e19fdbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07151aa6c32f4872be458e5d102a3bcb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:18.045394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67fdbbb8-e1e9-4717-95a4-87447e19fdbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07151aa6c32f4872be458e5d102a3bcb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:18.049624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8a2b336f-a234-4211-a2c8-1b650254c819 None None] MFA Rules not processed for user `fa79e2e228a244f4be4d31df6bdab690`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:18.051658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8a2b336f-a234-4211-a2c8-1b650254c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:18.056763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67fdbbb8-e1e9-4717-95a4-87447e19fdbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07151aa6c32f4872be458e5d102a3bcb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:18.073204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67fdbbb8-e1e9-4717-95a4-87447e19fdbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07151aa6c32f4872be458e5d102a3bcb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:18.075319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67fdbbb8-e1e9-4717-95a4-87447e19fdbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07151aa6c32f4872be458e5d102a3bcb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:18.084485 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1046/2074] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:17 2022] DELETE /identity/v3/users/07151aa6c32f4872be458e5d102a3bcb => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:18.159238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1029/2075] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:17 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:18.177188 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdbbb8-e1e9-4717-95a4-87447e19fdbd admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:18.179318 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-67fdbbb8-e1e9-4717-95a4-87447e19fdbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:18.317829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdbbb8-e1e9-4717-95a4-87447e19fdbd admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:18.329966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96172653-7c04-460f-ad24-276efb592e4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:18.330679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96172653-7c04-460f-ad24-276efb592e4e service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:18.331033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96172653-7c04-460f-ad24-276efb592e4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:18.331377 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96172653-7c04-460f-ad24-276efb592e4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:18.362764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:18.464550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96172653-7c04-460f-ad24-276efb592e4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:18.472427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96172653-7c04-460f-ad24-276efb592e4e service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:18.504709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1047/2076] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:18 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:18.754886 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b336f-a234-4211-a2c8-1b650254c819 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:18.756535 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8a2b336f-a234-4211-a2c8-1b650254c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:18.866418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b336f-a234-4211-a2c8-1b650254c819 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:18.903048 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96172653-7c04-460f-ad24-276efb592e4e service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:18.904509 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-96172653-7c04-460f-ad24-276efb592e4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:18.941180 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:18.960247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e6d6a-70ce-4c5f-b77f-586bba34bae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:18.961248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e6d6a-70ce-4c5f-b77f-586bba34bae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:18.961530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e6d6a-70ce-4c5f-b77f-586bba34bae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:18.961800 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e6d6a-70ce-4c5f-b77f-586bba34bae4 admin admin] PATH_INFO: `/v3/projects/5989e8a3c4604b0fb39eda52363f7b9e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:18.965691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e6d6a-70ce-4c5f-b77f-586bba34bae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5989e8a3c4604b0fb39eda52363f7b9e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:18.967788 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e6d6a-70ce-4c5f-b77f-586bba34bae4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:19.039669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96172653-7c04-460f-ad24-276efb592e4e service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:19.041676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-522e6d6a-70ce-4c5f-b77f-586bba34bae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5989e8a3c4604b0fb39eda52363f7b9e', 'request_id': 'req-522e6d6a-70ce-4c5f-b77f-586bba34bae4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:19.051108 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-522e6d6a-70ce-4c5f-b77f-586bba34bae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5989e8a3c4604b0fb39eda52363f7b9e', 'request_id': 'req-522e6d6a-70ce-4c5f-b77f-586bba34bae4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:19.061548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-522e6d6a-70ce-4c5f-b77f-586bba34bae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5989e8a3c4604b0fb39eda52363f7b9e', 'request_id': 'req-522e6d6a-70ce-4c5f-b77f-586bba34bae4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:19.075881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-522e6d6a-70ce-4c5f-b77f-586bba34bae4 admin admin] The token cache is being invalidate because project 5989e8a3c4604b0fb39eda52363f7b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:19.080122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-522e6d6a-70ce-4c5f-b77f-586bba34bae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:19.080122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-522e6d6a-70ce-4c5f-b77f-586bba34bae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:19.080755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1030/2077] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:18 2022] DELETE /identity/v3/projects/5989e8a3c4604b0fb39eda52363f7b9e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:19.087211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfca619-2069-431e-bf59-aa2adb90f0b2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:19.088817 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfca619-2069-431e-bf59-aa2adb90f0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:19.089264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfca619-2069-431e-bf59-aa2adb90f0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:19.116936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8dfca619-2069-431e-bf59-aa2adb90f0b2 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:19.118391 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8dfca619-2069-431e-bf59-aa2adb90f0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:19.126643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316b9b7-7252-4a14-a684-c7b244891b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:19.127258 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316b9b7-7252-4a14-a684-c7b244891b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:19.127529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316b9b7-7252-4a14-a684-c7b244891b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:19.127795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316b9b7-7252-4a14-a684-c7b244891b16 admin admin] PATH_INFO: `/v3/users/b003596a02c7468b8c0003b651c9d857` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:19.129607 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316b9b7-7252-4a14-a684-c7b244891b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b003596a02c7468b8c0003b651c9d857)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:19.131713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316b9b7-7252-4a14-a684-c7b244891b16 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:19.203625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9316b9b7-7252-4a14-a684-c7b244891b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b003596a02c7468b8c0003b651c9d857'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:19.227349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:19.230335 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9316b9b7-7252-4a14-a684-c7b244891b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b003596a02c7468b8c0003b651c9d857'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:19.232233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1031/2078] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:19.240283 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9316b9b7-7252-4a14-a684-c7b244891b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b003596a02c7468b8c0003b651c9d857'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:19.241214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26f67a-dc63-4523-9808-6f4a2b8b1a9d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:19.241501 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26f67a-dc63-4523-9808-6f4a2b8b1a9d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:19.241790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26f67a-dc63-4523-9808-6f4a2b8b1a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:19.250222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9316b9b7-7252-4a14-a684-c7b244891b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b003596a02c7468b8c0003b651c9d857'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:19.251007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9316b9b7-7252-4a14-a684-c7b244891b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b003596a02c7468b8c0003b651c9d857'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:19.260210 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1048/2079] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:18 2022] DELETE /identity/v3/users/b003596a02c7468b8c0003b651c9d857 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:19.261902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add8816-2acd-4055-b662-ef19ed67bbc9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:19.262187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add8816-2acd-4055-b662-ef19ed67bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:19.263206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add8816-2acd-4055-b662-ef19ed67bbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:19.265415 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9a26f67a-dc63-4523-9808-6f4a2b8b1a9d None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:19.266611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9a26f67a-dc63-4523-9808-6f4a2b8b1a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:19.288421 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3add8816-2acd-4055-b662-ef19ed67bbc9 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:19.289623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3add8816-2acd-4055-b662-ef19ed67bbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:19.349228 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1032/2080] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:19.353681 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26f67a-dc63-4523-9808-6f4a2b8b1a9d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:19.370071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26f67a-dc63-4523-9808-6f4a2b8b1a9d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:19.379959 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a87266-1877-464d-acae-dd56d3f31957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:19.380654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a87266-1877-464d-acae-dd56d3f31957 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:19.380984 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a87266-1877-464d-acae-dd56d3f31957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:19.381261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a87266-1877-464d-acae-dd56d3f31957 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:19.382448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a87266-1877-464d-acae-dd56d3f31957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:19.382897 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a87266-1877-464d-acae-dd56d3f31957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:19.384638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1049/2081] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:19.384844 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a87266-1877-464d-acae-dd56d3f31957 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:19.395285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add8816-2acd-4055-b662-ef19ed67bbc9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:19.396996 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3add8816-2acd-4055-b662-ef19ed67bbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:19.398816 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1033/2082] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:26:19.403337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a87266-1877-464d-acae-dd56d3f31957 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:19.414788 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a87266-1877-464d-acae-dd56d3f31957 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:19.420724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93989d87-d2fb-47f7-a27e-031ea06c9398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:19.421433 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93989d87-d2fb-47f7-a27e-031ea06c9398 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:19.421939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93989d87-d2fb-47f7-a27e-031ea06c9398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:19.425907 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93989d87-d2fb-47f7-a27e-031ea06c9398 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:19.426738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93989d87-d2fb-47f7-a27e-031ea06c9398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:19.428887 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93989d87-d2fb-47f7-a27e-031ea06c9398 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:19.444897 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:19.472462 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1034/2083] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:19 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:19.473998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93989d87-d2fb-47f7-a27e-031ea06c9398 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:19.477934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add8816-2acd-4055-b662-ef19ed67bbc9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:19.562806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e01968-a55b-4c36-b87b-63b049111e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:19.563578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e01968-a55b-4c36-b87b-63b049111e6f service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:19.563978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e01968-a55b-4c36-b87b-63b049111e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:19.564346 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e01968-a55b-4c36-b87b-63b049111e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:19.575904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93989d87-d2fb-47f7-a27e-031ea06c9398 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:19.577088 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e01968-a55b-4c36-b87b-63b049111e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:19.578658 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e01968-a55b-4c36-b87b-63b049111e6f service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:19.581465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7cc1d-719f-4cda-8233-244d82c55ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:19.582087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7cc1d-719f-4cda-8233-244d82c55ebb admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:19.583046 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7cc1d-719f-4cda-8233-244d82c55ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:19.583046 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7cc1d-719f-4cda-8233-244d82c55ebb admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:19.583288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7cc1d-719f-4cda-8233-244d82c55ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:19.585269 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7cc1d-719f-4cda-8233-244d82c55ebb admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:19.600699 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1050/2084] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:19.613864 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1035/2085] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:19 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:19.618113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e01968-a55b-4c36-b87b-63b049111e6f service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:19.630824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e01968-a55b-4c36-b87b-63b049111e6f service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:19.637320 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9d9f1-f0d1-42db-999d-a4e239a2fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:19.638095 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9d9f1-f0d1-42db-999d-a4e239a2fdec admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:19.638736 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9d9f1-f0d1-42db-999d-a4e239a2fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:19.638997 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9d9f1-f0d1-42db-999d-a4e239a2fdec admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:19.639727 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9d9f1-f0d1-42db-999d-a4e239a2fdec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:19.642136 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9d9f1-f0d1-42db-999d-a4e239a2fdec admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:19.658872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1051/2086] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:19.660176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7cc1d-719f-4cda-8233-244d82c55ebb admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:19.680540 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7cc1d-719f-4cda-8233-244d82c55ebb admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:19.693357 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18a85b-2939-48ba-8667-519299c94df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:19.694309 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18a85b-2939-48ba-8667-519299c94df1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:19.695065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18a85b-2939-48ba-8667-519299c94df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:19.695602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18a85b-2939-48ba-8667-519299c94df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:19.696695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18a85b-2939-48ba-8667-519299c94df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:19.698740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18a85b-2939-48ba-8667-519299c94df1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:19.711780 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1036/2087] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:19.722084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9d9f1-f0d1-42db-999d-a4e239a2fdec admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:19.752535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9d9f1-f0d1-42db-999d-a4e239a2fdec admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:19.764808 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dbdb0-315a-49d6-b010-468e7099ab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:19.765489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dbdb0-315a-49d6-b010-468e7099ab86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:19.765773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dbdb0-315a-49d6-b010-468e7099ab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:19.766052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dbdb0-315a-49d6-b010-468e7099ab86 admin admin] PATH_INFO: `/v3/projects/289f56b7379e4883a6dc1e341e0b4fd5/users/60efc2d0976c438fb904d943968ea4cc/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:19.804226 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dbdb0-315a-49d6-b010-468e7099ab86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=289f56b7379e4883a6dc1e341e0b4fd5, user_id=60efc2d0976c438fb904d943968ea4cc, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:19.807628 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dbdb0-315a-49d6-b010-468e7099ab86 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:19.826183 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1052/2088] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:19 2022] PUT /identity/v3/projects/289f56b7379e4883a6dc1e341e0b4fd5/users/60efc2d0976c438fb904d943968ea4cc/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:19.838163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6b539-6448-4816-9092-da1926040d75 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:19.838658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6b539-6448-4816-9092-da1926040d75 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:19.839029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6b539-6448-4816-9092-da1926040d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:19.911812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ddf6b539-6448-4816-9092-da1926040d75 None None] MFA Rules not processed for user `60efc2d0976c438fb904d943968ea4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:19.915886 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ddf6b539-6448-4816-9092-da1926040d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:20.111618 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1037/2089] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:20.116387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dbdb0-315a-49d6-b010-468e7099ab86 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:20.120960 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:20.250694 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dbdb0-315a-49d6-b010-468e7099ab86 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:20.256332 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a3db6-81cc-4e6d-83af-56240fe4f802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:20.256993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a3db6-81cc-4e6d-83af-56240fe4f802 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:20.257271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a3db6-81cc-4e6d-83af-56240fe4f802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:20.257539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a3db6-81cc-4e6d-83af-56240fe4f802 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:20.258179 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a3db6-81cc-4e6d-83af-56240fe4f802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:20.264201 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a3db6-81cc-4e6d-83af-56240fe4f802 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:20.287247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6b539-6448-4816-9092-da1926040d75 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:20.288868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ddf6b539-6448-4816-9092-da1926040d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:20.312821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6b539-6448-4816-9092-da1926040d75 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:20.332622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1053/2090] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:20 2022] POST /identity/v3/projects => generated 375 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:20.333524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a3db6-81cc-4e6d-83af-56240fe4f802 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:20.333663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147d166-11c2-4516-bf3d-e20a89d61efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:20.334197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147d166-11c2-4516-bf3d-e20a89d61efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:20.336739 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147d166-11c2-4516-bf3d-e20a89d61efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:20.337201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147d166-11c2-4516-bf3d-e20a89d61efd admin admin] PATH_INFO: `/v3/projects/5b3e1c134820437c8deac4786b91ba43` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:20.350222 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147d166-11c2-4516-bf3d-e20a89d61efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3e1c134820437c8deac4786b91ba43)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:20.353408 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147d166-11c2-4516-bf3d-e20a89d61efd admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:20.420639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a3db6-81cc-4e6d-83af-56240fe4f802 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:20.429904 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f35dab-733b-4a61-9e8b-d96ad5ff0b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:20.430569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f35dab-733b-4a61-9e8b-d96ad5ff0b91 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:20.430942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f35dab-733b-4a61-9e8b-d96ad5ff0b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:20.431236 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f35dab-733b-4a61-9e8b-d96ad5ff0b91 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:20.435725 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f35dab-733b-4a61-9e8b-d96ad5ff0b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:20.437809 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f35dab-733b-4a61-9e8b-d96ad5ff0b91 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:20.477596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1054/2091] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:20 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:20.478497 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f35dab-733b-4a61-9e8b-d96ad5ff0b91 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:20.484628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1147d166-11c2-4516-bf3d-e20a89d61efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3e1c134820437c8deac4786b91ba43', 'request_id': 'req-1147d166-11c2-4516-bf3d-e20a89d61efd'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:20.493556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f35dab-733b-4a61-9e8b-d96ad5ff0b91 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:20.499525 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:20.513343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1147d166-11c2-4516-bf3d-e20a89d61efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3e1c134820437c8deac4786b91ba43', 'request_id': 'req-1147d166-11c2-4516-bf3d-e20a89d61efd'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:20.523807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1147d166-11c2-4516-bf3d-e20a89d61efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3e1c134820437c8deac4786b91ba43', 'request_id': 'req-1147d166-11c2-4516-bf3d-e20a89d61efd'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:20.539361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1147d166-11c2-4516-bf3d-e20a89d61efd admin admin] The token cache is being invalidate because project 5b3e1c134820437c8deac4786b91ba43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:20.539361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1147d166-11c2-4516-bf3d-e20a89d61efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:20.539361 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1147d166-11c2-4516-bf3d-e20a89d61efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:20.541454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1038/2092] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:20 2022] DELETE /identity/v3/projects/5b3e1c134820437c8deac4786b91ba43 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:20.546045 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147d166-11c2-4516-bf3d-e20a89d61efd admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:20.548106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1147d166-11c2-4516-bf3d-e20a89d61efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:20.606475 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd146087-cc03-4c94-ab1f-8e400526a85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:20.607261 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd146087-cc03-4c94-ab1f-8e400526a85d admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:20.607551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd146087-cc03-4c94-ab1f-8e400526a85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:20.607822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd146087-cc03-4c94-ab1f-8e400526a85d admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:20.608693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd146087-cc03-4c94-ab1f-8e400526a85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:20.610670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd146087-cc03-4c94-ab1f-8e400526a85d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:20.624873 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1055/2093] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:20.629892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd146087-cc03-4c94-ab1f-8e400526a85d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:20.632679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fd146087-cc03-4c94-ab1f-8e400526a85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:20.654372 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd146087-cc03-4c94-ab1f-8e400526a85d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:20.654611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147d166-11c2-4516-bf3d-e20a89d61efd admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:20.659873 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b5d36-e37f-4232-8e3f-b5071d4000a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:20.661029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b5d36-e37f-4232-8e3f-b5071d4000a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:20.661206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b5d36-e37f-4232-8e3f-b5071d4000a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:20.661551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89418a8a-a57d-44d2-be1b-e2ff7e424d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:20.661690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b5d36-e37f-4232-8e3f-b5071d4000a8 admin admin] PATH_INFO: `/v3/projects/ad24a468860c4821a02e51f2cbd95fd6/users/beb7341ee9fb412b913f9580d5cdbb97/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:20.664041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89418a8a-a57d-44d2-be1b-e2ff7e424d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:20.664041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89418a8a-a57d-44d2-be1b-e2ff7e424d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:20.664041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89418a8a-a57d-44d2-be1b-e2ff7e424d96 admin admin] PATH_INFO: `/v3/users/fa79e2e228a244f4be4d31df6bdab690` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:20.665115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89418a8a-a57d-44d2-be1b-e2ff7e424d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa79e2e228a244f4be4d31df6bdab690)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:20.667987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89418a8a-a57d-44d2-be1b-e2ff7e424d96 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:20.680902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:20.687378 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b5d36-e37f-4232-8e3f-b5071d4000a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad24a468860c4821a02e51f2cbd95fd6, user_id=beb7341ee9fb412b913f9580d5cdbb97, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:20.692405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b5d36-e37f-4232-8e3f-b5071d4000a8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:20.713808 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1056/2094] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:20 2022] PUT /identity/v3/projects/ad24a468860c4821a02e51f2cbd95fd6/users/beb7341ee9fb412b913f9580d5cdbb97/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:20.719139 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b5d36-e37f-4232-8e3f-b5071d4000a8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:20.768889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-89418a8a-a57d-44d2-be1b-e2ff7e424d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa79e2e228a244f4be4d31df6bdab690'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:20.780064 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-89418a8a-a57d-44d2-be1b-e2ff7e424d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa79e2e228a244f4be4d31df6bdab690'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:20.804341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-89418a8a-a57d-44d2-be1b-e2ff7e424d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa79e2e228a244f4be4d31df6bdab690'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:20.809029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b5d36-e37f-4232-8e3f-b5071d4000a8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:20.815340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-89418a8a-a57d-44d2-be1b-e2ff7e424d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa79e2e228a244f4be4d31df6bdab690'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:20.815819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab3892-c3da-46aa-aeae-364aee3d18ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:20.816378 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-89418a8a-a57d-44d2-be1b-e2ff7e424d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa79e2e228a244f4be4d31df6bdab690'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:20.816709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab3892-c3da-46aa-aeae-364aee3d18ed admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:20.816988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab3892-c3da-46aa-aeae-364aee3d18ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:20.817529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab3892-c3da-46aa-aeae-364aee3d18ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:20.818218 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab3892-c3da-46aa-aeae-364aee3d18ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:20.819827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab3892-c3da-46aa-aeae-364aee3d18ed admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:20.828709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1039/2095] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:20 2022] DELETE /identity/v3/users/fa79e2e228a244f4be4d31df6bdab690 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:20.837730 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1057/2096] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:20.843200 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89418a8a-a57d-44d2-be1b-e2ff7e424d96 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:20.846458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-89418a8a-a57d-44d2-be1b-e2ff7e424d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:20.853324 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab3892-c3da-46aa-aeae-364aee3d18ed admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:20.855504 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-60ab3892-c3da-46aa-aeae-364aee3d18ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:20.894408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab3892-c3da-46aa-aeae-364aee3d18ed admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:20.955778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89418a8a-a57d-44d2-be1b-e2ff7e424d96 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:20.963755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63df3b-afd7-4c3b-a1f6-61e7dd346e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:20.966219 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63df3b-afd7-4c3b-a1f6-61e7dd346e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:20.966560 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63df3b-afd7-4c3b-a1f6-61e7dd346e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:20.966858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63df3b-afd7-4c3b-a1f6-61e7dd346e15 admin admin] PATH_INFO: `/v3/projects/ad24a468860c4821a02e51f2cbd95fd6/users/beb7341ee9fb412b913f9580d5cdbb97/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:20.970290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63df3b-afd7-4c3b-a1f6-61e7dd346e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad24a468860c4821a02e51f2cbd95fd6, user_id=beb7341ee9fb412b913f9580d5cdbb97, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:20.974800 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63df3b-afd7-4c3b-a1f6-61e7dd346e15 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:20.979028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:21.003797 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1040/2097] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:20 2022] PUT /identity/v3/projects/ad24a468860c4821a02e51f2cbd95fd6/users/beb7341ee9fb412b913f9580d5cdbb97/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:21.004193 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bc2cd-f0b6-487e-92db-f45266df387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:21.004193 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bc2cd-f0b6-487e-92db-f45266df387d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:21.004193 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bc2cd-f0b6-487e-92db-f45266df387d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:21.004730 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bc2cd-f0b6-487e-92db-f45266df387d admin admin] PATH_INFO: `/v3/users/abe49b89481a4d41ac4e74ccbdf50e56` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:21.005913 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bc2cd-f0b6-487e-92db-f45266df387d admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe49b89481a4d41ac4e74ccbdf50e56)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:21.007490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2479bd-360f-4227-8f8b-d522eb525360 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:21.007942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bc2cd-f0b6-487e-92db-f45266df387d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:21.008167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2479bd-360f-4227-8f8b-d522eb525360 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:21.008453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2479bd-360f-4227-8f8b-d522eb525360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:21.064787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-cf2479bd-360f-4227-8f8b-d522eb525360 None None] MFA Rules not processed for user `beb7341ee9fb412b913f9580d5cdbb97`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:21.066091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cf2479bd-360f-4227-8f8b-d522eb525360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:21.077615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-db5bc2cd-f0b6-487e-92db-f45266df387d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe49b89481a4d41ac4e74ccbdf50e56'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.092748 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-db5bc2cd-f0b6-487e-92db-f45266df387d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe49b89481a4d41ac4e74ccbdf50e56'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.102436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-db5bc2cd-f0b6-487e-92db-f45266df387d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe49b89481a4d41ac4e74ccbdf50e56'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.113632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-db5bc2cd-f0b6-487e-92db-f45266df387d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe49b89481a4d41ac4e74ccbdf50e56'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.114803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-db5bc2cd-f0b6-487e-92db-f45266df387d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe49b89481a4d41ac4e74ccbdf50e56'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.125073 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1058/2098] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:20 2022] DELETE /identity/v3/users/abe49b89481a4d41ac4e74ccbdf50e56 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:21.149136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1041/2099] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:21.160919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bc2cd-f0b6-487e-92db-f45266df387d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:21.162567 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-db5bc2cd-f0b6-487e-92db-f45266df387d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:21.170195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:21.190074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2479bd-360f-4227-8f8b-d522eb525360 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:21.190074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cf2479bd-360f-4227-8f8b-d522eb525360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:21.282412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bc2cd-f0b6-487e-92db-f45266df387d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:21.288271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4600f-1bcd-4b53-80fe-8218daaa2629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:21.289184 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2479bd-360f-4227-8f8b-d522eb525360 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:21.289798 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4600f-1bcd-4b53-80fe-8218daaa2629 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:21.290186 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4600f-1bcd-4b53-80fe-8218daaa2629 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:21.290459 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4600f-1bcd-4b53-80fe-8218daaa2629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:21.292228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bce4600f-1bcd-4b53-80fe-8218daaa2629 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:21.365605 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfdf4c-e4fe-448f-9ae7-c76d0c1e2832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:21.366300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfdf4c-e4fe-448f-9ae7-c76d0c1e2832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:21.366763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfdf4c-e4fe-448f-9ae7-c76d0c1e2832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:21.367738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfdf4c-e4fe-448f-9ae7-c76d0c1e2832 admin admin] PATH_INFO: `/v3/projects/ec89e20b091a4431aba73e3c026b219c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:21.368766 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfdf4c-e4fe-448f-9ae7-c76d0c1e2832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec89e20b091a4431aba73e3c026b219c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:21.370843 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4600f-1bcd-4b53-80fe-8218daaa2629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:21.371053 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfdf4c-e4fe-448f-9ae7-c76d0c1e2832 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:21.372864 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4600f-1bcd-4b53-80fe-8218daaa2629 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:21.387012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1059/2100] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:21.413216 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:21.456388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4600f-1bcd-4b53-80fe-8218daaa2629 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:21.458260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bce4600f-1bcd-4b53-80fe-8218daaa2629 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:21.464998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-04dfdf4c-e4fe-448f-9ae7-c76d0c1e2832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec89e20b091a4431aba73e3c026b219c', 'request_id': 'req-04dfdf4c-e4fe-448f-9ae7-c76d0c1e2832'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.477004 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-04dfdf4c-e4fe-448f-9ae7-c76d0c1e2832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec89e20b091a4431aba73e3c026b219c', 'request_id': 'req-04dfdf4c-e4fe-448f-9ae7-c76d0c1e2832'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.489695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-04dfdf4c-e4fe-448f-9ae7-c76d0c1e2832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec89e20b091a4431aba73e3c026b219c', 'request_id': 'req-04dfdf4c-e4fe-448f-9ae7-c76d0c1e2832'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.493469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4600f-1bcd-4b53-80fe-8218daaa2629 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:21.518369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-04dfdf4c-e4fe-448f-9ae7-c76d0c1e2832 admin admin] The token cache is being invalidate because project ec89e20b091a4431aba73e3c026b219c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:21.526630 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-04dfdf4c-e4fe-448f-9ae7-c76d0c1e2832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.527840 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-04dfdf4c-e4fe-448f-9ae7-c76d0c1e2832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.529693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1042/2101] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:21 2022] DELETE /identity/v3/projects/ec89e20b091a4431aba73e3c026b219c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:21.534680 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b93e3-7b8f-4616-acee-1532e2d24abb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:21.534968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b93e3-7b8f-4616-acee-1532e2d24abb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:21.535245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b93e3-7b8f-4616-acee-1532e2d24abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:21.555971 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-942b93e3-7b8f-4616-acee-1532e2d24abb None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:21.557238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-942b93e3-7b8f-4616-acee-1532e2d24abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:21.569640 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f572c82-42dc-4ef5-8611-d3849064d0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:21.570345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f572c82-42dc-4ef5-8611-d3849064d0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:21.570767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f572c82-42dc-4ef5-8611-d3849064d0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:21.571046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f572c82-42dc-4ef5-8611-d3849064d0a0 admin admin] PATH_INFO: `/v3/projects/f317f083cc2d4dd2801a266b8c6cdfbe` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:21.572370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f572c82-42dc-4ef5-8611-d3849064d0a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f317f083cc2d4dd2801a266b8c6cdfbe)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:21.575387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f572c82-42dc-4ef5-8611-d3849064d0a0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:21.642141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1043/2102] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:21.649741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134fac7-91a5-4c99-bc9b-a79c762a85fd None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:21.650093 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134fac7-91a5-4c99-bc9b-a79c762a85fd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:21.650432 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134fac7-91a5-4c99-bc9b-a79c762a85fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:21.661626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f572c82-42dc-4ef5-8611-d3849064d0a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f317f083cc2d4dd2801a266b8c6cdfbe', 'request_id': 'req-4f572c82-42dc-4ef5-8611-d3849064d0a0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.671957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f572c82-42dc-4ef5-8611-d3849064d0a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f317f083cc2d4dd2801a266b8c6cdfbe', 'request_id': 'req-4f572c82-42dc-4ef5-8611-d3849064d0a0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.677955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:21.680015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8134fac7-91a5-4c99-bc9b-a79c762a85fd None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:21.681401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8134fac7-91a5-4c99-bc9b-a79c762a85fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:21.686787 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f572c82-42dc-4ef5-8611-d3849064d0a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f317f083cc2d4dd2801a266b8c6cdfbe', 'request_id': 'req-4f572c82-42dc-4ef5-8611-d3849064d0a0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.702596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f572c82-42dc-4ef5-8611-d3849064d0a0 admin admin] The token cache is being invalidate because project f317f083cc2d4dd2801a266b8c6cdfbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:21.702898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f572c82-42dc-4ef5-8611-d3849064d0a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.703719 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f572c82-42dc-4ef5-8611-d3849064d0a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.705274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1060/2103] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:21 2022] DELETE /identity/v3/projects/f317f083cc2d4dd2801a266b8c6cdfbe => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:21.706267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f572c82-42dc-4ef5-8611-d3849064d0a0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:21.707990 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4f572c82-42dc-4ef5-8611-d3849064d0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:21.782095 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1044/2104] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:21.783718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783250c-b00b-4e37-acbf-e79bd36808a7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:21.784012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783250c-b00b-4e37-acbf-e79bd36808a7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:21.784290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783250c-b00b-4e37-acbf-e79bd36808a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:21.806709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0783250c-b00b-4e37-acbf-e79bd36808a7 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:21.807987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0783250c-b00b-4e37-acbf-e79bd36808a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:21.811680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f572c82-42dc-4ef5-8611-d3849064d0a0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:21.817014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1045/2105] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:21.817344 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46788d-673c-47a7-9a40-141f5d732118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:21.817807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783250c-b00b-4e37-acbf-e79bd36808a7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:21.818082 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46788d-673c-47a7-9a40-141f5d732118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:21.818373 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46788d-673c-47a7-9a40-141f5d732118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:21.818637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46788d-673c-47a7-9a40-141f5d732118 admin admin] PATH_INFO: `/v3/users/74ca833f8e1d4274a3f4cd83dfb7b69a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:21.819959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46788d-673c-47a7-9a40-141f5d732118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74ca833f8e1d4274a3f4cd83dfb7b69a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:21.821999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46788d-673c-47a7-9a40-141f5d732118 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:21.835635 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783250c-b00b-4e37-acbf-e79bd36808a7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:21.842056 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e75ca-722f-45b5-be96-0e5d7cc6bd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:21.842834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e75ca-722f-45b5-be96-0e5d7cc6bd9a admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:21.843271 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e75ca-722f-45b5-be96-0e5d7cc6bd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:21.843691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e75ca-722f-45b5-be96-0e5d7cc6bd9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:21.844991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e75ca-722f-45b5-be96-0e5d7cc6bd9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:21.845291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e75ca-722f-45b5-be96-0e5d7cc6bd9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:21.847103 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e75ca-722f-45b5-be96-0e5d7cc6bd9a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:21.860494 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1046/2106] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:26:21.862184 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e4c38-8521-45d7-8bde-058cfa985864 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:21.862514 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e4c38-8521-45d7-8bde-058cfa985864 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:21.862814 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e4c38-8521-45d7-8bde-058cfa985864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:21.874288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ff46788d-673c-47a7-9a40-141f5d732118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74ca833f8e1d4274a3f4cd83dfb7b69a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.885512 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a10e4c38-8521-45d7-8bde-058cfa985864 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:21.886839 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a10e4c38-8521-45d7-8bde-058cfa985864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:21.886997 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ff46788d-673c-47a7-9a40-141f5d732118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74ca833f8e1d4274a3f4cd83dfb7b69a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.896681 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1047/2107] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:21.897305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e4c38-8521-45d7-8bde-058cfa985864 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:21.900776 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ff46788d-673c-47a7-9a40-141f5d732118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74ca833f8e1d4274a3f4cd83dfb7b69a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.908688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e4c38-8521-45d7-8bde-058cfa985864 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:21.911039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ff46788d-673c-47a7-9a40-141f5d732118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74ca833f8e1d4274a3f4cd83dfb7b69a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.911785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ff46788d-673c-47a7-9a40-141f5d732118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74ca833f8e1d4274a3f4cd83dfb7b69a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:21.913709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0175d-018c-4b8f-91b0-a32c38f6b638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:21.914303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0175d-018c-4b8f-91b0-a32c38f6b638 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:21.914584 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0175d-018c-4b8f-91b0-a32c38f6b638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:21.914851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0175d-018c-4b8f-91b0-a32c38f6b638 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:21.915500 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0175d-018c-4b8f-91b0-a32c38f6b638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:21.917486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0175d-018c-4b8f-91b0-a32c38f6b638 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:21.921647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1061/2108] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:21 2022] DELETE /identity/v3/users/74ca833f8e1d4274a3f4cd83dfb7b69a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:21.921647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46788d-673c-47a7-9a40-141f5d732118 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:21.922504 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ff46788d-673c-47a7-9a40-141f5d732118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:21.950197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1048/2109] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:21 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:21.950197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e42fa2-c321-433a-ab83-87afa320afc6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:21.950197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e42fa2-c321-433a-ab83-87afa320afc6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:21.950197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e42fa2-c321-433a-ab83-87afa320afc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:21.969102 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-83e42fa2-c321-433a-ab83-87afa320afc6 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:21.970689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-83e42fa2-c321-433a-ab83-87afa320afc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:21.974450 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:21.991916 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46788d-673c-47a7-9a40-141f5d732118 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:22.004703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:22.050768 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1049/2110] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:22.051972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e42fa2-c321-433a-ab83-87afa320afc6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:22.053518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-83e42fa2-c321-433a-ab83-87afa320afc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:22.065999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce01e6-52c0-4bde-b988-e8ca211b9f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:22.066971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce01e6-52c0-4bde-b988-e8ca211b9f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.067256 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce01e6-52c0-4bde-b988-e8ca211b9f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.067614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce01e6-52c0-4bde-b988-e8ca211b9f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.068224 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e42fa2-c321-433a-ab83-87afa320afc6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:22.068465 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce01e6-52c0-4bde-b988-e8ca211b9f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:22.068846 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce01e6-52c0-4bde-b988-e8ca211b9f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:22.070631 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce01e6-52c0-4bde-b988-e8ca211b9f92 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:22.073586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab77760-5d7c-455a-9d82-eb72997406e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:22.074186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab77760-5d7c-455a-9d82-eb72997406e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.074467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab77760-5d7c-455a-9d82-eb72997406e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.075327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab77760-5d7c-455a-9d82-eb72997406e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.075963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab77760-5d7c-455a-9d82-eb72997406e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:22.078434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab77760-5d7c-455a-9d82-eb72997406e0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:22.084932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1062/2111] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:26:22.085973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce01e6-52c0-4bde-b988-e8ca211b9f92 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:22.087755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a8ce01e6-52c0-4bde-b988-e8ca211b9f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:22.114514 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1050/2112] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:22 2022] POST /identity/v3/users => generated 287 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:22.115521 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab77760-5d7c-455a-9d82-eb72997406e0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:22.125998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab77760-5d7c-455a-9d82-eb72997406e0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:22.130967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c691646-d2ea-47f4-9aad-0d946c60fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:22.131603 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c691646-d2ea-47f4-9aad-0d946c60fd6d admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.131871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c691646-d2ea-47f4-9aad-0d946c60fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.132146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c691646-d2ea-47f4-9aad-0d946c60fd6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.132794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c691646-d2ea-47f4-9aad-0d946c60fd6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:22.134796 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c691646-d2ea-47f4-9aad-0d946c60fd6d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:22.157567 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce01e6-52c0-4bde-b988-e8ca211b9f92 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:22.161614 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f7f1f-b132-4fc6-9b1d-6f0cd5d3b97e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:22.162221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f7f1f-b132-4fc6-9b1d-6f0cd5d3b97e service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.162666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f7f1f-b132-4fc6-9b1d-6f0cd5d3b97e service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.162979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f7f1f-b132-4fc6-9b1d-6f0cd5d3b97e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.164542 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1051/2113] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:22 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:22.165573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c691646-d2ea-47f4-9aad-0d946c60fd6d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:22.179416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f7f1f-b132-4fc6-9b1d-6f0cd5d3b97e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:22.180898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f7f1f-b132-4fc6-9b1d-6f0cd5d3b97e service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:22.191819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1063/2114] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:22.192712 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f7f1f-b132-4fc6-9b1d-6f0cd5d3b97e service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:22.203459 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f7f1f-b132-4fc6-9b1d-6f0cd5d3b97e service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:22.242263 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c691646-d2ea-47f4-9aad-0d946c60fd6d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:22.248086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7762f5-ebc2-4b2d-9ab2-bacf04ee7db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:22.248733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7762f5-ebc2-4b2d-9ab2-bacf04ee7db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.249029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7762f5-ebc2-4b2d-9ab2-bacf04ee7db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.249339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7762f5-ebc2-4b2d-9ab2-bacf04ee7db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.249925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7762f5-ebc2-4b2d-9ab2-bacf04ee7db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:22.251686 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7762f5-ebc2-4b2d-9ab2-bacf04ee7db2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:22.263878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1052/2115] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:22.268271 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7762f5-ebc2-4b2d-9ab2-bacf04ee7db2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:22.271335 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5a606-c1df-4661-90bc-09ccc0493d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:22.272361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5a606-c1df-4661-90bc-09ccc0493d46 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.272783 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5a606-c1df-4661-90bc-09ccc0493d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.273171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5a606-c1df-4661-90bc-09ccc0493d46 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.273944 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5a606-c1df-4661-90bc-09ccc0493d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:22.276203 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5a606-c1df-4661-90bc-09ccc0493d46 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:22.279552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7762f5-ebc2-4b2d-9ab2-bacf04ee7db2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:22.285211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ea6fd-2540-45d7-88a8-4a200d87164a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:22.285812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ea6fd-2540-45d7-88a8-4a200d87164a admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.286088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ea6fd-2540-45d7-88a8-4a200d87164a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.286360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ea6fd-2540-45d7-88a8-4a200d87164a admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.286998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ea6fd-2540-45d7-88a8-4a200d87164a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:22.288771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ea6fd-2540-45d7-88a8-4a200d87164a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:22.300696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1053/2116] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:22.302082 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1064/2117] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:22 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:22.306137 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ea6fd-2540-45d7-88a8-4a200d87164a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:22.310187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5a606-c1df-4661-90bc-09ccc0493d46 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:22.317562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ea6fd-2540-45d7-88a8-4a200d87164a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:22.322429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d3a68-0a86-47bf-a27d-06ff7528783c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:22.323082 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d3a68-0a86-47bf-a27d-06ff7528783c admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.323210 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5a606-c1df-4661-90bc-09ccc0493d46 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:22.323362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d3a68-0a86-47bf-a27d-06ff7528783c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.323635 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d3a68-0a86-47bf-a27d-06ff7528783c admin admin] PATH_INFO: `/v3/projects/e786ed7142064c34b03321cf33c94f24/users/e56c5bc58e9844fa915136bd8dc37390/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.330406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e754d7-4ae2-4d80-bf41-d1c51287724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:22.331009 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e754d7-4ae2-4d80-bf41-d1c51287724f admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.331283 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e754d7-4ae2-4d80-bf41-d1c51287724f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.332008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e754d7-4ae2-4d80-bf41-d1c51287724f admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.332559 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e754d7-4ae2-4d80-bf41-d1c51287724f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:22.334177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e754d7-4ae2-4d80-bf41-d1c51287724f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:22.340967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d3a68-0a86-47bf-a27d-06ff7528783c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e786ed7142064c34b03321cf33c94f24, user_id=e56c5bc58e9844fa915136bd8dc37390, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:22.343254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d3a68-0a86-47bf-a27d-06ff7528783c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:22.344841 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1065/2118] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:22.350089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e754d7-4ae2-4d80-bf41-d1c51287724f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:22.370988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e754d7-4ae2-4d80-bf41-d1c51287724f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:22.380685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1054/2119] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:22 2022] PUT /identity/v3/projects/e786ed7142064c34b03321cf33c94f24/users/e56c5bc58e9844fa915136bd8dc37390/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:22.395137 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524529a-d6a1-42da-95f6-b450c8680865 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.395659 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524529a-d6a1-42da-95f6-b450c8680865 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.396121 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524529a-d6a1-42da-95f6-b450c8680865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.429043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:22.444562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c524529a-d6a1-42da-95f6-b450c8680865 None None] MFA Rules not processed for user `e56c5bc58e9844fa915136bd8dc37390`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:22.446478 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c524529a-d6a1-42da-95f6-b450c8680865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:22.467586 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457da1e-bf20-46f6-9d4e-dfaecbc68692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:22.468200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457da1e-bf20-46f6-9d4e-dfaecbc68692 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.468480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457da1e-bf20-46f6-9d4e-dfaecbc68692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.468791 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457da1e-bf20-46f6-9d4e-dfaecbc68692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.469575 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457da1e-bf20-46f6-9d4e-dfaecbc68692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:22.471498 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457da1e-bf20-46f6-9d4e-dfaecbc68692 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:22.472958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:22.503795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1066/2120] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:22.505094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457da1e-bf20-46f6-9d4e-dfaecbc68692 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:22.525344 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457da1e-bf20-46f6-9d4e-dfaecbc68692 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:22.533131 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4a7c9-cc8a-417b-acd5-bbe3756d02bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:22.533805 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4a7c9-cc8a-417b-acd5-bbe3756d02bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.534088 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4a7c9-cc8a-417b-acd5-bbe3756d02bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.534371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4a7c9-cc8a-417b-acd5-bbe3756d02bc admin admin] PATH_INFO: `/v3/projects/2113110ea4e44086b449f3c20ce70432/users/3785c2b13a644a5693de86af9e79f5b3/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.561669 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1055/2121] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:22.561669 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524529a-d6a1-42da-95f6-b450c8680865 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:22.564948 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4a7c9-cc8a-417b-acd5-bbe3756d02bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2113110ea4e44086b449f3c20ce70432, user_id=3785c2b13a644a5693de86af9e79f5b3, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:22.566287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c524529a-d6a1-42da-95f6-b450c8680865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:22.568986 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4a7c9-cc8a-417b-acd5-bbe3756d02bc admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:22.584445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524529a-d6a1-42da-95f6-b450c8680865 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:22.590330 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1067/2122] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:22 2022] PUT /identity/v3/projects/2113110ea4e44086b449f3c20ce70432/users/3785c2b13a644a5693de86af9e79f5b3/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:22.591957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4a7c9-cc8a-417b-acd5-bbe3756d02bc admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:22.593688 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d1b4a7c9-cc8a-417b-acd5-bbe3756d02bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:22.661904 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4a7c9-cc8a-417b-acd5-bbe3756d02bc admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:22.666047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1a4a4-1c71-458b-bda6-09e2345fd1ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:22.666653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1a4a4-1c71-458b-bda6-09e2345fd1ee service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.666984 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1a4a4-1c71-458b-bda6-09e2345fd1ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.667262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1a4a4-1c71-458b-bda6-09e2345fd1ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.672543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:22.673200 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.673530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.673750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8 admin admin] PATH_INFO: `/v3/projects/66878032a9104a75a24f7327bbd1d9c9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.675150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66878032a9104a75a24f7327bbd1d9c9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:22.677103 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:22.730174 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66878032a9104a75a24f7327bbd1d9c9', 'request_id': 'req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:22.730765 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1a4a4-1c71-458b-bda6-09e2345fd1ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:22.732243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1a4a4-1c71-458b-bda6-09e2345fd1ee service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:22.738088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66878032a9104a75a24f7327bbd1d9c9', 'request_id': 'req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:22.741876 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1068/2123] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:22.743097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf6243-fbe3-49a5-96ec-9c250d735d89 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.743387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf6243-fbe3-49a5-96ec-9c250d735d89 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.743660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf6243-fbe3-49a5-96ec-9c250d735d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.746531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66878032a9104a75a24f7327bbd1d9c9', 'request_id': 'req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:22.757158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8 admin admin] The token cache is being invalidate because project 66878032a9104a75a24f7327bbd1d9c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:22.757447 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:22.758107 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:22.759677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1056/2124] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:22 2022] DELETE /identity/v3/projects/66878032a9104a75a24f7327bbd1d9c9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:22.765392 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:22.766830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:22.783468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-09bf6243-fbe3-49a5-96ec-9c250d735d89 None None] MFA Rules not processed for user `3785c2b13a644a5693de86af9e79f5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:22.784906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-09bf6243-fbe3-49a5-96ec-9c250d735d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:22.830628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:22.838564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:22.859476 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3f0ab-b7d7-4608-98c9-37ca6de6f0b8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:22.863502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1069/2125] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:22.864858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf6243-fbe3-49a5-96ec-9c250d735d89 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:22.867845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-09bf6243-fbe3-49a5-96ec-9c250d735d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:22.867965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b883c-bade-4a79-8993-ce9bed330ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:22.867965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b883c-bade-4a79-8993-ce9bed330ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.868122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b883c-bade-4a79-8993-ce9bed330ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.868621 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b883c-bade-4a79-8993-ce9bed330ee2 admin admin] PATH_INFO: `/v3/users/93fda6eb69a8491e89bc2c2f40e38db4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.869546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b883c-bade-4a79-8993-ce9bed330ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93fda6eb69a8491e89bc2c2f40e38db4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:22.871496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b883c-bade-4a79-8993-ce9bed330ee2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:22.888465 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf6243-fbe3-49a5-96ec-9c250d735d89 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:22.893527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f428a-c4f0-4284-995e-7e79ac382a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:22.894158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f428a-c4f0-4284-995e-7e79ac382a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:22.894435 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f428a-c4f0-4284-995e-7e79ac382a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:22.894704 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f428a-c4f0-4284-995e-7e79ac382a4c admin admin] PATH_INFO: `/v3/users/e56c5bc58e9844fa915136bd8dc37390` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:22.895839 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f428a-c4f0-4284-995e-7e79ac382a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56c5bc58e9844fa915136bd8dc37390)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:22.897784 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f428a-c4f0-4284-995e-7e79ac382a4c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:22.927677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4f8b883c-bade-4a79-8993-ce9bed330ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93fda6eb69a8491e89bc2c2f40e38db4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:22.942621 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4f8b883c-bade-4a79-8993-ce9bed330ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93fda6eb69a8491e89bc2c2f40e38db4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:22.967685 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-364f428a-c4f0-4284-995e-7e79ac382a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56c5bc58e9844fa915136bd8dc37390'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:22.968848 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4f8b883c-bade-4a79-8993-ce9bed330ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93fda6eb69a8491e89bc2c2f40e38db4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:22.983925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4f8b883c-bade-4a79-8993-ce9bed330ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93fda6eb69a8491e89bc2c2f40e38db4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:22.985039 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4f8b883c-bade-4a79-8993-ce9bed330ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93fda6eb69a8491e89bc2c2f40e38db4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:22.988642 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-364f428a-c4f0-4284-995e-7e79ac382a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56c5bc58e9844fa915136bd8dc37390'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:22.991663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1057/2126] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:22 2022] DELETE /identity/v3/users/93fda6eb69a8491e89bc2c2f40e38db4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:22.992936 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b883c-bade-4a79-8993-ce9bed330ee2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:22.998499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4f8b883c-bade-4a79-8993-ce9bed330ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:23.002352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-364f428a-c4f0-4284-995e-7e79ac382a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56c5bc58e9844fa915136bd8dc37390'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.011792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-364f428a-c4f0-4284-995e-7e79ac382a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56c5bc58e9844fa915136bd8dc37390'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.013406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-364f428a-c4f0-4284-995e-7e79ac382a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56c5bc58e9844fa915136bd8dc37390'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.024859 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1070/2127] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:22 2022] DELETE /identity/v3/users/e56c5bc58e9844fa915136bd8dc37390 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:23.031121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b52f4-da32-4ca4-b2f1-3ddd9c8c7df7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:23.031269 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b52f4-da32-4ca4-b2f1-3ddd9c8c7df7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:23.031771 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b52f4-da32-4ca4-b2f1-3ddd9c8c7df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:23.055143 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-462b52f4-da32-4ca4-b2f1-3ddd9c8c7df7 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:23.056409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-462b52f4-da32-4ca4-b2f1-3ddd9c8c7df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:23.101772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b883c-bade-4a79-8993-ce9bed330ee2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:23.130376 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1071/2128] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:23.140972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b52f4-da32-4ca4-b2f1-3ddd9c8c7df7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:23.142486 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-462b52f4-da32-4ca4-b2f1-3ddd9c8c7df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:23.186573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4b99f-3d61-48b0-b96f-a3a638ddec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:23.187427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4b99f-3d61-48b0-b96f-a3a638ddec72 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:23.187710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4b99f-3d61-48b0-b96f-a3a638ddec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:23.188135 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4b99f-3d61-48b0-b96f-a3a638ddec72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:23.189380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4b99f-3d61-48b0-b96f-a3a638ddec72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:23.191640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4b99f-3d61-48b0-b96f-a3a638ddec72 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:23.207804 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b52f4-da32-4ca4-b2f1-3ddd9c8c7df7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:23.213299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd3d8b-4cda-4dd8-8153-26ce6d5e9588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:23.213997 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd3d8b-4cda-4dd8-8153-26ce6d5e9588 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:23.214303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd3d8b-4cda-4dd8-8153-26ce6d5e9588 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:23.214564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd3d8b-4cda-4dd8-8153-26ce6d5e9588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:23.227674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1058/2129] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:22 2022] POST /identity/v3/projects => generated 365 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:23.231265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd3d8b-4cda-4dd8-8153-26ce6d5e9588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:23.231695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4b99f-3d61-48b0-b96f-a3a638ddec72 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:23.233265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd3d8b-4cda-4dd8-8153-26ce6d5e9588 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:23.234210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-53b4b99f-3d61-48b0-b96f-a3a638ddec72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:23.240017 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:23.244392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1072/2130] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:23.324262 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4b99f-3d61-48b0-b96f-a3a638ddec72 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:23.330092 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09762f8b-b4f1-4a20-ab59-43e987bfa72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:23.330828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09762f8b-b4f1-4a20-ab59-43e987bfa72c admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:23.331113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09762f8b-b4f1-4a20-ab59-43e987bfa72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:23.331299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09762f8b-b4f1-4a20-ab59-43e987bfa72c admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:23.332046 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09762f8b-b4f1-4a20-ab59-43e987bfa72c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:23.334075 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09762f8b-b4f1-4a20-ab59-43e987bfa72c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:23.339447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd3d8b-4cda-4dd8-8153-26ce6d5e9588 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:23.341368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-27cd3d8b-4cda-4dd8-8153-26ce6d5e9588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:23.350174 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:23.357063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd3d8b-4cda-4dd8-8153-26ce6d5e9588 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:23.368548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16c9e9-bc93-4637-9319-b101e3756e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:23.369528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16c9e9-bc93-4637-9319-b101e3756e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:23.370262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16c9e9-bc93-4637-9319-b101e3756e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:23.370645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16c9e9-bc93-4637-9319-b101e3756e8d admin admin] PATH_INFO: `/v3/projects/393aed16522a449da4ffdff4ac93f87c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:23.372725 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16c9e9-bc93-4637-9319-b101e3756e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=393aed16522a449da4ffdff4ac93f87c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:23.376892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16c9e9-bc93-4637-9319-b101e3756e8d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:23.390625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1059/2131] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:23 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:23.391998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09762f8b-b4f1-4a20-ab59-43e987bfa72c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:23.404419 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09762f8b-b4f1-4a20-ab59-43e987bfa72c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:23.411452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bc7c1-b4e9-488c-8fcd-100b25758c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:23.412339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bc7c1-b4e9-488c-8fcd-100b25758c82 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:23.412941 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bc7c1-b4e9-488c-8fcd-100b25758c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:23.413285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bc7c1-b4e9-488c-8fcd-100b25758c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:23.414624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bc7c1-b4e9-488c-8fcd-100b25758c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:23.416765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bc7c1-b4e9-488c-8fcd-100b25758c82 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:23.431027 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8a16c9e9-bc93-4637-9319-b101e3756e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393aed16522a449da4ffdff4ac93f87c', 'request_id': 'req-8a16c9e9-bc93-4637-9319-b101e3756e8d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.436634 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1060/2132] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:23.436634 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bc7c1-b4e9-488c-8fcd-100b25758c82 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:23.439270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8a16c9e9-bc93-4637-9319-b101e3756e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393aed16522a449da4ffdff4ac93f87c', 'request_id': 'req-8a16c9e9-bc93-4637-9319-b101e3756e8d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.450891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8a16c9e9-bc93-4637-9319-b101e3756e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393aed16522a449da4ffdff4ac93f87c', 'request_id': 'req-8a16c9e9-bc93-4637-9319-b101e3756e8d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.463670 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bc7c1-b4e9-488c-8fcd-100b25758c82 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:23.468038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8a16c9e9-bc93-4637-9319-b101e3756e8d admin admin] The token cache is being invalidate because project 393aed16522a449da4ffdff4ac93f87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:23.468449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8a16c9e9-bc93-4637-9319-b101e3756e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.469245 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8a16c9e9-bc93-4637-9319-b101e3756e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.471066 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1073/2133] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:23 2022] DELETE /identity/v3/projects/393aed16522a449da4ffdff4ac93f87c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:23.475323 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16c9e9-bc93-4637-9319-b101e3756e8d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:23.477255 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8a16c9e9-bc93-4637-9319-b101e3756e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:23.546163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb62844-78cb-4637-8110-cfcb3fe68b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:23.546842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb62844-78cb-4637-8110-cfcb3fe68b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:23.547310 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb62844-78cb-4637-8110-cfcb3fe68b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:23.548696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb62844-78cb-4637-8110-cfcb3fe68b3e admin admin] PATH_INFO: `/v3/projects/76a6ab13b29b490dbf4968ce13b2bc64/users/f0ae2dcea6d4466c8fac4e0257d16de6/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:23.562595 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16c9e9-bc93-4637-9319-b101e3756e8d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:23.567697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05278377-4c49-4292-87c5-b9da22457915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:23.568293 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05278377-4c49-4292-87c5-b9da22457915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:23.568571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05278377-4c49-4292-87c5-b9da22457915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:23.568890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05278377-4c49-4292-87c5-b9da22457915 admin admin] PATH_INFO: `/v3/users/c834ce9d518546fa8b507e6ece0728ff` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:23.570109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05278377-4c49-4292-87c5-b9da22457915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c834ce9d518546fa8b507e6ece0728ff)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:23.571974 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb62844-78cb-4637-8110-cfcb3fe68b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a6ab13b29b490dbf4968ce13b2bc64, user_id=f0ae2dcea6d4466c8fac4e0257d16de6, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:23.572174 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05278377-4c49-4292-87c5-b9da22457915 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:23.574769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb62844-78cb-4637-8110-cfcb3fe68b3e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:23.590825 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1061/2134] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:23 2022] PUT /identity/v3/projects/76a6ab13b29b490dbf4968ce13b2bc64/users/f0ae2dcea6d4466c8fac4e0257d16de6/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:23.592130 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb62844-78cb-4637-8110-cfcb3fe68b3e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:23.594179 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6cb62844-78cb-4637-8110-cfcb3fe68b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:23.635432 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-05278377-4c49-4292-87c5-b9da22457915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c834ce9d518546fa8b507e6ece0728ff'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.648352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-05278377-4c49-4292-87c5-b9da22457915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c834ce9d518546fa8b507e6ece0728ff'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.655922 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-05278377-4c49-4292-87c5-b9da22457915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c834ce9d518546fa8b507e6ece0728ff'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.663263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-05278377-4c49-4292-87c5-b9da22457915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c834ce9d518546fa8b507e6ece0728ff'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.663918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-05278377-4c49-4292-87c5-b9da22457915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c834ce9d518546fa8b507e6ece0728ff'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.670486 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1074/2135] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:23 2022] DELETE /identity/v3/users/c834ce9d518546fa8b507e6ece0728ff => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:23.671331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05278377-4c49-4292-87c5-b9da22457915 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:23.673671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-05278377-4c49-4292-87c5-b9da22457915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:23.679051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb62844-78cb-4637-8110-cfcb3fe68b3e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:23.682150 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:23.709190 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:23.778727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8523bf-586d-47b4-aa96-f8b2a8adb558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:23.779966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8523bf-586d-47b4-aa96-f8b2a8adb558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:23.780313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8523bf-586d-47b4-aa96-f8b2a8adb558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:23.780814 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8523bf-586d-47b4-aa96-f8b2a8adb558 admin admin] PATH_INFO: `/v3/projects/e786ed7142064c34b03321cf33c94f24` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:23.783150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8523bf-586d-47b4-aa96-f8b2a8adb558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e786ed7142064c34b03321cf33c94f24)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:23.786579 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8523bf-586d-47b4-aa96-f8b2a8adb558 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:23.797639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05278377-4c49-4292-87c5-b9da22457915 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:23.803431 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07fede-4dfb-4061-b7e2-da2aaa3e7831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:23.803975 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07fede-4dfb-4061-b7e2-da2aaa3e7831 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:23.805913 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07fede-4dfb-4061-b7e2-da2aaa3e7831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:23.806198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07fede-4dfb-4061-b7e2-da2aaa3e7831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:23.806874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07fede-4dfb-4061-b7e2-da2aaa3e7831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:23.808492 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07fede-4dfb-4061-b7e2-da2aaa3e7831 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:23.823922 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1075/2136] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:23.825101 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07fede-4dfb-4061-b7e2-da2aaa3e7831 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:23.836466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07fede-4dfb-4061-b7e2-da2aaa3e7831 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:23.844490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ea10f-b253-4746-8b80-b068ed2a7b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:23.846267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea10f-b253-4746-8b80-b068ed2a7b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:23.846733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea10f-b253-4746-8b80-b068ed2a7b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:23.847181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea10f-b253-4746-8b80-b068ed2a7b6f admin admin] PATH_INFO: `/v3/projects/76a6ab13b29b490dbf4968ce13b2bc64/users/f0ae2dcea6d4466c8fac4e0257d16de6/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:23.857378 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ea10f-b253-4746-8b80-b068ed2a7b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a6ab13b29b490dbf4968ce13b2bc64, user_id=f0ae2dcea6d4466c8fac4e0257d16de6, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:23.860303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ea10f-b253-4746-8b80-b068ed2a7b6f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:23.893416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1076/2137] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:23 2022] PUT /identity/v3/projects/76a6ab13b29b490dbf4968ce13b2bc64/users/f0ae2dcea6d4466c8fac4e0257d16de6/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:23.893606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c8523bf-586d-47b4-aa96-f8b2a8adb558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e786ed7142064c34b03321cf33c94f24', 'request_id': 'req-2c8523bf-586d-47b4-aa96-f8b2a8adb558'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.895077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf2428-9157-4cf6-9350-17f546b216a3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:23.895437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf2428-9157-4cf6-9350-17f546b216a3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:23.895899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf2428-9157-4cf6-9350-17f546b216a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:23.901120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c8523bf-586d-47b4-aa96-f8b2a8adb558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e786ed7142064c34b03321cf33c94f24', 'request_id': 'req-2c8523bf-586d-47b4-aa96-f8b2a8adb558'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.909620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c8523bf-586d-47b4-aa96-f8b2a8adb558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e786ed7142064c34b03321cf33c94f24', 'request_id': 'req-2c8523bf-586d-47b4-aa96-f8b2a8adb558'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.929667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c8523bf-586d-47b4-aa96-f8b2a8adb558 admin admin] The token cache is being invalidate because project e786ed7142064c34b03321cf33c94f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:23.929910 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1adf2428-9157-4cf6-9350-17f546b216a3 None None] MFA Rules not processed for user `f0ae2dcea6d4466c8fac4e0257d16de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:23.930013 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c8523bf-586d-47b4-aa96-f8b2a8adb558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.930593 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c8523bf-586d-47b4-aa96-f8b2a8adb558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:23.930932 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1adf2428-9157-4cf6-9350-17f546b216a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:23.932091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1062/2138] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:23 2022] DELETE /identity/v3/projects/e786ed7142064c34b03321cf33c94f24 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:23.937798 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db2648-49ce-4423-afd9-343574d3c513 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:23.937798 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db2648-49ce-4423-afd9-343574d3c513 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:23.938056 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db2648-49ce-4423-afd9-343574d3c513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:23.958995 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-71db2648-49ce-4423-afd9-343574d3c513 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:23.960244 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-71db2648-49ce-4423-afd9-343574d3c513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:24.016888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1077/2139] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:24.030543 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf2428-9157-4cf6-9350-17f546b216a3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.033228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1adf2428-9157-4cf6-9350-17f546b216a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:24.057541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1063/2140] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:24.058658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db2648-49ce-4423-afd9-343574d3c513 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.060850 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-71db2648-49ce-4423-afd9-343574d3c513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:24.120967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:24.132104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf2428-9157-4cf6-9350-17f546b216a3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:24.134671 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db2648-49ce-4423-afd9-343574d3c513 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:24.136634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dca86-53d4-49a5-a804-83af93437eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:24.137338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dca86-53d4-49a5-a804-83af93437eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.137611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dca86-53d4-49a5-a804-83af93437eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.137880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dca86-53d4-49a5-a804-83af93437eb6 admin admin] PATH_INFO: `/v3/projects/43ba33d6a3454c91a6b57830b91568e6` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.139020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825dca86-53d4-49a5-a804-83af93437eb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ba33d6a3454c91a6b57830b91568e6)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:24.139220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5e499-e253-46c4-8ad4-2472acf83682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:24.139819 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e499-e253-46c4-8ad4-2472acf83682 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.140098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e499-e253-46c4-8ad4-2472acf83682 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.140370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e499-e253-46c4-8ad4-2472acf83682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.140960 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825dca86-53d4-49a5-a804-83af93437eb6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:24.149837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5e499-e253-46c4-8ad4-2472acf83682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:24.151344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5e499-e253-46c4-8ad4-2472acf83682 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:24.157184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:24.161567 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1064/2141] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:24.162847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc11a7d-bdbd-4950-a00f-999d118d86fb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.163225 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc11a7d-bdbd-4950-a00f-999d118d86fb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.163595 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc11a7d-bdbd-4950-a00f-999d118d86fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.186209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fdc11a7d-bdbd-4950-a00f-999d118d86fb None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:24.187708 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fdc11a7d-bdbd-4950-a00f-999d118d86fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:24.195523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-825dca86-53d4-49a5-a804-83af93437eb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ba33d6a3454c91a6b57830b91568e6', 'request_id': 'req-825dca86-53d4-49a5-a804-83af93437eb6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:24.210249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-825dca86-53d4-49a5-a804-83af93437eb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ba33d6a3454c91a6b57830b91568e6', 'request_id': 'req-825dca86-53d4-49a5-a804-83af93437eb6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:24.220626 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-825dca86-53d4-49a5-a804-83af93437eb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ba33d6a3454c91a6b57830b91568e6', 'request_id': 'req-825dca86-53d4-49a5-a804-83af93437eb6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:24.235948 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-825dca86-53d4-49a5-a804-83af93437eb6 admin admin] The token cache is being invalidate because project 43ba33d6a3454c91a6b57830b91568e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:24.236329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-825dca86-53d4-49a5-a804-83af93437eb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:24.237110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-825dca86-53d4-49a5-a804-83af93437eb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:24.238710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1078/2142] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:24 2022] DELETE /identity/v3/projects/43ba33d6a3454c91a6b57830b91568e6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:24.248713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dca86-53d4-49a5-a804-83af93437eb6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.248713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-825dca86-53d4-49a5-a804-83af93437eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:24.269535 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1065/2143] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:24.271100 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2891-060d-4b77-b67a-69c922a5fad3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.271562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2891-060d-4b77-b67a-69c922a5fad3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.271951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2891-060d-4b77-b67a-69c922a5fad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.294140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-587d2891-060d-4b77-b67a-69c922a5fad3 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:24.295369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-587d2891-060d-4b77-b67a-69c922a5fad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:24.308930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1066/2144] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:24.310554 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d2891-060d-4b77-b67a-69c922a5fad3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.320695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d2891-060d-4b77-b67a-69c922a5fad3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:24.326624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd1e55-22e8-438e-b2d8-4764ef85fa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:24.327010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dca86-53d4-49a5-a804-83af93437eb6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:24.327217 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd1e55-22e8-438e-b2d8-4764ef85fa9b admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.327495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd1e55-22e8-438e-b2d8-4764ef85fa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.327762 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd1e55-22e8-438e-b2d8-4764ef85fa9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.328871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd1e55-22e8-438e-b2d8-4764ef85fa9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:24.329185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd1e55-22e8-438e-b2d8-4764ef85fa9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:24.330779 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd1e55-22e8-438e-b2d8-4764ef85fa9b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:24.331803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eea38c-1cd4-4fdc-a076-d77dc5f50dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:24.332428 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eea38c-1cd4-4fdc-a076-d77dc5f50dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.332748 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eea38c-1cd4-4fdc-a076-d77dc5f50dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.333023 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eea38c-1cd4-4fdc-a076-d77dc5f50dac admin admin] PATH_INFO: `/v3/users/60efc2d0976c438fb904d943968ea4cc` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.334226 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eea38c-1cd4-4fdc-a076-d77dc5f50dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=60efc2d0976c438fb904d943968ea4cc)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:24.336144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eea38c-1cd4-4fdc-a076-d77dc5f50dac admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:24.345964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1067/2145] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:26:24.347760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dc9f0-1425-4de0-9068-d04fbb626883 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.348143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dc9f0-1425-4de0-9068-d04fbb626883 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.348484 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dc9f0-1425-4de0-9068-d04fbb626883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.379904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b51dc9f0-1425-4de0-9068-d04fbb626883 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:24.381203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b51dc9f0-1425-4de0-9068-d04fbb626883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:24.392552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1068/2146] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:24.393475 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dc9f0-1425-4de0-9068-d04fbb626883 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.402160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-33eea38c-1cd4-4fdc-a076-d77dc5f50dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60efc2d0976c438fb904d943968ea4cc'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:24.403869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dc9f0-1425-4de0-9068-d04fbb626883 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:24.409869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732fc2e1-a227-494f-8bd6-a8d461982db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:24.410731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fc2e1-a227-494f-8bd6-a8d461982db4 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.411009 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fc2e1-a227-494f-8bd6-a8d461982db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.411277 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fc2e1-a227-494f-8bd6-a8d461982db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.411890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732fc2e1-a227-494f-8bd6-a8d461982db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:24.413836 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732fc2e1-a227-494f-8bd6-a8d461982db4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:24.421636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-33eea38c-1cd4-4fdc-a076-d77dc5f50dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60efc2d0976c438fb904d943968ea4cc'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:24.430882 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-33eea38c-1cd4-4fdc-a076-d77dc5f50dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60efc2d0976c438fb904d943968ea4cc'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:24.451734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-33eea38c-1cd4-4fdc-a076-d77dc5f50dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60efc2d0976c438fb904d943968ea4cc'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:24.451734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-33eea38c-1cd4-4fdc-a076-d77dc5f50dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60efc2d0976c438fb904d943968ea4cc'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:24.451907 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1069/2147] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:24 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:24.452966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732fc2e1-a227-494f-8bd6-a8d461982db4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.455456 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-732fc2e1-a227-494f-8bd6-a8d461982db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:24.457190 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1079/2148] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:24 2022] DELETE /identity/v3/users/60efc2d0976c438fb904d943968ea4cc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:24.457882 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eea38c-1cd4-4fdc-a076-d77dc5f50dac admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.461160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-33eea38c-1cd4-4fdc-a076-d77dc5f50dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:24.496901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:24.546891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732fc2e1-a227-494f-8bd6-a8d461982db4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:24.547881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eea38c-1cd4-4fdc-a076-d77dc5f50dac admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:24.549506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee475bf-944d-4bec-9062-a63e24899954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:24.550110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee475bf-944d-4bec-9062-a63e24899954 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.550384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee475bf-944d-4bec-9062-a63e24899954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.550652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee475bf-944d-4bec-9062-a63e24899954 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.551292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee475bf-944d-4bec-9062-a63e24899954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:24.551585 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee475bf-944d-4bec-9062-a63e24899954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:24.552704 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767ff1c-844a-45e4-b5da-c15cf95f6dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:24.553202 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee475bf-944d-4bec-9062-a63e24899954 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:24.553314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767ff1c-844a-45e4-b5da-c15cf95f6dbf admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.553569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767ff1c-844a-45e4-b5da-c15cf95f6dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.553837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767ff1c-844a-45e4-b5da-c15cf95f6dbf admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.554448 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767ff1c-844a-45e4-b5da-c15cf95f6dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:24.557162 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767ff1c-844a-45e4-b5da-c15cf95f6dbf admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:24.565290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1070/2149] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:26:24.572518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f371d-e2e9-4da5-900b-bba2127a2b26 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.572518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f371d-e2e9-4da5-900b-bba2127a2b26 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.572518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f371d-e2e9-4da5-900b-bba2127a2b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.582904 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1080/2150] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:24 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:24.583840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767ff1c-844a-45e4-b5da-c15cf95f6dbf admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.596455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a08f371d-e2e9-4da5-900b-bba2127a2b26 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:24.596664 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767ff1c-844a-45e4-b5da-c15cf95f6dbf admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:24.597990 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a08f371d-e2e9-4da5-900b-bba2127a2b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:24.602093 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f02d75-0616-4dbf-8232-797171065ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:24.602536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f02d75-0616-4dbf-8232-797171065ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.602830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f02d75-0616-4dbf-8232-797171065ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.603121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f02d75-0616-4dbf-8232-797171065ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.603679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f02d75-0616-4dbf-8232-797171065ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:24.605617 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f02d75-0616-4dbf-8232-797171065ac9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:24.609816 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1071/2151] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:24.610973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f371d-e2e9-4da5-900b-bba2127a2b26 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.630869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f371d-e2e9-4da5-900b-bba2127a2b26 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:24.636143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd601f74-0a01-4e4a-a740-819c8d844645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:24.636845 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd601f74-0a01-4e4a-a740-819c8d844645 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.637194 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd601f74-0a01-4e4a-a740-819c8d844645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.637510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd601f74-0a01-4e4a-a740-819c8d844645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.638160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd601f74-0a01-4e4a-a740-819c8d844645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:24.639988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd601f74-0a01-4e4a-a740-819c8d844645 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:24.644174 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1081/2152] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:24 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:24.644174 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f02d75-0616-4dbf-8232-797171065ac9 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.644174 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a9f02d75-0616-4dbf-8232-797171065ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:24.651697 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1072/2153] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:24.652499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd601f74-0a01-4e4a-a740-819c8d844645 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.664831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd601f74-0a01-4e4a-a740-819c8d844645 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:24.674354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:24.709531 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f02d75-0616-4dbf-8232-797171065ac9 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:24.713489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96615734-3a38-4efd-bc63-fe7153c13423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:24.714094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96615734-3a38-4efd-bc63-fe7153c13423 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.714369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96615734-3a38-4efd-bc63-fe7153c13423 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.714637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96615734-3a38-4efd-bc63-fe7153c13423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.726689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729ff95-e7e3-4df2-abc0-6a2e5cb40f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:24.727293 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729ff95-e7e3-4df2-abc0-6a2e5cb40f66 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.727571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729ff95-e7e3-4df2-abc0-6a2e5cb40f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.727843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729ff95-e7e3-4df2-abc0-6a2e5cb40f66 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.728455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729ff95-e7e3-4df2-abc0-6a2e5cb40f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:24.730420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729ff95-e7e3-4df2-abc0-6a2e5cb40f66 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:24.761259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1073/2154] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:24 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:24.761259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729ff95-e7e3-4df2-abc0-6a2e5cb40f66 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.770082 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729ff95-e7e3-4df2-abc0-6a2e5cb40f66 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:24.774749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac1a3d-efcf-4ae3-bf33-c8231324e316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:24.775318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac1a3d-efcf-4ae3-bf33-c8231324e316 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.775592 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac1a3d-efcf-4ae3-bf33-c8231324e316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.775855 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac1a3d-efcf-4ae3-bf33-c8231324e316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.776479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac1a3d-efcf-4ae3-bf33-c8231324e316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:24.778143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac1a3d-efcf-4ae3-bf33-c8231324e316 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:24.778663 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96615734-3a38-4efd-bc63-fe7153c13423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:24.780101 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96615734-3a38-4efd-bc63-fe7153c13423 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:24.788701 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1074/2155] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:24.789497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac1a3d-efcf-4ae3-bf33-c8231324e316 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.794206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1aac1a3d-efcf-4ae3-bf33-c8231324e316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:24.794343 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1082/2156] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:24.795299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96615734-3a38-4efd-bc63-fe7153c13423 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.806060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96615734-3a38-4efd-bc63-fe7153c13423 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:24.810908 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac1a3d-efcf-4ae3-bf33-c8231324e316 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:24.811873 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f504a35-59a2-4e18-bc4b-6499a05c09ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:24.813150 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f504a35-59a2-4e18-bc4b-6499a05c09ab admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.813432 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f504a35-59a2-4e18-bc4b-6499a05c09ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.813703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f504a35-59a2-4e18-bc4b-6499a05c09ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.814353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f504a35-59a2-4e18-bc4b-6499a05c09ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:24.816640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad0495-942e-4e45-8f1d-ae43f60ce486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:24.816776 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f504a35-59a2-4e18-bc4b-6499a05c09ab admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:24.816879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad0495-942e-4e45-8f1d-ae43f60ce486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.817101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad0495-942e-4e45-8f1d-ae43f60ce486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.817378 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad0495-942e-4e45-8f1d-ae43f60ce486 admin admin] PATH_INFO: `/v3/users/3785c2b13a644a5693de86af9e79f5b3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.827165 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad0495-942e-4e45-8f1d-ae43f60ce486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3785c2b13a644a5693de86af9e79f5b3)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:24.828202 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1083/2157] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:24.829292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad0495-942e-4e45-8f1d-ae43f60ce486 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:24.831940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f504a35-59a2-4e18-bc4b-6499a05c09ab admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.842164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f504a35-59a2-4e18-bc4b-6499a05c09ab admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:24.848161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9901e86-e301-4fed-97ce-49c77e755f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:24.853821 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9901e86-e301-4fed-97ce-49c77e755f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.854138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9901e86-e301-4fed-97ce-49c77e755f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.854602 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9901e86-e301-4fed-97ce-49c77e755f58 admin admin] PATH_INFO: `/v3/projects/72ee2dba72704f62a048743b75c346dc/users/213d8f95da3f4c66a2bd11e64f812085/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.877349 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9901e86-e301-4fed-97ce-49c77e755f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ee2dba72704f62a048743b75c346dc, user_id=213d8f95da3f4c66a2bd11e64f812085, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:24.880384 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9901e86-e301-4fed-97ce-49c77e755f58 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:24.890259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-baad0495-942e-4e45-8f1d-ae43f60ce486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3785c2b13a644a5693de86af9e79f5b3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:24.894772 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1084/2158] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:24 2022] PUT /identity/v3/projects/72ee2dba72704f62a048743b75c346dc/users/213d8f95da3f4c66a2bd11e64f812085/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:24.895518 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9901e86-e301-4fed-97ce-49c77e755f58 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:24.906111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:24.911195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-baad0495-942e-4e45-8f1d-ae43f60ce486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3785c2b13a644a5693de86af9e79f5b3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:24.930793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-baad0495-942e-4e45-8f1d-ae43f60ce486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3785c2b13a644a5693de86af9e79f5b3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:24.944116 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-baad0495-942e-4e45-8f1d-ae43f60ce486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3785c2b13a644a5693de86af9e79f5b3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:24.944895 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-baad0495-942e-4e45-8f1d-ae43f60ce486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3785c2b13a644a5693de86af9e79f5b3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:24.952961 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1075/2159] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:24 2022] DELETE /identity/v3/users/3785c2b13a644a5693de86af9e79f5b3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:24.954058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b7559-7d25-47f6-a3a8-24dc69cccb2a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:24.954344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b7559-7d25-47f6-a3a8-24dc69cccb2a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:24.954613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b7559-7d25-47f6-a3a8-24dc69cccb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:24.989591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ad9b7559-7d25-47f6-a3a8-24dc69cccb2a None None] MFA Rules not processed for user `213d8f95da3f4c66a2bd11e64f812085`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:24.991232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ad9b7559-7d25-47f6-a3a8-24dc69cccb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:24.994807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9901e86-e301-4fed-97ce-49c77e755f58 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:25.075363 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:25.088399 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6959a4-4f52-4bb4-8941-277836190b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:25.088872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6959a4-4f52-4bb4-8941-277836190b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:25.089301 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6959a4-4f52-4bb4-8941-277836190b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:25.089581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6959a4-4f52-4bb4-8941-277836190b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:25.090553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6959a4-4f52-4bb4-8941-277836190b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:25.092214 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6959a4-4f52-4bb4-8941-277836190b34 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:25.100733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1076/2160] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:25.100733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd50199-57be-465b-858c-8b6e4016db0a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:25.100733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd50199-57be-465b-858c-8b6e4016db0a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:25.100733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd50199-57be-465b-858c-8b6e4016db0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:25.116457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1085/2161] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:25.120218 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6959a4-4f52-4bb4-8941-277836190b34 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:25.122998 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cc6959a4-4f52-4bb4-8941-277836190b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:25.127963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8dd50199-57be-465b-858c-8b6e4016db0a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:25.129223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8dd50199-57be-465b-858c-8b6e4016db0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:25.142391 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1077/2162] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:25.142647 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd50199-57be-465b-858c-8b6e4016db0a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:25.144280 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8dd50199-57be-465b-858c-8b6e4016db0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:25.147991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6959a4-4f52-4bb4-8941-277836190b34 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:25.155356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ea84c-3cc9-446d-a54a-c8dbe6421c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:25.156053 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ea84c-3cc9-446d-a54a-c8dbe6421c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:25.156340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ea84c-3cc9-446d-a54a-c8dbe6421c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:25.156930 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ea84c-3cc9-446d-a54a-c8dbe6421c2c admin admin] PATH_INFO: `/v3/projects/dbd9625a4af44dc491ff983cfd51b22f/users/ddde994edc874eb29f8ceea4a40b75e0/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:25.177641 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ea84c-3cc9-446d-a54a-c8dbe6421c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd9625a4af44dc491ff983cfd51b22f, user_id=ddde994edc874eb29f8ceea4a40b75e0, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:25.180695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ea84c-3cc9-446d-a54a-c8dbe6421c2c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:25.198950 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1086/2163] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:25 2022] PUT /identity/v3/projects/dbd9625a4af44dc491ff983cfd51b22f/users/ddde994edc874eb29f8ceea4a40b75e0/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:25.203064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ea84c-3cc9-446d-a54a-c8dbe6421c2c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:25.214863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-525ea84c-3cc9-446d-a54a-c8dbe6421c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:25.247102 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd50199-57be-465b-858c-8b6e4016db0a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:25.275285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ea84c-3cc9-446d-a54a-c8dbe6421c2c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:25.279550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7b3e3-233e-4aed-b5d7-cfad6667ffc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:25.280188 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b3e3-233e-4aed-b5d7-cfad6667ffc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:25.280552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b3e3-233e-4aed-b5d7-cfad6667ffc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:25.280890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b3e3-233e-4aed-b5d7-cfad6667ffc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:25.300086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d9fec-fe26-4c9e-8901-37166b70ac92 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9158ce9d8a4aadbf86405657958c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:25.300724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d9fec-fe26-4c9e-8901-37166b70ac92 service glance] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:25.301004 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d9fec-fe26-4c9e-8901-37166b70ac92 service glance] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:25.301272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d9fec-fe26-4c9e-8901-37166b70ac92 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:25.320433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:25.346910 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7b3e3-233e-4aed-b5d7-cfad6667ffc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:25.348379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7b3e3-233e-4aed-b5d7-cfad6667ffc3 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:25.358054 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1087/2164] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:25.358761 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7b3e3-233e-4aed-b5d7-cfad6667ffc3 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:25.360113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7af7b3e3-233e-4aed-b5d7-cfad6667ffc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:25.361804 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d9fec-fe26-4c9e-8901-37166b70ac92 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:25.363968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d9fec-fe26-4c9e-8901-37166b70ac92 service glance] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:25.373050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7b3e3-233e-4aed-b5d7-cfad6667ffc3 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:25.373920 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1078/2165] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:25.375232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcf2c4-75d4-4d69-a8cf-f3445435cc80 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:25.375521 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcf2c4-75d4-4d69-a8cf-f3445435cc80 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:25.375789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcf2c4-75d4-4d69-a8cf-f3445435cc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:25.392175 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:25.393794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:25.395504 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:25.396106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b admin admin] PATH_INFO: `/v3/projects/289f56b7379e4883a6dc1e341e0b4fd5` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:25.397662 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=289f56b7379e4883a6dc1e341e0b4fd5)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:25.400823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:25.418170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-29bcf2c4-75d4-4d69-a8cf-f3445435cc80 None None] MFA Rules not processed for user `ddde994edc874eb29f8ceea4a40b75e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:25.419939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-29bcf2c4-75d4-4d69-a8cf-f3445435cc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:25.455881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:25.499874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '289f56b7379e4883a6dc1e341e0b4fd5', 'request_id': 'req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:25.511560 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '289f56b7379e4883a6dc1e341e0b4fd5', 'request_id': 'req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:25.522810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '289f56b7379e4883a6dc1e341e0b4fd5', 'request_id': 'req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:25.529049 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1079/2166] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:25.544867 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcf2c4-75d4-4d69-a8cf-f3445435cc80 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:25.547335 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-29bcf2c4-75d4-4d69-a8cf-f3445435cc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:25.558146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b admin admin] The token cache is being invalidate because project 289f56b7379e4883a6dc1e341e0b4fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:25.560818 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:25.562077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:25.564275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcf2c4-75d4-4d69-a8cf-f3445435cc80 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:25.567225 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1088/2167] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:25 2022] DELETE /identity/v3/projects/289f56b7379e4883a6dc1e341e0b4fd5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:25.568097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:25.569525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:25.642574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750a157-3a21-4480-ac51-f016d2b77bef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9158ce9d8a4aadbf86405657958c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:25.643320 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750a157-3a21-4480-ac51-f016d2b77bef service glance] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:25.644857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750a157-3a21-4480-ac51-f016d2b77bef service glance] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:25.645345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750a157-3a21-4480-ac51-f016d2b77bef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:25.648087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a750a157-3a21-4480-ac51-f016d2b77bef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:25.673827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8eb013-cc2d-4f81-b8bf-1e5bb2c0aa4b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:25.680288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bce07-b948-4aa5-a9c0-842bb3763b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:25.681021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bce07-b948-4aa5-a9c0-842bb3763b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:25.681311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bce07-b948-4aa5-a9c0-842bb3763b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:25.681636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bce07-b948-4aa5-a9c0-842bb3763b5a admin admin] PATH_INFO: `/v3/users/beb7341ee9fb412b913f9580d5cdbb97` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:25.683109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bce07-b948-4aa5-a9c0-842bb3763b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb7341ee9fb412b913f9580d5cdbb97)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:25.685844 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bce07-b948-4aa5-a9c0-842bb3763b5a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:25.750246 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750a157-3a21-4480-ac51-f016d2b77bef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:25.751831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750a157-3a21-4480-ac51-f016d2b77bef service glance] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:25.765262 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1080/2168] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:25.766028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750a157-3a21-4480-ac51-f016d2b77bef service glance] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:25.767401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a750a157-3a21-4480-ac51-f016d2b77bef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:25.770083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a96bce07-b948-4aa5-a9c0-842bb3763b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb7341ee9fb412b913f9580d5cdbb97'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:25.783694 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:25.794031 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a96bce07-b948-4aa5-a9c0-842bb3763b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb7341ee9fb412b913f9580d5cdbb97'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:25.805094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750a157-3a21-4480-ac51-f016d2b77bef service glance] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:25.814591 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a96bce07-b948-4aa5-a9c0-842bb3763b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb7341ee9fb412b913f9580d5cdbb97'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:25.824471 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a96bce07-b948-4aa5-a9c0-842bb3763b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb7341ee9fb412b913f9580d5cdbb97'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:25.825091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a16d8-a95e-47c0-8900-4fb3b93e72c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:25.825744 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a16d8-a95e-47c0-8900-4fb3b93e72c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:25.826020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a16d8-a95e-47c0-8900-4fb3b93e72c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:25.826290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a16d8-a95e-47c0-8900-4fb3b93e72c3 admin admin] PATH_INFO: `/v3/projects/2113110ea4e44086b449f3c20ce70432` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:25.827242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a96bce07-b948-4aa5-a9c0-842bb3763b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb7341ee9fb412b913f9580d5cdbb97'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:25.829401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a16d8-a95e-47c0-8900-4fb3b93e72c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2113110ea4e44086b449f3c20ce70432)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:25.831312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a16d8-a95e-47c0-8900-4fb3b93e72c3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:25.834869 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1089/2169] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:25 2022] DELETE /identity/v3/users/beb7341ee9fb412b913f9580d5cdbb97 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:25.897035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-880a16d8-a95e-47c0-8900-4fb3b93e72c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2113110ea4e44086b449f3c20ce70432', 'request_id': 'req-880a16d8-a95e-47c0-8900-4fb3b93e72c3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:25.906201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-880a16d8-a95e-47c0-8900-4fb3b93e72c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2113110ea4e44086b449f3c20ce70432', 'request_id': 'req-880a16d8-a95e-47c0-8900-4fb3b93e72c3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:25.914143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-880a16d8-a95e-47c0-8900-4fb3b93e72c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2113110ea4e44086b449f3c20ce70432', 'request_id': 'req-880a16d8-a95e-47c0-8900-4fb3b93e72c3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:25.938020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-880a16d8-a95e-47c0-8900-4fb3b93e72c3 admin admin] The token cache is being invalidate because project 2113110ea4e44086b449f3c20ce70432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:25.938314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-880a16d8-a95e-47c0-8900-4fb3b93e72c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:25.939249 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-880a16d8-a95e-47c0-8900-4fb3b93e72c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:25.941172 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1081/2170] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:25 2022] DELETE /identity/v3/projects/2113110ea4e44086b449f3c20ce70432 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:25.945159 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bce07-b948-4aa5-a9c0-842bb3763b5a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:25.946655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a96bce07-b948-4aa5-a9c0-842bb3763b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:26.101466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bce07-b948-4aa5-a9c0-842bb3763b5a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:26.192273 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa6cd0-a4f7-4dc5-b7a5-1ae8b102d5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:26.193017 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6cd0-a4f7-4dc5-b7a5-1ae8b102d5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:26.193382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6cd0-a4f7-4dc5-b7a5-1ae8b102d5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:26.193701 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6cd0-a4f7-4dc5-b7a5-1ae8b102d5c4 admin admin] PATH_INFO: `/v3/users/f0ae2dcea6d4466c8fac4e0257d16de6` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:26.195273 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa6cd0-a4f7-4dc5-b7a5-1ae8b102d5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ae2dcea6d4466c8fac4e0257d16de6)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:26.197397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa6cd0-a4f7-4dc5-b7a5-1ae8b102d5c4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:26.260201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a16d8-a95e-47c0-8900-4fb3b93e72c3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:26.261782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-880a16d8-a95e-47c0-8900-4fb3b93e72c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:26.270624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e3aa6cd0-a4f7-4dc5-b7a5-1ae8b102d5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ae2dcea6d4466c8fac4e0257d16de6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:26.273388 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:26.282431 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a16d8-a95e-47c0-8900-4fb3b93e72c3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:26.295892 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e1663-0bf2-42ea-9594-7a82acb0c547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:26.297637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e1663-0bf2-42ea-9594-7a82acb0c547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:26.298370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e1663-0bf2-42ea-9594-7a82acb0c547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:26.298890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e1663-0bf2-42ea-9594-7a82acb0c547 admin admin] PATH_INFO: `/v3/projects/ad24a468860c4821a02e51f2cbd95fd6` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:26.301010 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e1663-0bf2-42ea-9594-7a82acb0c547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad24a468860c4821a02e51f2cbd95fd6)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:26.309743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e3aa6cd0-a4f7-4dc5-b7a5-1ae8b102d5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ae2dcea6d4466c8fac4e0257d16de6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:26.316500 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e1663-0bf2-42ea-9594-7a82acb0c547 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:26.319503 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e3aa6cd0-a4f7-4dc5-b7a5-1ae8b102d5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ae2dcea6d4466c8fac4e0257d16de6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:26.345952 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e3aa6cd0-a4f7-4dc5-b7a5-1ae8b102d5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ae2dcea6d4466c8fac4e0257d16de6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:26.346781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e3aa6cd0-a4f7-4dc5-b7a5-1ae8b102d5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ae2dcea6d4466c8fac4e0257d16de6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:26.355577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1090/2171] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:25 2022] DELETE /identity/v3/users/f0ae2dcea6d4466c8fac4e0257d16de6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:26.385207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8f8e1663-0bf2-42ea-9594-7a82acb0c547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad24a468860c4821a02e51f2cbd95fd6', 'request_id': 'req-8f8e1663-0bf2-42ea-9594-7a82acb0c547'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:26.397048 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8f8e1663-0bf2-42ea-9594-7a82acb0c547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad24a468860c4821a02e51f2cbd95fd6', 'request_id': 'req-8f8e1663-0bf2-42ea-9594-7a82acb0c547'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:26.407141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8f8e1663-0bf2-42ea-9594-7a82acb0c547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad24a468860c4821a02e51f2cbd95fd6', 'request_id': 'req-8f8e1663-0bf2-42ea-9594-7a82acb0c547'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:26.421226 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8f8e1663-0bf2-42ea-9594-7a82acb0c547 admin admin] The token cache is being invalidate because project ad24a468860c4821a02e51f2cbd95fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:26.421495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8f8e1663-0bf2-42ea-9594-7a82acb0c547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:26.422137 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8f8e1663-0bf2-42ea-9594-7a82acb0c547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:26.424185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1082/2172] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:26 2022] DELETE /identity/v3/projects/ad24a468860c4821a02e51f2cbd95fd6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:26.430137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ce793-ad83-4719-a344-cc5e0bb34561 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:26.430299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ce793-ad83-4719-a344-cc5e0bb34561 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:26.430535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ce793-ad83-4719-a344-cc5e0bb34561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:26.444545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:26.462257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b56ce793-ad83-4719-a344-cc5e0bb34561 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:26.463503 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b56ce793-ad83-4719-a344-cc5e0bb34561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:26.541231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1091/2173] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:26.549654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c516e-81c3-4b21-b24d-c262fc468bf4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:26.550021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c516e-81c3-4b21-b24d-c262fc468bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:26.550292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c516e-81c3-4b21-b24d-c262fc468bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:26.572777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fb8c516e-81c3-4b21-b24d-c262fc468bf4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:26.574087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fb8c516e-81c3-4b21-b24d-c262fc468bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:26.583787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1083/2174] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:26.587964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ce793-ad83-4719-a344-cc5e0bb34561 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:26.597811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ce793-ad83-4719-a344-cc5e0bb34561 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:26.603240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019631e-ce45-4165-a95f-6f4055e418b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:26.603842 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019631e-ce45-4165-a95f-6f4055e418b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:26.604115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019631e-ce45-4165-a95f-6f4055e418b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:26.604385 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019631e-ce45-4165-a95f-6f4055e418b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:26.605106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019631e-ce45-4165-a95f-6f4055e418b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:26.605527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019631e-ce45-4165-a95f-6f4055e418b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:26.607657 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019631e-ce45-4165-a95f-6f4055e418b2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:26.620456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1092/2175] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:26:26.625722 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c516e-81c3-4b21-b24d-c262fc468bf4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:26.635864 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c516e-81c3-4b21-b24d-c262fc468bf4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:26.644708 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34f84a-e7e7-481a-a191-d91bad14d939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:26.645316 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34f84a-e7e7-481a-a191-d91bad14d939 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:26.645594 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34f84a-e7e7-481a-a191-d91bad14d939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:26.645867 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34f84a-e7e7-481a-a191-d91bad14d939 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:26.646507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34f84a-e7e7-481a-a191-d91bad14d939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:26.648800 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34f84a-e7e7-481a-a191-d91bad14d939 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:26.662371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019631e-ce45-4165-a95f-6f4055e418b2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:26.664200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a019631e-ce45-4165-a95f-6f4055e418b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:26.686984 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1084/2176] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:26 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:26.690569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019631e-ce45-4165-a95f-6f4055e418b2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:26.693078 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34f84a-e7e7-481a-a191-d91bad14d939 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:26.764149 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68a2d0-16e1-40a2-ac54-f7e3e184cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:26.764840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68a2d0-16e1-40a2-ac54-f7e3e184cfbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:26.765225 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68a2d0-16e1-40a2-ac54-f7e3e184cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:26.765503 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68a2d0-16e1-40a2-ac54-f7e3e184cfbe admin admin] PATH_INFO: `/v3/projects/76a6ab13b29b490dbf4968ce13b2bc64` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:26.766697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68a2d0-16e1-40a2-ac54-f7e3e184cfbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a6ab13b29b490dbf4968ce13b2bc64)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:26.769011 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68a2d0-16e1-40a2-ac54-f7e3e184cfbe admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:26.778446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34f84a-e7e7-481a-a191-d91bad14d939 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:26.785302 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1011bc-710a-4e3e-a087-158fb77a7f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:26.785982 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1011bc-710a-4e3e-a087-158fb77a7f5f admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:26.786270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1011bc-710a-4e3e-a087-158fb77a7f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:26.786688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1011bc-710a-4e3e-a087-158fb77a7f5f admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:26.787192 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1011bc-710a-4e3e-a087-158fb77a7f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:26.789288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1011bc-710a-4e3e-a087-158fb77a7f5f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:26.811030 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1085/2177] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:26 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:26.815448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1011bc-710a-4e3e-a087-158fb77a7f5f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:26.823267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1b68a2d0-16e1-40a2-ac54-f7e3e184cfbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a6ab13b29b490dbf4968ce13b2bc64', 'request_id': 'req-1b68a2d0-16e1-40a2-ac54-f7e3e184cfbe'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:26.825463 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1011bc-710a-4e3e-a087-158fb77a7f5f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:26.829540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1b68a2d0-16e1-40a2-ac54-f7e3e184cfbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a6ab13b29b490dbf4968ce13b2bc64', 'request_id': 'req-1b68a2d0-16e1-40a2-ac54-f7e3e184cfbe'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:26.838244 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1b68a2d0-16e1-40a2-ac54-f7e3e184cfbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a6ab13b29b490dbf4968ce13b2bc64', 'request_id': 'req-1b68a2d0-16e1-40a2-ac54-f7e3e184cfbe'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:26.853004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1b68a2d0-16e1-40a2-ac54-f7e3e184cfbe admin admin] The token cache is being invalidate because project 76a6ab13b29b490dbf4968ce13b2bc64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:26.853310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1b68a2d0-16e1-40a2-ac54-f7e3e184cfbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:26.853957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1b68a2d0-16e1-40a2-ac54-f7e3e184cfbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:26.860285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1093/2178] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:26 2022] DELETE /identity/v3/projects/76a6ab13b29b490dbf4968ce13b2bc64 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:26.861703 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaf3b2-4d8c-4528-9940-41e528b16349 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:26.862060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaf3b2-4d8c-4528-9940-41e528b16349 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:26.862411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaf3b2-4d8c-4528-9940-41e528b16349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:26.875312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:26.886229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2eeaf3b2-4d8c-4528-9940-41e528b16349 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:26.887701 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2eeaf3b2-4d8c-4528-9940-41e528b16349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:26.892896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686040b9-fee7-4a17-88a6-f2ccf0d3e498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:26.894421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686040b9-fee7-4a17-88a6-f2ccf0d3e498 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:26.894856 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686040b9-fee7-4a17-88a6-f2ccf0d3e498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:26.895275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686040b9-fee7-4a17-88a6-f2ccf0d3e498 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:26.895944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686040b9-fee7-4a17-88a6-f2ccf0d3e498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:26.897563 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686040b9-fee7-4a17-88a6-f2ccf0d3e498 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:26.909807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:26.912661 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1086/2179] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:26.916686 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686040b9-fee7-4a17-88a6-f2ccf0d3e498 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:26.919600 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-686040b9-fee7-4a17-88a6-f2ccf0d3e498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:26.933126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686040b9-fee7-4a17-88a6-f2ccf0d3e498 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:26.940138 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06929090-dadd-4248-b14d-4a98ccd90862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:26.940826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06929090-dadd-4248-b14d-4a98ccd90862 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:26.941111 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06929090-dadd-4248-b14d-4a98ccd90862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:26.941386 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06929090-dadd-4248-b14d-4a98ccd90862 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:26.942040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06929090-dadd-4248-b14d-4a98ccd90862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:26.943680 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06929090-dadd-4248-b14d-4a98ccd90862 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:26.956732 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1087/2180] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:26.960799 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06929090-dadd-4248-b14d-4a98ccd90862 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:26.966642 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1094/2181] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:26.973086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06929090-dadd-4248-b14d-4a98ccd90862 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:26.974314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517c8f3-b4fd-4acb-98ab-39f4bf9aa25c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:26.974608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517c8f3-b4fd-4acb-98ab-39f4bf9aa25c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:26.974915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517c8f3-b4fd-4acb-98ab-39f4bf9aa25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:26.978346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6f7ad-feb4-42ab-9522-2ee578a23e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:26.979045 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6f7ad-feb4-42ab-9522-2ee578a23e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:26.979312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6f7ad-feb4-42ab-9522-2ee578a23e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:26.979583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6f7ad-feb4-42ab-9522-2ee578a23e19 admin admin] PATH_INFO: `/v3/projects/98b2e9af7b8b41afa7209e2d01bc8653/users/c445012655f1402a982cbfe0bb50d9a8/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:26.994380 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a517c8f3-b4fd-4acb-98ab-39f4bf9aa25c None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:26.995842 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a517c8f3-b4fd-4acb-98ab-39f4bf9aa25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:26.995956 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6f7ad-feb4-42ab-9522-2ee578a23e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b2e9af7b8b41afa7209e2d01bc8653, user_id=c445012655f1402a982cbfe0bb50d9a8, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:26.998612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6f7ad-feb4-42ab-9522-2ee578a23e19 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.007650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1095/2182] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:27.014197 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517c8f3-b4fd-4acb-98ab-39f4bf9aa25c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.020292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1088/2183] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:26 2022] PUT /identity/v3/projects/98b2e9af7b8b41afa7209e2d01bc8653/users/c445012655f1402a982cbfe0bb50d9a8/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:27.025239 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517c8f3-b4fd-4acb-98ab-39f4bf9aa25c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.032816 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276dd5d-1e68-4780-9305-c23014da8ea6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.033102 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276dd5d-1e68-4780-9305-c23014da8ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.033375 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276dd5d-1e68-4780-9305-c23014da8ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.063019 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e276dd5d-1e68-4780-9305-c23014da8ea6 None None] MFA Rules not processed for user `c445012655f1402a982cbfe0bb50d9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:27.064227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e276dd5d-1e68-4780-9305-c23014da8ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:27.090777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26a556-e545-4412-82b4-3f9fc4730143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.091499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26a556-e545-4412-82b4-3f9fc4730143 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.091779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26a556-e545-4412-82b4-3f9fc4730143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.092083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26a556-e545-4412-82b4-3f9fc4730143 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.092803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26a556-e545-4412-82b4-3f9fc4730143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:27.093137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26a556-e545-4412-82b4-3f9fc4730143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.094885 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26a556-e545-4412-82b4-3f9fc4730143 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.114769 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1096/2184] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:26:27.115817 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26a556-e545-4412-82b4-3f9fc4730143 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.126062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26a556-e545-4412-82b4-3f9fc4730143 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.131010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ec24f-9595-4473-802b-1bbd16f4aaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.131616 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ec24f-9595-4473-802b-1bbd16f4aaab admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.131896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ec24f-9595-4473-802b-1bbd16f4aaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.132168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ec24f-9595-4473-802b-1bbd16f4aaab admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.132823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ec24f-9595-4473-802b-1bbd16f4aaab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.134767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ec24f-9595-4473-802b-1bbd16f4aaab admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.138901 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1089/2185] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:27.144130 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276dd5d-1e68-4780-9305-c23014da8ea6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.154428 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276dd5d-1e68-4780-9305-c23014da8ea6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.160197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f418eba-e7de-43a8-b49a-07ed8563fe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.160817 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f418eba-e7de-43a8-b49a-07ed8563fe5c admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.161084 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f418eba-e7de-43a8-b49a-07ed8563fe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.161349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f418eba-e7de-43a8-b49a-07ed8563fe5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.161960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f418eba-e7de-43a8-b49a-07ed8563fe5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.163834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f418eba-e7de-43a8-b49a-07ed8563fe5c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.166558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1097/2186] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:27 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:27.171489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ec24f-9595-4473-802b-1bbd16f4aaab admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.198666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1090/2187] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:27 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:27.202971 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f418eba-e7de-43a8-b49a-07ed8563fe5c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.239988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ec24f-9595-4473-802b-1bbd16f4aaab admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.268166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f418eba-e7de-43a8-b49a-07ed8563fe5c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.271653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:27.273285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc26bff-3b07-439d-8d3a-c38ba03d5920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.273830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc26bff-3b07-439d-8d3a-c38ba03d5920 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.274196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc26bff-3b07-439d-8d3a-c38ba03d5920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.274460 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc26bff-3b07-439d-8d3a-c38ba03d5920 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.275279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc26bff-3b07-439d-8d3a-c38ba03d5920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.277290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc26bff-3b07-439d-8d3a-c38ba03d5920 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.308638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e2e21-c751-41ec-867f-66038b243be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.309811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e2e21-c751-41ec-867f-66038b243be0 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.310092 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e2e21-c751-41ec-867f-66038b243be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.310363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e2e21-c751-41ec-867f-66038b243be0 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.311011 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e2e21-c751-41ec-867f-66038b243be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.313240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e2e21-c751-41ec-867f-66038b243be0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.313723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1091/2188] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:27 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:27.317781 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc26bff-3b07-439d-8d3a-c38ba03d5920 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.328678 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc26bff-3b07-439d-8d3a-c38ba03d5920 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.333562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89323f7-13ab-424b-bbb7-7dfb4eeb2df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.334150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89323f7-13ab-424b-bbb7-7dfb4eeb2df0 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.334496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89323f7-13ab-424b-bbb7-7dfb4eeb2df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.334804 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89323f7-13ab-424b-bbb7-7dfb4eeb2df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.335543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89323f7-13ab-424b-bbb7-7dfb4eeb2df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.339817 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1098/2189] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:27 2022] POST /identity/v3/users => generated 284 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:27.340018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89323f7-13ab-424b-bbb7-7dfb4eeb2df0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.340018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:27.341744 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e2e21-c751-41ec-867f-66038b243be0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.352564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1092/2190] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:27.354286 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e2e21-c751-41ec-867f-66038b243be0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.356811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89323f7-13ab-424b-bbb7-7dfb4eeb2df0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.359695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58c157-9d10-49e3-8e01-b69e6aa53554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.360298 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58c157-9d10-49e3-8e01-b69e6aa53554 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.360577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58c157-9d10-49e3-8e01-b69e6aa53554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.360882 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58c157-9d10-49e3-8e01-b69e6aa53554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.361698 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58c157-9d10-49e3-8e01-b69e6aa53554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.363934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58c157-9d10-49e3-8e01-b69e6aa53554 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.366604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89323f7-13ab-424b-bbb7-7dfb4eeb2df0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.371247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdb874-3908-46c5-8564-a5f142780b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.372351 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdb874-3908-46c5-8564-a5f142780b15 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.372658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdb874-3908-46c5-8564-a5f142780b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.372937 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdb874-3908-46c5-8564-a5f142780b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.373680 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdb874-3908-46c5-8564-a5f142780b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.375158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdb874-3908-46c5-8564-a5f142780b15 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.379515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1099/2191] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:27.381042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58c157-9d10-49e3-8e01-b69e6aa53554 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.391929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1093/2192] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:27.399715 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdb874-3908-46c5-8564-a5f142780b15 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.400233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58c157-9d10-49e3-8e01-b69e6aa53554 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.405695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357f40c-208e-4bd3-9c74-62a066e2aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.406256 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357f40c-208e-4bd3-9c74-62a066e2aae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.406787 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357f40c-208e-4bd3-9c74-62a066e2aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.407153 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357f40c-208e-4bd3-9c74-62a066e2aae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.407743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357f40c-208e-4bd3-9c74-62a066e2aae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.409365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357f40c-208e-4bd3-9c74-62a066e2aae7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.415593 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdb874-3908-46c5-8564-a5f142780b15 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.423792 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d992f-857e-4e18-96f9-f821f175e0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.424467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d992f-857e-4e18-96f9-f821f175e0aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.424781 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d992f-857e-4e18-96f9-f821f175e0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.425060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d992f-857e-4e18-96f9-f821f175e0aa admin admin] PATH_INFO: `/v3/projects/7c177d6d893b41e1b1cf3db034664d6b/users/b8d349a71c514295b9e9018345a5cf19/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.437292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1100/2193] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:27.443188 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357f40c-208e-4bd3-9c74-62a066e2aae7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.445220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d992f-857e-4e18-96f9-f821f175e0aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c177d6d893b41e1b1cf3db034664d6b, user_id=b8d349a71c514295b9e9018345a5cf19, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.453998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d992f-857e-4e18-96f9-f821f175e0aa admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.469879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1094/2194] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:27 2022] PUT /identity/v3/projects/7c177d6d893b41e1b1cf3db034664d6b/users/b8d349a71c514295b9e9018345a5cf19/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:27.473708 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357f40c-208e-4bd3-9c74-62a066e2aae7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.481405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc03914-e82d-4d55-813e-6c55083a3097 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.481702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc03914-e82d-4d55-813e-6c55083a3097 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.481981 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc03914-e82d-4d55-813e-6c55083a3097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.516799 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ffc03914-e82d-4d55-813e-6c55083a3097 None None] MFA Rules not processed for user `b8d349a71c514295b9e9018345a5cf19`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:27.520787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ffc03914-e82d-4d55-813e-6c55083a3097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:27.551457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a6dc0-37f7-4a33-b49c-588159432af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.552111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a6dc0-37f7-4a33-b49c-588159432af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.552409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a6dc0-37f7-4a33-b49c-588159432af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.552711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a6dc0-37f7-4a33-b49c-588159432af9 admin admin] PATH_INFO: `/v3/projects/04852665f0204cee8a6d699e9edf7405/users/44fddbd3984b46dd9098784c9f29bacf/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.566929 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a6dc0-37f7-4a33-b49c-588159432af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04852665f0204cee8a6d699e9edf7405, user_id=44fddbd3984b46dd9098784c9f29bacf, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.569627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a6dc0-37f7-4a33-b49c-588159432af9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.583583 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1101/2195] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:27 2022] PUT /identity/v3/projects/04852665f0204cee8a6d699e9edf7405/users/44fddbd3984b46dd9098784c9f29bacf/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:27.594448 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23feea6e-352f-4854-acb3-2454c2d65eb6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.594740 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23feea6e-352f-4854-acb3-2454c2d65eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.595016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23feea6e-352f-4854-acb3-2454c2d65eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.600117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1095/2196] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:27.604468 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc03914-e82d-4d55-813e-6c55083a3097 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.615337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc03914-e82d-4d55-813e-6c55083a3097 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.626010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-23feea6e-352f-4854-acb3-2454c2d65eb6 None None] MFA Rules not processed for user `44fddbd3984b46dd9098784c9f29bacf`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:27.627351 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-23feea6e-352f-4854-acb3-2454c2d65eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:27.671410 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2edf4-9790-456b-90a2-ae5917812124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.672156 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2edf4-9790-456b-90a2-ae5917812124 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.672463 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2edf4-9790-456b-90a2-ae5917812124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.672785 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2edf4-9790-456b-90a2-ae5917812124 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.673407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2edf4-9790-456b-90a2-ae5917812124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.675446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2edf4-9790-456b-90a2-ae5917812124 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.691706 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1102/2197] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:27.696722 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23feea6e-352f-4854-acb3-2454c2d65eb6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.704573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1096/2198] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:27 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:27.705919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2edf4-9790-456b-90a2-ae5917812124 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.706908 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23feea6e-352f-4854-acb3-2454c2d65eb6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.716571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:27.755486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:27.767783 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e4dfa-a24e-4217-bda2-ba35ba408ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.768326 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e4dfa-a24e-4217-bda2-ba35ba408ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.768624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e4dfa-a24e-4217-bda2-ba35ba408ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.768906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e4dfa-a24e-4217-bda2-ba35ba408ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.769526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e4dfa-a24e-4217-bda2-ba35ba408ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.771450 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e4dfa-a24e-4217-bda2-ba35ba408ff0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.783143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2edf4-9790-456b-90a2-ae5917812124 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.788212 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd2f36-7590-4f64-9c22-5d43dae0fbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.788875 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd2f36-7590-4f64-9c22-5d43dae0fbea admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.789157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd2f36-7590-4f64-9c22-5d43dae0fbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.789458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd2f36-7590-4f64-9c22-5d43dae0fbea admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.790108 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd2f36-7590-4f64-9c22-5d43dae0fbea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.792029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd2f36-7590-4f64-9c22-5d43dae0fbea admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.802786 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1103/2199] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:27 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:27.807127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e4dfa-a24e-4217-bda2-ba35ba408ff0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.816708 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1097/2200] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:27 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:27.817755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd2f36-7590-4f64-9c22-5d43dae0fbea admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.828285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd2f36-7590-4f64-9c22-5d43dae0fbea admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.870350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e4dfa-a24e-4217-bda2-ba35ba408ff0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.875568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75621b1-93f4-4aa5-95e3-438634e1a184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.876174 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75621b1-93f4-4aa5-95e3-438634e1a184 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.876453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75621b1-93f4-4aa5-95e3-438634e1a184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.876769 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75621b1-93f4-4aa5-95e3-438634e1a184 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.877384 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75621b1-93f4-4aa5-95e3-438634e1a184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.879334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75621b1-93f4-4aa5-95e3-438634e1a184 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.884923 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fb323-74ed-4ee5-9fa7-c850a50a5f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.885531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fb323-74ed-4ee5-9fa7-c850a50a5f41 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.885806 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fb323-74ed-4ee5-9fa7-c850a50a5f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.886076 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fb323-74ed-4ee5-9fa7-c850a50a5f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.886720 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fb323-74ed-4ee5-9fa7-c850a50a5f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.888878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fb323-74ed-4ee5-9fa7-c850a50a5f41 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.900148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1098/2201] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:27.904845 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fb323-74ed-4ee5-9fa7-c850a50a5f41 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.912289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1104/2202] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:27 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:27.915896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75621b1-93f4-4aa5-95e3-438634e1a184 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.917794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fb323-74ed-4ee5-9fa7-c850a50a5f41 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.922433 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dd0d3-bc8e-4981-81cd-7e8634deae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.923068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dd0d3-bc8e-4981-81cd-7e8634deae01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.923346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dd0d3-bc8e-4981-81cd-7e8634deae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.923620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dd0d3-bc8e-4981-81cd-7e8634deae01 admin admin] PATH_INFO: `/v3/projects/fc4608eec11448daadf5bb9242109424/users/81bad16e816d42c7b119adbea5527945/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.925398 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75621b1-93f4-4aa5-95e3-438634e1a184 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.930039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad0d3b-84d0-4810-81c9-5319a4bc962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:27.930620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad0d3b-84d0-4810-81c9-5319a4bc962c admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:27.930902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad0d3b-84d0-4810-81c9-5319a4bc962c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:27.931177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad0d3b-84d0-4810-81c9-5319a4bc962c admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:27.931818 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad0d3b-84d0-4810-81c9-5319a4bc962c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.933581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad0d3b-84d0-4810-81c9-5319a4bc962c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.939602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5dd0d3-bc8e-4981-81cd-7e8634deae01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4608eec11448daadf5bb9242109424, user_id=81bad16e816d42c7b119adbea5527945, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:27.942440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5dd0d3-bc8e-4981-81cd-7e8634deae01 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:27.945035 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1105/2203] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:27.948973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad0d3b-84d0-4810-81c9-5319a4bc962c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:27.959792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad0d3b-84d0-4810-81c9-5319a4bc962c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:27.960023 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1099/2204] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:27 2022] PUT /identity/v3/projects/fc4608eec11448daadf5bb9242109424/users/81bad16e816d42c7b119adbea5527945/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:27.963794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dd0d3-bc8e-4981-81cd-7e8634deae01 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:28.019069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5ec56-b059-4313-b7cc-71932d086a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:28.019657 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5ec56-b059-4313-b7cc-71932d086a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:28.020076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5ec56-b059-4313-b7cc-71932d086a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:28.020361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5ec56-b059-4313-b7cc-71932d086a67 admin admin] PATH_INFO: `/v3/projects/f549cff5b46c419a80f7b379ac3ed52e/users/7f6bdce2b1b049db8ad51559cad1ec2e/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:28.026815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dd0d3-bc8e-4981-81cd-7e8634deae01 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:28.032166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb35b8-03b8-4a87-91c0-877686c8ffa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:28.032803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb35b8-03b8-4a87-91c0-877686c8ffa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:28.033175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb35b8-03b8-4a87-91c0-877686c8ffa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:28.033599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb35b8-03b8-4a87-91c0-877686c8ffa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:28.034246 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb35b8-03b8-4a87-91c0-877686c8ffa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:28.035852 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb35b8-03b8-4a87-91c0-877686c8ffa6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:28.039069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5ec56-b059-4313-b7cc-71932d086a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f549cff5b46c419a80f7b379ac3ed52e, user_id=7f6bdce2b1b049db8ad51559cad1ec2e, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:28.041821 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5ec56-b059-4313-b7cc-71932d086a67 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:28.047075 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1100/2205] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:28.051453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb35b8-03b8-4a87-91c0-877686c8ffa6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:28.051994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:28.057715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1106/2206] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:27 2022] PUT /identity/v3/projects/f549cff5b46c419a80f7b379ac3ed52e/users/7f6bdce2b1b049db8ad51559cad1ec2e/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:28.061753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5ec56-b059-4313-b7cc-71932d086a67 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:28.062820 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb35b8-03b8-4a87-91c0-877686c8ffa6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:28.094699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:28.134713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a23eb-a820-4f83-bb52-5df0e7fd7d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:28.135512 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a23eb-a820-4f83-bb52-5df0e7fd7d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:28.136016 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a23eb-a820-4f83-bb52-5df0e7fd7d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:28.136369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a23eb-a820-4f83-bb52-5df0e7fd7d5b admin admin] PATH_INFO: `/v3/projects/fc4608eec11448daadf5bb9242109424/users/81bad16e816d42c7b119adbea5527945/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:28.138524 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a23eb-a820-4f83-bb52-5df0e7fd7d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4608eec11448daadf5bb9242109424, user_id=81bad16e816d42c7b119adbea5527945, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:28.141331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a23eb-a820-4f83-bb52-5df0e7fd7d5b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:28.145489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5ec56-b059-4313-b7cc-71932d086a67 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:28.153031 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1101/2207] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:28 2022] PUT /identity/v3/projects/fc4608eec11448daadf5bb9242109424/users/81bad16e816d42c7b119adbea5527945/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:28.163031 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b975a27-cf33-4bb3-b6a3-03c16eef1eab None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:28.163313 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b975a27-cf33-4bb3-b6a3-03c16eef1eab None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:28.163583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b975a27-cf33-4bb3-b6a3-03c16eef1eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:28.191552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8b975a27-cf33-4bb3-b6a3-03c16eef1eab None None] MFA Rules not processed for user `81bad16e816d42c7b119adbea5527945`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:28.192798 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8b975a27-cf33-4bb3-b6a3-03c16eef1eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:28.202489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c51a3c-2960-4869-94a4-ace685c31137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:28.203286 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c51a3c-2960-4869-94a4-ace685c31137 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:28.203575 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c51a3c-2960-4869-94a4-ace685c31137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:28.203848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c51a3c-2960-4869-94a4-ace685c31137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:28.204629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c51a3c-2960-4869-94a4-ace685c31137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:28.206470 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c51a3c-2960-4869-94a4-ace685c31137 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:28.217971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1107/2208] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:28.222206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c51a3c-2960-4869-94a4-ace685c31137 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:28.234219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c51a3c-2960-4869-94a4-ace685c31137 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:28.238960 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf408f-4873-4789-bb37-dffb280ce113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:28.239607 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf408f-4873-4789-bb37-dffb280ce113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:28.239905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf408f-4873-4789-bb37-dffb280ce113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:28.240183 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf408f-4873-4789-bb37-dffb280ce113 admin admin] PATH_INFO: `/v3/projects/f549cff5b46c419a80f7b379ac3ed52e/users/7f6bdce2b1b049db8ad51559cad1ec2e/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:28.242167 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf408f-4873-4789-bb37-dffb280ce113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f549cff5b46c419a80f7b379ac3ed52e, user_id=7f6bdce2b1b049db8ad51559cad1ec2e, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:28.244825 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf408f-4873-4789-bb37-dffb280ce113 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:28.255308 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1108/2209] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:28 2022] PUT /identity/v3/projects/f549cff5b46c419a80f7b379ac3ed52e/users/7f6bdce2b1b049db8ad51559cad1ec2e/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:28.266691 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa621728-4301-42b5-8960-99f80725bf32 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:28.267343 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa621728-4301-42b5-8960-99f80725bf32 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:28.267624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa621728-4301-42b5-8960-99f80725bf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:28.271906 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1102/2210] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:28.283531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b975a27-cf33-4bb3-b6a3-03c16eef1eab None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:28.285063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8b975a27-cf33-4bb3-b6a3-03c16eef1eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:28.298557 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-aa621728-4301-42b5-8960-99f80725bf32 None None] MFA Rules not processed for user `7f6bdce2b1b049db8ad51559cad1ec2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:28.299780 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-aa621728-4301-42b5-8960-99f80725bf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:28.352842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b975a27-cf33-4bb3-b6a3-03c16eef1eab None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:28.386029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1109/2211] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:28.398051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa621728-4301-42b5-8960-99f80725bf32 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:28.399632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-aa621728-4301-42b5-8960-99f80725bf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:28.417200 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097f440-c912-4143-9b68-f6c75128137e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:28.417817 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097f440-c912-4143-9b68-f6c75128137e service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:28.418169 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097f440-c912-4143-9b68-f6c75128137e service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:28.418983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097f440-c912-4143-9b68-f6c75128137e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:28.423767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:28.441446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:28.468076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa621728-4301-42b5-8960-99f80725bf32 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:28.473923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779f1ee-ffb7-4ab9-8568-657c49339c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:28.474556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779f1ee-ffb7-4ab9-8568-657c49339c89 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:28.474835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779f1ee-ffb7-4ab9-8568-657c49339c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:28.475108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779f1ee-ffb7-4ab9-8568-657c49339c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:28.485419 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779f1ee-ffb7-4ab9-8568-657c49339c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:28.486859 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779f1ee-ffb7-4ab9-8568-657c49339c89 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:28.488022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097f440-c912-4143-9b68-f6c75128137e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:28.489528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097f440-c912-4143-9b68-f6c75128137e service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:28.497124 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1110/2212] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:28.499134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1103/2213] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:28.585841 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779f1ee-ffb7-4ab9-8568-657c49339c89 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:28.596004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779f1ee-ffb7-4ab9-8568-657c49339c89 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:28.600079 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f59dc5-f52b-4117-a009-f01cc0725ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:28.600912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f59dc5-f52b-4117-a009-f01cc0725ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:28.601283 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f59dc5-f52b-4117-a009-f01cc0725ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:28.601674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f59dc5-f52b-4117-a009-f01cc0725ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:28.667137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f59dc5-f52b-4117-a009-f01cc0725ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:28.668693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f59dc5-f52b-4117-a009-f01cc0725ef0 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:28.678099 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1111/2214] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:30.123660 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097f440-c912-4143-9b68-f6c75128137e service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:30.133407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097f440-c912-4143-9b68-f6c75128137e service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:30.137842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807baf6b-cae2-4ab9-b9c4-864cce6b5cc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:30.138789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807baf6b-cae2-4ab9-b9c4-864cce6b5cc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:30.139068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807baf6b-cae2-4ab9-b9c4-864cce6b5cc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:30.139335 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807baf6b-cae2-4ab9-b9c4-864cce6b5cc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:30.210108 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807baf6b-cae2-4ab9-b9c4-864cce6b5cc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:30.211997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807baf6b-cae2-4ab9-b9c4-864cce6b5cc4 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:30.222217 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1104/2215] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:30.862217 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f59dc5-f52b-4117-a009-f01cc0725ef0 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:30.870599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f59dc5-f52b-4117-a009-f01cc0725ef0 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:30.875038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf7b13-220e-4d16-8678-e85d286610f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:30.875625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7b13-220e-4d16-8678-e85d286610f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:30.875898 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7b13-220e-4d16-8678-e85d286610f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:30.876163 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7b13-220e-4d16-8678-e85d286610f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:30.939099 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf7b13-220e-4d16-8678-e85d286610f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:30.940436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf7b13-220e-4d16-8678-e85d286610f2 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:30.950338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1112/2216] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:32.099745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807baf6b-cae2-4ab9-b9c4-864cce6b5cc4 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:32.171972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807baf6b-cae2-4ab9-b9c4-864cce6b5cc4 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:32.176822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021f7ae-6c1a-457c-89fb-d756fe4d82e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:32.177290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021f7ae-6c1a-457c-89fb-d756fe4d82e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:32.177564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021f7ae-6c1a-457c-89fb-d756fe4d82e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:32.177829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021f7ae-6c1a-457c-89fb-d756fe4d82e0 admin admin] PATH_INFO: `/v3/users/44fddbd3984b46dd9098784c9f29bacf` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:32.178951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021f7ae-6c1a-457c-89fb-d756fe4d82e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44fddbd3984b46dd9098784c9f29bacf)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:32.181057 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021f7ae-6c1a-457c-89fb-d756fe4d82e0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:32.260982 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7021f7ae-6c1a-457c-89fb-d756fe4d82e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44fddbd3984b46dd9098784c9f29bacf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:32.273223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7021f7ae-6c1a-457c-89fb-d756fe4d82e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44fddbd3984b46dd9098784c9f29bacf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:32.284170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:32.294868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7021f7ae-6c1a-457c-89fb-d756fe4d82e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44fddbd3984b46dd9098784c9f29bacf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:32.306653 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7021f7ae-6c1a-457c-89fb-d756fe4d82e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44fddbd3984b46dd9098784c9f29bacf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:32.308269 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7021f7ae-6c1a-457c-89fb-d756fe4d82e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44fddbd3984b46dd9098784c9f29bacf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:32.318554 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1105/2217] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:32 2022] DELETE /identity/v3/users/44fddbd3984b46dd9098784c9f29bacf => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:32.323655 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e6220-a291-49da-9a1c-c9612ed5ba18 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:32.324341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e6220-a291-49da-9a1c-c9612ed5ba18 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:32.324341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e6220-a291-49da-9a1c-c9612ed5ba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:32.348823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-093e6220-a291-49da-9a1c-c9612ed5ba18 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:32.350138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-093e6220-a291-49da-9a1c-c9612ed5ba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:32.405128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:32.426199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1113/2218] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:32.442048 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021f7ae-6c1a-457c-89fb-d756fe4d82e0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:32.443772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7021f7ae-6c1a-457c-89fb-d756fe4d82e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:32.520179 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021f7ae-6c1a-457c-89fb-d756fe4d82e0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:32.524200 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904760eb-9675-4f9a-80a3-175e22089b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:32.524847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904760eb-9675-4f9a-80a3-175e22089b41 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:32.525115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904760eb-9675-4f9a-80a3-175e22089b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:32.525392 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904760eb-9675-4f9a-80a3-175e22089b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:32.535720 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904760eb-9675-4f9a-80a3-175e22089b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:32.537274 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904760eb-9675-4f9a-80a3-175e22089b41 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:32.548134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1106/2219] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:32.830707 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e6220-a291-49da-9a1c-c9612ed5ba18 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:32.831433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-093e6220-a291-49da-9a1c-c9612ed5ba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:32.845101 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e6220-a291-49da-9a1c-c9612ed5ba18 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:32.851176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:32.851802 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:32.852081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:32.852357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a admin admin] PATH_INFO: `/v3/projects/04852665f0204cee8a6d699e9edf7405` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:32.853633 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=04852665f0204cee8a6d699e9edf7405)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:32.856240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:32.908200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04852665f0204cee8a6d699e9edf7405', 'request_id': 'req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:32.913660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04852665f0204cee8a6d699e9edf7405', 'request_id': 'req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:32.921235 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04852665f0204cee8a6d699e9edf7405', 'request_id': 'req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:32.932516 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a admin admin] The token cache is being invalidate because project 04852665f0204cee8a6d699e9edf7405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:32.932838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:32.933480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:32.935126 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1114/2220] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:32 2022] DELETE /identity/v3/projects/04852665f0204cee8a6d699e9edf7405 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:32.940254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904760eb-9675-4f9a-80a3-175e22089b41 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:32.957343 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904760eb-9675-4f9a-80a3-175e22089b41 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:33.017180 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff92944-7369-4565-9741-c77524901136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:33.017736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff92944-7369-4565-9741-c77524901136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:33.018016 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff92944-7369-4565-9741-c77524901136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:33.018290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff92944-7369-4565-9741-c77524901136 admin admin] PATH_INFO: `/v3/users/7f6bdce2b1b049db8ad51559cad1ec2e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:33.019416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff92944-7369-4565-9741-c77524901136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6bdce2b1b049db8ad51559cad1ec2e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:33.021383 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff92944-7369-4565-9741-c77524901136 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:33.066780 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7ff92944-7369-4565-9741-c77524901136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6bdce2b1b049db8ad51559cad1ec2e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:33.075301 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7ff92944-7369-4565-9741-c77524901136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6bdce2b1b049db8ad51559cad1ec2e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:33.087215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7ff92944-7369-4565-9741-c77524901136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6bdce2b1b049db8ad51559cad1ec2e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:33.094657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7ff92944-7369-4565-9741-c77524901136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6bdce2b1b049db8ad51559cad1ec2e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:33.095409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7ff92944-7369-4565-9741-c77524901136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6bdce2b1b049db8ad51559cad1ec2e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:33.101778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1107/2221] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:32 2022] DELETE /identity/v3/users/7f6bdce2b1b049db8ad51559cad1ec2e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:33.373767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:33.375723 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:33.391536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0da5c7-59d8-4ac4-aa5b-5817de8f2d5a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:33.481746 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a38c8-503c-4a01-9478-0b6f1446a4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:33.482548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a38c8-503c-4a01-9478-0b6f1446a4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:33.482829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a38c8-503c-4a01-9478-0b6f1446a4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:33.483118 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a38c8-503c-4a01-9478-0b6f1446a4e4 admin admin] PATH_INFO: `/v3/projects/f549cff5b46c419a80f7b379ac3ed52e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:33.484484 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a38c8-503c-4a01-9478-0b6f1446a4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f549cff5b46c419a80f7b379ac3ed52e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:33.486533 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a38c8-503c-4a01-9478-0b6f1446a4e4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:33.559378 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-617a38c8-503c-4a01-9478-0b6f1446a4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f549cff5b46c419a80f7b379ac3ed52e', 'request_id': 'req-617a38c8-503c-4a01-9478-0b6f1446a4e4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:33.570075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-617a38c8-503c-4a01-9478-0b6f1446a4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f549cff5b46c419a80f7b379ac3ed52e', 'request_id': 'req-617a38c8-503c-4a01-9478-0b6f1446a4e4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:33.579650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-617a38c8-503c-4a01-9478-0b6f1446a4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f549cff5b46c419a80f7b379ac3ed52e', 'request_id': 'req-617a38c8-503c-4a01-9478-0b6f1446a4e4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:33.596961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-617a38c8-503c-4a01-9478-0b6f1446a4e4 admin admin] The token cache is being invalidate because project f549cff5b46c419a80f7b379ac3ed52e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:33.597211 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-617a38c8-503c-4a01-9478-0b6f1446a4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:33.597903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-617a38c8-503c-4a01-9478-0b6f1446a4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:33.599658 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1115/2222] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:33 2022] DELETE /identity/v3/projects/f549cff5b46c419a80f7b379ac3ed52e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:33.605423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77be94-4417-4f7d-be22-70c9b800d254 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:33.605672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77be94-4417-4f7d-be22-70c9b800d254 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:33.606284 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77be94-4417-4f7d-be22-70c9b800d254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:33.614750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:33.630373 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0a77be94-4417-4f7d-be22-70c9b800d254 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:33.631958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0a77be94-4417-4f7d-be22-70c9b800d254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:33.700657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1108/2223] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:33.708778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e956e-7877-45a5-a0f6-f1b05a04bc52 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:33.709241 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e956e-7877-45a5-a0f6-f1b05a04bc52 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:33.709578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e956e-7877-45a5-a0f6-f1b05a04bc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:33.718501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:33.731322 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-664e956e-7877-45a5-a0f6-f1b05a04bc52 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:33.732683 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-664e956e-7877-45a5-a0f6-f1b05a04bc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:33.747084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1116/2224] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:33.750437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77be94-4417-4f7d-be22-70c9b800d254 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:33.760379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77be94-4417-4f7d-be22-70c9b800d254 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:33.766626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f022ecb-9a47-4658-80d9-864de4121dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:33.766626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f022ecb-9a47-4658-80d9-864de4121dfc admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:33.766897 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f022ecb-9a47-4658-80d9-864de4121dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:33.767165 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f022ecb-9a47-4658-80d9-864de4121dfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:33.767812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f022ecb-9a47-4658-80d9-864de4121dfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:33.768191 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f022ecb-9a47-4658-80d9-864de4121dfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:33.769789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f022ecb-9a47-4658-80d9-864de4121dfc admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:33.782393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1109/2225] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:26:33.786961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e956e-7877-45a5-a0f6-f1b05a04bc52 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:33.797728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e956e-7877-45a5-a0f6-f1b05a04bc52 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:33.803317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b99715-a961-4f09-b200-44a2da05011f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:33.804263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b99715-a961-4f09-b200-44a2da05011f admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:33.804263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b99715-a961-4f09-b200-44a2da05011f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:33.804865 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b99715-a961-4f09-b200-44a2da05011f admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:33.805909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b99715-a961-4f09-b200-44a2da05011f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:33.807903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b99715-a961-4f09-b200-44a2da05011f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:33.839763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1117/2226] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:33 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:33.843806 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f022ecb-9a47-4658-80d9-864de4121dfc admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:33.854217 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f022ecb-9a47-4658-80d9-864de4121dfc admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:33.924146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4e1b5-d598-44b4-8f26-bd323c43586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:33.924783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4e1b5-d598-44b4-8f26-bd323c43586e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:33.925063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4e1b5-d598-44b4-8f26-bd323c43586e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:33.925341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4e1b5-d598-44b4-8f26-bd323c43586e admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:33.925983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4e1b5-d598-44b4-8f26-bd323c43586e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:33.927883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4e1b5-d598-44b4-8f26-bd323c43586e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:33.950740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1110/2227] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:33 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:33.954613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b99715-a961-4f09-b200-44a2da05011f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:33.965475 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b99715-a961-4f09-b200-44a2da05011f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:33.969994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22a6ab-cc22-493e-9a79-6c004c73845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:33.970577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22a6ab-cc22-493e-9a79-6c004c73845d admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:33.970851 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22a6ab-cc22-493e-9a79-6c004c73845d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:33.971119 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22a6ab-cc22-493e-9a79-6c004c73845d admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:33.971756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22a6ab-cc22-493e-9a79-6c004c73845d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:33.973428 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22a6ab-cc22-493e-9a79-6c004c73845d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:33.987126 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1118/2228] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:33.993738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4e1b5-d598-44b4-8f26-bd323c43586e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:34.006831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4e1b5-d598-44b4-8f26-bd323c43586e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:34.014603 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf7e51-2833-472e-9a9e-a6bf6bc5d1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:34.015650 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf7e51-2833-472e-9a9e-a6bf6bc5d1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:34.016424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf7e51-2833-472e-9a9e-a6bf6bc5d1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:34.016739 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf7e51-2833-472e-9a9e-a6bf6bc5d1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:34.018311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf7e51-2833-472e-9a9e-a6bf6bc5d1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:34.020082 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf7e51-2833-472e-9a9e-a6bf6bc5d1c9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:34.034853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1111/2229] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:34.038836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22a6ab-cc22-493e-9a79-6c004c73845d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:34.049858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22a6ab-cc22-493e-9a79-6c004c73845d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:34.054798 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91549fc5-6342-48d6-ae56-3f3c2ea890c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:34.055473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91549fc5-6342-48d6-ae56-3f3c2ea890c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:34.055759 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91549fc5-6342-48d6-ae56-3f3c2ea890c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:34.056074 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91549fc5-6342-48d6-ae56-3f3c2ea890c8 admin admin] PATH_INFO: `/v3/projects/7a26bc0b1b264546b395e42df7101b48/users/ce44887cb82747a190c9132c39333ade/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:34.071579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91549fc5-6342-48d6-ae56-3f3c2ea890c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a26bc0b1b264546b395e42df7101b48, user_id=ce44887cb82747a190c9132c39333ade, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:34.074303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91549fc5-6342-48d6-ae56-3f3c2ea890c8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:34.087092 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1119/2230] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:34 2022] PUT /identity/v3/projects/7a26bc0b1b264546b395e42df7101b48/users/ce44887cb82747a190c9132c39333ade/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:34.097757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d9bde-7ffb-47fe-9b73-5ad7426b25bf None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:34.098542 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d9bde-7ffb-47fe-9b73-5ad7426b25bf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:34.098818 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d9bde-7ffb-47fe-9b73-5ad7426b25bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:34.128372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b42d9bde-7ffb-47fe-9b73-5ad7426b25bf None None] MFA Rules not processed for user `ce44887cb82747a190c9132c39333ade`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:34.129648 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b42d9bde-7ffb-47fe-9b73-5ad7426b25bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:34.189809 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:34.196394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1112/2231] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:34.201022 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91549fc5-6342-48d6-ae56-3f3c2ea890c8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:34.266860 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91549fc5-6342-48d6-ae56-3f3c2ea890c8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:34.271834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73c27-0245-47b6-8eb6-04aee8bc3737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:34.272429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73c27-0245-47b6-8eb6-04aee8bc3737 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:34.272746 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73c27-0245-47b6-8eb6-04aee8bc3737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:34.273044 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73c27-0245-47b6-8eb6-04aee8bc3737 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:34.273687 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec73c27-0245-47b6-8eb6-04aee8bc3737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:34.275647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec73c27-0245-47b6-8eb6-04aee8bc3737 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:34.306480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1120/2232] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:34 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:34.310351 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d9bde-7ffb-47fe-9b73-5ad7426b25bf None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:34.321878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d9bde-7ffb-47fe-9b73-5ad7426b25bf None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:34.378584 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648520f1-cd58-47cf-8be9-3ac7e713421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:34.379202 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648520f1-cd58-47cf-8be9-3ac7e713421d admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:34.379482 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648520f1-cd58-47cf-8be9-3ac7e713421d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:34.379755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648520f1-cd58-47cf-8be9-3ac7e713421d admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:34.380390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648520f1-cd58-47cf-8be9-3ac7e713421d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:34.382444 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648520f1-cd58-47cf-8be9-3ac7e713421d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:34.407377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1113/2233] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:34 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:34.411290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73c27-0245-47b6-8eb6-04aee8bc3737 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:34.422340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73c27-0245-47b6-8eb6-04aee8bc3737 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:34.427244 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b62b9-6478-4bd4-b51e-593f1a03d3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:34.427857 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b62b9-6478-4bd4-b51e-593f1a03d3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:34.428178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b62b9-6478-4bd4-b51e-593f1a03d3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:34.428450 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b62b9-6478-4bd4-b51e-593f1a03d3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:34.429221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b62b9-6478-4bd4-b51e-593f1a03d3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:34.430830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b62b9-6478-4bd4-b51e-593f1a03d3d4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:34.441726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1121/2234] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:34.445997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648520f1-cd58-47cf-8be9-3ac7e713421d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:34.456026 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648520f1-cd58-47cf-8be9-3ac7e713421d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:34.460699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d466b-5f9f-40c9-b5bb-08efce4a830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:34.461338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d466b-5f9f-40c9-b5bb-08efce4a830f admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:34.461614 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d466b-5f9f-40c9-b5bb-08efce4a830f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:34.461885 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d466b-5f9f-40c9-b5bb-08efce4a830f admin admin] PATH_INFO: `/v3/projects/9a47b1b4c929462f8a4e9d87ea541496/users/a967f0b691914b28b96a67407417730d/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:34.477104 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d466b-5f9f-40c9-b5bb-08efce4a830f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a47b1b4c929462f8a4e9d87ea541496, user_id=a967f0b691914b28b96a67407417730d, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:34.479729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d466b-5f9f-40c9-b5bb-08efce4a830f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:34.495091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1114/2235] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:34 2022] PUT /identity/v3/projects/9a47b1b4c929462f8a4e9d87ea541496/users/a967f0b691914b28b96a67407417730d/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:34.500151 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b62b9-6478-4bd4-b51e-593f1a03d3d4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:34.512633 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b62b9-6478-4bd4-b51e-593f1a03d3d4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:34.559033 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d466b-5f9f-40c9-b5bb-08efce4a830f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:34.561221 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c80d466b-5f9f-40c9-b5bb-08efce4a830f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:34.571508 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e07dd-3dfc-4a25-831a-d77e58360df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:34.572235 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e07dd-3dfc-4a25-831a-d77e58360df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:34.572548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e07dd-3dfc-4a25-831a-d77e58360df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:34.572926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e07dd-3dfc-4a25-831a-d77e58360df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:34.573915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e07dd-3dfc-4a25-831a-d77e58360df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:34.576534 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e07dd-3dfc-4a25-831a-d77e58360df9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:34.588191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1122/2236] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:34.594159 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e07dd-3dfc-4a25-831a-d77e58360df9 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:34.604262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e07dd-3dfc-4a25-831a-d77e58360df9 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:34.609907 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e3de4-7573-482a-a82c-c9b5ec316e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:34.610559 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3de4-7573-482a-a82c-c9b5ec316e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:34.610838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3de4-7573-482a-a82c-c9b5ec316e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:34.611107 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3de4-7573-482a-a82c-c9b5ec316e5e admin admin] PATH_INFO: `/v3/projects/9a47b1b4c929462f8a4e9d87ea541496/users/a967f0b691914b28b96a67407417730d/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:34.613158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e3de4-7573-482a-a82c-c9b5ec316e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a47b1b4c929462f8a4e9d87ea541496, user_id=a967f0b691914b28b96a67407417730d, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:34.615909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e3de4-7573-482a-a82c-c9b5ec316e5e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:34.621762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:34.629892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1123/2237] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:34 2022] PUT /identity/v3/projects/9a47b1b4c929462f8a4e9d87ea541496/users/a967f0b691914b28b96a67407417730d/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:34.634741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d466b-5f9f-40c9-b5bb-08efce4a830f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:34.643164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22458c0-d89a-4741-98ea-1ea794034c04 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:34.643460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22458c0-d89a-4741-98ea-1ea794034c04 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:34.643738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22458c0-d89a-4741-98ea-1ea794034c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:34.679341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a22458c0-d89a-4741-98ea-1ea794034c04 None None] MFA Rules not processed for user `a967f0b691914b28b96a67407417730d`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:34.687273 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a22458c0-d89a-4741-98ea-1ea794034c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:34.725876 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a684a-90a8-4602-b518-85dfcfd6921e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:34.726934 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a684a-90a8-4602-b518-85dfcfd6921e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:34.727485 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a684a-90a8-4602-b518-85dfcfd6921e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:34.728046 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a684a-90a8-4602-b518-85dfcfd6921e admin admin] PATH_INFO: `/v3/users/41411a04ebda4b01918afcaca2bb3fd4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:34.729862 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a684a-90a8-4602-b518-85dfcfd6921e admin admin] RBAC: Authorizing `identity:delete_user(user_id=41411a04ebda4b01918afcaca2bb3fd4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:34.731726 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a684a-90a8-4602-b518-85dfcfd6921e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:34.752727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:34.771896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1124/2238] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:34.786081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22458c0-d89a-4741-98ea-1ea794034c04 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:34.787743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a22458c0-d89a-4741-98ea-1ea794034c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:34.796921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ef7a684a-90a8-4602-b518-85dfcfd6921e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41411a04ebda4b01918afcaca2bb3fd4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:34.804886 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ef7a684a-90a8-4602-b518-85dfcfd6921e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41411a04ebda4b01918afcaca2bb3fd4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:34.821409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ef7a684a-90a8-4602-b518-85dfcfd6921e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41411a04ebda4b01918afcaca2bb3fd4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:34.831634 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ef7a684a-90a8-4602-b518-85dfcfd6921e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41411a04ebda4b01918afcaca2bb3fd4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:34.832388 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ef7a684a-90a8-4602-b518-85dfcfd6921e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41411a04ebda4b01918afcaca2bb3fd4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:34.838623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1115/2239] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:34 2022] DELETE /identity/v3/users/41411a04ebda4b01918afcaca2bb3fd4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:34.842929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d6815-2950-4c1f-9d67-45afabd3361f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:34.843215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d6815-2950-4c1f-9d67-45afabd3361f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:34.843487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d6815-2950-4c1f-9d67-45afabd3361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:34.859580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22458c0-d89a-4741-98ea-1ea794034c04 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:34.862879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7d0d6815-2950-4c1f-9d67-45afabd3361f None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:34.864109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7d0d6815-2950-4c1f-9d67-45afabd3361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:34.923633 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bf964-def5-4eb2-8306-208c9b53c564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:34.924268 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bf964-def5-4eb2-8306-208c9b53c564 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:34.924547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bf964-def5-4eb2-8306-208c9b53c564 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:34.924849 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bf964-def5-4eb2-8306-208c9b53c564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:34.938143 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d65bf964-def5-4eb2-8306-208c9b53c564 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:34.943900 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1116/2240] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:34.953233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d6815-2950-4c1f-9d67-45afabd3361f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:34.954708 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7d0d6815-2950-4c1f-9d67-45afabd3361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:35.012449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:35.029529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bf964-def5-4eb2-8306-208c9b53c564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:35.030986 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bf964-def5-4eb2-8306-208c9b53c564 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:35.035902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d6815-2950-4c1f-9d67-45afabd3361f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:35.040174 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a870c6-6dbe-425c-a00f-b8931440a969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:35.040808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a870c6-6dbe-425c-a00f-b8931440a969 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:35.041086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a870c6-6dbe-425c-a00f-b8931440a969 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:35.041482 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1125/2241] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:35.041601 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a870c6-6dbe-425c-a00f-b8931440a969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:35.042031 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bf964-def5-4eb2-8306-208c9b53c564 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:35.043923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d65bf964-def5-4eb2-8306-208c9b53c564 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:35.051663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a870c6-6dbe-425c-a00f-b8931440a969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:35.053267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a870c6-6dbe-425c-a00f-b8931440a969 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:35.057045 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bf964-def5-4eb2-8306-208c9b53c564 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:35.062078 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec73ec-6d58-4446-b707-afdc794a905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:35.062600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec73ec-6d58-4446-b707-afdc794a905c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:35.062879 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec73ec-6d58-4446-b707-afdc794a905c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:35.063208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec73ec-6d58-4446-b707-afdc794a905c admin admin] PATH_INFO: `/v3/users/c445012655f1402a982cbfe0bb50d9a8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:35.064339 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec73ec-6d58-4446-b707-afdc794a905c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c445012655f1402a982cbfe0bb50d9a8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:35.065537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1117/2242] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:35.066604 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec73ec-6d58-4446-b707-afdc794a905c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:35.125307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a870c6-6dbe-425c-a00f-b8931440a969 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:35.127773 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e1a870c6-6dbe-425c-a00f-b8931440a969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:35.141457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e2ec73ec-6d58-4446-b707-afdc794a905c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c445012655f1402a982cbfe0bb50d9a8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:35.146718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a870c6-6dbe-425c-a00f-b8931440a969 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:35.152229 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c2d17-012e-4129-8d79-3fb4736445f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:35.153477 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c2d17-012e-4129-8d79-3fb4736445f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:35.153841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c2d17-012e-4129-8d79-3fb4736445f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:35.154186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c2d17-012e-4129-8d79-3fb4736445f3 admin admin] PATH_INFO: `/v3/users/ce44887cb82747a190c9132c39333ade` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:35.155616 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c2d17-012e-4129-8d79-3fb4736445f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce44887cb82747a190c9132c39333ade)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:35.157625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e2ec73ec-6d58-4446-b707-afdc794a905c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c445012655f1402a982cbfe0bb50d9a8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:35.157949 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c2d17-012e-4129-8d79-3fb4736445f3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:35.168052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e2ec73ec-6d58-4446-b707-afdc794a905c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c445012655f1402a982cbfe0bb50d9a8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:35.177109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e2ec73ec-6d58-4446-b707-afdc794a905c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c445012655f1402a982cbfe0bb50d9a8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:35.177718 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e2ec73ec-6d58-4446-b707-afdc794a905c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c445012655f1402a982cbfe0bb50d9a8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:35.184794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1126/2243] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:35 2022] DELETE /identity/v3/users/c445012655f1402a982cbfe0bb50d9a8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:35.189437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80149245-717b-4d67-958f-8757455af4ca None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:35.189680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80149245-717b-4d67-958f-8757455af4ca None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:35.189984 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80149245-717b-4d67-958f-8757455af4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:35.195683 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:35.217775 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-80149245-717b-4d67-958f-8757455af4ca None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:35.219544 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-80149245-717b-4d67-958f-8757455af4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:35.222237 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d37c2d17-012e-4129-8d79-3fb4736445f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce44887cb82747a190c9132c39333ade'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:35.236330 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d37c2d17-012e-4129-8d79-3fb4736445f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce44887cb82747a190c9132c39333ade'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:35.268748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d37c2d17-012e-4129-8d79-3fb4736445f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce44887cb82747a190c9132c39333ade'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:35.281014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d37c2d17-012e-4129-8d79-3fb4736445f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce44887cb82747a190c9132c39333ade'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:35.282864 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d37c2d17-012e-4129-8d79-3fb4736445f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce44887cb82747a190c9132c39333ade'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:35.290757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1118/2244] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:35 2022] DELETE /identity/v3/users/ce44887cb82747a190c9132c39333ade => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:35.295325 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94a16-df66-4bb3-a2dc-9209b935e096 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:35.295623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94a16-df66-4bb3-a2dc-9209b935e096 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:35.295900 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94a16-df66-4bb3-a2dc-9209b935e096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:35.305307 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1127/2245] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:35.315939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-94f94a16-df66-4bb3-a2dc-9209b935e096 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:35.317215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-94f94a16-df66-4bb3-a2dc-9209b935e096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:35.318563 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80149245-717b-4d67-958f-8757455af4ca None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:35.320190 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-80149245-717b-4d67-958f-8757455af4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:35.393702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1119/2246] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:35.394631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f94a16-df66-4bb3-a2dc-9209b935e096 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:35.395906 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-94f94a16-df66-4bb3-a2dc-9209b935e096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:35.396364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80149245-717b-4d67-958f-8757455af4ca None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:35.416112 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:35.418386 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f94a16-df66-4bb3-a2dc-9209b935e096 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:35.424075 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc1fb0-4340-4eb7-9bbc-43fa1a499202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:35.424852 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc1fb0-4340-4eb7-9bbc-43fa1a499202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:35.425211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc1fb0-4340-4eb7-9bbc-43fa1a499202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:35.426167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc1fb0-4340-4eb7-9bbc-43fa1a499202 admin admin] PATH_INFO: `/v3/projects/88766412e7ea477d8f255250b264b892` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:35.427853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc1fb0-4340-4eb7-9bbc-43fa1a499202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88766412e7ea477d8f255250b264b892)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:35.429937 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc1fb0-4340-4eb7-9bbc-43fa1a499202 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:35.455603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402c08c-825d-4bd6-9800-f4646bdb1556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:35.456203 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402c08c-825d-4bd6-9800-f4646bdb1556 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:35.456478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402c08c-825d-4bd6-9800-f4646bdb1556 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:35.456775 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402c08c-825d-4bd6-9800-f4646bdb1556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:35.471837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402c08c-825d-4bd6-9800-f4646bdb1556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:35.474009 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402c08c-825d-4bd6-9800-f4646bdb1556 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:35.489399 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1128/2247] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:35.490338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402c08c-825d-4bd6-9800-f4646bdb1556 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:35.492690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f7fc1fb0-4340-4eb7-9bbc-43fa1a499202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88766412e7ea477d8f255250b264b892', 'request_id': 'req-f7fc1fb0-4340-4eb7-9bbc-43fa1a499202'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:35.498548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402c08c-825d-4bd6-9800-f4646bdb1556 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:35.502108 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f7fc1fb0-4340-4eb7-9bbc-43fa1a499202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88766412e7ea477d8f255250b264b892', 'request_id': 'req-f7fc1fb0-4340-4eb7-9bbc-43fa1a499202'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:35.510131 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f7fc1fb0-4340-4eb7-9bbc-43fa1a499202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88766412e7ea477d8f255250b264b892', 'request_id': 'req-f7fc1fb0-4340-4eb7-9bbc-43fa1a499202'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:35.523953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f7fc1fb0-4340-4eb7-9bbc-43fa1a499202 admin admin] The token cache is being invalidate because project 88766412e7ea477d8f255250b264b892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:35.524245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f7fc1fb0-4340-4eb7-9bbc-43fa1a499202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:35.526035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f7fc1fb0-4340-4eb7-9bbc-43fa1a499202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:35.528948 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1120/2248] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:35 2022] DELETE /identity/v3/projects/88766412e7ea477d8f255250b264b892 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:35.533829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10619d1-4a4c-459f-baf5-871d98f31d5f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:35.534111 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10619d1-4a4c-459f-baf5-871d98f31d5f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:35.534386 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10619d1-4a4c-459f-baf5-871d98f31d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:35.555986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f10619d1-4a4c-459f-baf5-871d98f31d5f None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:35.557300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f10619d1-4a4c-459f-baf5-871d98f31d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:35.559195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6c949-0a82-4fc5-865c-d86198bd397a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:35.559923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6c949-0a82-4fc5-865c-d86198bd397a service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:35.560206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6c949-0a82-4fc5-865c-d86198bd397a service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:35.560665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6c949-0a82-4fc5-865c-d86198bd397a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:35.562241 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b3f6c949-0a82-4fc5-865c-d86198bd397a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:35.589524 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:35.638212 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1121/2249] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:35.640023 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb946c4-b057-4df0-80b8-3da65b458c71 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:35.640320 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb946c4-b057-4df0-80b8-3da65b458c71 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:35.640616 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb946c4-b057-4df0-80b8-3da65b458c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:35.662962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6c949-0a82-4fc5-865c-d86198bd397a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:35.663956 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-abb946c4-b057-4df0-80b8-3da65b458c71 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:35.664900 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6c949-0a82-4fc5-865c-d86198bd397a service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:35.665207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-abb946c4-b057-4df0-80b8-3da65b458c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:35.676272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1129/2250] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:35.678021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1122/2251] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:35.682909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6c949-0a82-4fc5-865c-d86198bd397a service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:35.693568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6c949-0a82-4fc5-865c-d86198bd397a service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:35.698607 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf830-15b9-4459-88eb-fb9577ef8aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:35.699409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf830-15b9-4459-88eb-fb9577ef8aae admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:35.700397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf830-15b9-4459-88eb-fb9577ef8aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:35.700823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf830-15b9-4459-88eb-fb9577ef8aae admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:35.701525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf830-15b9-4459-88eb-fb9577ef8aae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:35.701856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf830-15b9-4459-88eb-fb9577ef8aae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:35.703472 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf830-15b9-4459-88eb-fb9577ef8aae admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:35.718308 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1130/2252] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:26:35.722179 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb946c4-b057-4df0-80b8-3da65b458c71 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:35.731999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb946c4-b057-4df0-80b8-3da65b458c71 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:35.737339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b7393-da00-4bb4-89db-1dfcb1ebe76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:35.737961 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b7393-da00-4bb4-89db-1dfcb1ebe76b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:35.738243 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b7393-da00-4bb4-89db-1dfcb1ebe76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:35.738523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b7393-da00-4bb4-89db-1dfcb1ebe76b admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:35.739171 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b7393-da00-4bb4-89db-1dfcb1ebe76b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:35.741248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b7393-da00-4bb4-89db-1dfcb1ebe76b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:35.781064 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1123/2253] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:35 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:35.785389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf830-15b9-4459-88eb-fb9577ef8aae admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:35.796827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf830-15b9-4459-88eb-fb9577ef8aae admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:35.872146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:35.878672 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5385c9-5c49-4940-bf37-f442a71b3245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:35.879555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5385c9-5c49-4940-bf37-f442a71b3245 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:35.879834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5385c9-5c49-4940-bf37-f442a71b3245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:35.880130 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5385c9-5c49-4940-bf37-f442a71b3245 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:35.880814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5385c9-5c49-4940-bf37-f442a71b3245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:35.882731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5385c9-5c49-4940-bf37-f442a71b3245 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:35.906566 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1131/2254] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:35 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:35.910968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b7393-da00-4bb4-89db-1dfcb1ebe76b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:35.923599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b7393-da00-4bb4-89db-1dfcb1ebe76b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:35.928397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2423186-8d8a-4d17-905d-d3998ff1a128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:35.929155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2423186-8d8a-4d17-905d-d3998ff1a128 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:35.929492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2423186-8d8a-4d17-905d-d3998ff1a128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:35.929829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2423186-8d8a-4d17-905d-d3998ff1a128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:35.930529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2423186-8d8a-4d17-905d-d3998ff1a128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:35.932190 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2423186-8d8a-4d17-905d-d3998ff1a128 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:35.944944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1124/2255] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:35.947361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5385c9-5c49-4940-bf37-f442a71b3245 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:35.959352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5385c9-5c49-4940-bf37-f442a71b3245 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:35.965914 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcc947-64ce-40e8-8688-b60a220e382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:35.966691 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcc947-64ce-40e8-8688-b60a220e382e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:35.966976 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcc947-64ce-40e8-8688-b60a220e382e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:35.967298 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcc947-64ce-40e8-8688-b60a220e382e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:35.970681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcc947-64ce-40e8-8688-b60a220e382e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:35.970919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcc947-64ce-40e8-8688-b60a220e382e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:36.002055 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1132/2256] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:36.003659 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2423186-8d8a-4d17-905d-d3998ff1a128 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:36.021497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2423186-8d8a-4d17-905d-d3998ff1a128 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:36.030186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5a0bc-fd60-4093-ab21-bdebcfbd9af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:36.030963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5a0bc-fd60-4093-ab21-bdebcfbd9af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:36.031565 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5a0bc-fd60-4093-ab21-bdebcfbd9af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:36.032413 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5a0bc-fd60-4093-ab21-bdebcfbd9af8 admin admin] PATH_INFO: `/v3/projects/0d3e14345a874baea9a66a916ac9cd51/users/8812bdb1f3834523aab2bb94bce61085/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:36.056187 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5a0bc-fd60-4093-ab21-bdebcfbd9af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3e14345a874baea9a66a916ac9cd51, user_id=8812bdb1f3834523aab2bb94bce61085, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:36.064664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5a0bc-fd60-4093-ab21-bdebcfbd9af8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:36.092655 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1125/2257] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:36 2022] PUT /identity/v3/projects/0d3e14345a874baea9a66a916ac9cd51/users/8812bdb1f3834523aab2bb94bce61085/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:36.099071 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42693fd-5869-4545-a0f3-2601b840ba12 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:36.099475 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42693fd-5869-4545-a0f3-2601b840ba12 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:36.099758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42693fd-5869-4545-a0f3-2601b840ba12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:36.165108 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5a0bc-fd60-4093-ab21-bdebcfbd9af8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:36.167823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0fd5a0bc-fd60-4093-ab21-bdebcfbd9af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:36.172848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c42693fd-5869-4545-a0f3-2601b840ba12 None None] MFA Rules not processed for user `8812bdb1f3834523aab2bb94bce61085`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:36.174298 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c42693fd-5869-4545-a0f3-2601b840ba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:36.270731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1133/2258] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:36.273918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5a0bc-fd60-4093-ab21-bdebcfbd9af8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:36.282156 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:36.282732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42693fd-5869-4545-a0f3-2601b840ba12 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:36.282847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:36.284424 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c42693fd-5869-4545-a0f3-2601b840ba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:36.284541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:36.284861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7 admin admin] PATH_INFO: `/v3/projects/98b2e9af7b8b41afa7209e2d01bc8653` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:36.286038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b2e9af7b8b41afa7209e2d01bc8653)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:36.287929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:36.366328 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b2e9af7b8b41afa7209e2d01bc8653', 'request_id': 'req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.366540 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42693fd-5869-4545-a0f3-2601b840ba12 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:36.375958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b2e9af7b8b41afa7209e2d01bc8653', 'request_id': 'req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.382993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b2e9af7b8b41afa7209e2d01bc8653', 'request_id': 'req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.389330 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:36.399835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7 admin admin] The token cache is being invalidate because project 98b2e9af7b8b41afa7209e2d01bc8653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:36.400411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.401566 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.404288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1126/2259] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:36 2022] DELETE /identity/v3/projects/98b2e9af7b8b41afa7209e2d01bc8653 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:36.410291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:36.412565 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:36.424698 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdfa0f-149d-488d-95df-0f38dd6677de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:36.425578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdfa0f-149d-488d-95df-0f38dd6677de service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:36.425578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdfa0f-149d-488d-95df-0f38dd6677de service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:36.425990 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdfa0f-149d-488d-95df-0f38dd6677de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:36.427769 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d6bdfa0f-149d-488d-95df-0f38dd6677de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:36.461036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:36.491116 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1798c9-dccc-47b4-a67b-f9356d37e8d7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:36.495849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226cb11-432f-427a-868e-642f1ad46265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:36.496533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226cb11-432f-427a-868e-642f1ad46265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:36.496849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226cb11-432f-427a-868e-642f1ad46265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:36.497126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226cb11-432f-427a-868e-642f1ad46265 admin admin] PATH_INFO: `/v3/projects/7a26bc0b1b264546b395e42df7101b48` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:36.498349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226cb11-432f-427a-868e-642f1ad46265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a26bc0b1b264546b395e42df7101b48)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:36.500348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226cb11-432f-427a-868e-642f1ad46265 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:36.501532 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdfa0f-149d-488d-95df-0f38dd6677de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:36.503058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdfa0f-149d-488d-95df-0f38dd6677de service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:36.514129 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1134/2260] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:36.515050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdfa0f-149d-488d-95df-0f38dd6677de service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:36.516405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d6bdfa0f-149d-488d-95df-0f38dd6677de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:36.532059 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdfa0f-149d-488d-95df-0f38dd6677de service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:36.537127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b3f01-5ae6-4fe1-af3f-8e31f7014350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:36.537801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b3f01-5ae6-4fe1-af3f-8e31f7014350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:36.538053 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b3f01-5ae6-4fe1-af3f-8e31f7014350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:36.538344 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b3f01-5ae6-4fe1-af3f-8e31f7014350 admin admin] PATH_INFO: `/v3/users/b8d349a71c514295b9e9018345a5cf19` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:36.539452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b3f01-5ae6-4fe1-af3f-8e31f7014350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d349a71c514295b9e9018345a5cf19)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:36.541410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b3f01-5ae6-4fe1-af3f-8e31f7014350 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:36.565497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0226cb11-432f-427a-868e-642f1ad46265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a26bc0b1b264546b395e42df7101b48', 'request_id': 'req-0226cb11-432f-427a-868e-642f1ad46265'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.573570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0226cb11-432f-427a-868e-642f1ad46265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a26bc0b1b264546b395e42df7101b48', 'request_id': 'req-0226cb11-432f-427a-868e-642f1ad46265'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.585761 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0226cb11-432f-427a-868e-642f1ad46265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a26bc0b1b264546b395e42df7101b48', 'request_id': 'req-0226cb11-432f-427a-868e-642f1ad46265'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.600942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3f6b3f01-5ae6-4fe1-af3f-8e31f7014350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d349a71c514295b9e9018345a5cf19'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.601134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0226cb11-432f-427a-868e-642f1ad46265 admin admin] The token cache is being invalidate because project 7a26bc0b1b264546b395e42df7101b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:36.601582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0226cb11-432f-427a-868e-642f1ad46265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.602410 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0226cb11-432f-427a-868e-642f1ad46265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.608081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1127/2261] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:36 2022] DELETE /identity/v3/projects/7a26bc0b1b264546b395e42df7101b48 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:36.608958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226cb11-432f-427a-868e-642f1ad46265 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:36.610310 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0226cb11-432f-427a-868e-642f1ad46265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:36.616281 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3f6b3f01-5ae6-4fe1-af3f-8e31f7014350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d349a71c514295b9e9018345a5cf19'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.625132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3f6b3f01-5ae6-4fe1-af3f-8e31f7014350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d349a71c514295b9e9018345a5cf19'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.633357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3f6b3f01-5ae6-4fe1-af3f-8e31f7014350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d349a71c514295b9e9018345a5cf19'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.634976 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3f6b3f01-5ae6-4fe1-af3f-8e31f7014350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d349a71c514295b9e9018345a5cf19'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.643049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1135/2262] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:36 2022] DELETE /identity/v3/users/b8d349a71c514295b9e9018345a5cf19 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:36.690524 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226cb11-432f-427a-868e-642f1ad46265 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:36.744868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:36.809133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccddaef-9408-4cdd-85b1-ab2d2f2315bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:36.810097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccddaef-9408-4cdd-85b1-ab2d2f2315bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:36.810424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccddaef-9408-4cdd-85b1-ab2d2f2315bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:36.810703 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccddaef-9408-4cdd-85b1-ab2d2f2315bd admin admin] PATH_INFO: `/v3/users/a967f0b691914b28b96a67407417730d` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:36.813534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccddaef-9408-4cdd-85b1-ab2d2f2315bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a967f0b691914b28b96a67407417730d)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:36.815730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccddaef-9408-4cdd-85b1-ab2d2f2315bd admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:36.899611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2ccddaef-9408-4cdd-85b1-ab2d2f2315bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a967f0b691914b28b96a67407417730d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.910044 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2ccddaef-9408-4cdd-85b1-ab2d2f2315bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a967f0b691914b28b96a67407417730d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.928748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2ccddaef-9408-4cdd-85b1-ab2d2f2315bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a967f0b691914b28b96a67407417730d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.935866 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2ccddaef-9408-4cdd-85b1-ab2d2f2315bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a967f0b691914b28b96a67407417730d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.937016 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2ccddaef-9408-4cdd-85b1-ab2d2f2315bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a967f0b691914b28b96a67407417730d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:36.943236 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1128/2263] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:36 2022] DELETE /identity/v3/users/a967f0b691914b28b96a67407417730d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:37.009698 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b3f01-5ae6-4fe1-af3f-8e31f7014350 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:37.011485 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3f6b3f01-5ae6-4fe1-af3f-8e31f7014350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:37.029201 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b3f01-5ae6-4fe1-af3f-8e31f7014350 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:37.099504 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e4049-c39a-4e74-b018-b0dcecaac282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:37.100942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4049-c39a-4e74-b018-b0dcecaac282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:37.100942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4049-c39a-4e74-b018-b0dcecaac282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:37.101197 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4049-c39a-4e74-b018-b0dcecaac282 admin admin] PATH_INFO: `/v3/projects/7c177d6d893b41e1b1cf3db034664d6b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:37.102205 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e4049-c39a-4e74-b018-b0dcecaac282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c177d6d893b41e1b1cf3db034664d6b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:37.104127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e4049-c39a-4e74-b018-b0dcecaac282 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:37.176269 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d58e4049-c39a-4e74-b018-b0dcecaac282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c177d6d893b41e1b1cf3db034664d6b', 'request_id': 'req-d58e4049-c39a-4e74-b018-b0dcecaac282'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.178530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:37.184315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d58e4049-c39a-4e74-b018-b0dcecaac282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c177d6d893b41e1b1cf3db034664d6b', 'request_id': 'req-d58e4049-c39a-4e74-b018-b0dcecaac282'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.196072 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d58e4049-c39a-4e74-b018-b0dcecaac282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c177d6d893b41e1b1cf3db034664d6b', 'request_id': 'req-d58e4049-c39a-4e74-b018-b0dcecaac282'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.211112 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d58e4049-c39a-4e74-b018-b0dcecaac282 admin admin] The token cache is being invalidate because project 7c177d6d893b41e1b1cf3db034664d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:37.211390 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d58e4049-c39a-4e74-b018-b0dcecaac282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.215572 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d58e4049-c39a-4e74-b018-b0dcecaac282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.217317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1136/2264] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:37 2022] DELETE /identity/v3/projects/7c177d6d893b41e1b1cf3db034664d6b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:37.221510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccddaef-9408-4cdd-85b1-ab2d2f2315bd admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:37.223003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2ccddaef-9408-4cdd-85b1-ab2d2f2315bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:37.239508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccddaef-9408-4cdd-85b1-ab2d2f2315bd admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:37.284037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e4049-c39a-4e74-b018-b0dcecaac282 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:37.285551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d58e4049-c39a-4e74-b018-b0dcecaac282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:37.335775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d85bc-9f23-4ab6-bb65-cd93e51b71e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:37.336489 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d85bc-9f23-4ab6-bb65-cd93e51b71e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:37.336802 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d85bc-9f23-4ab6-bb65-cd93e51b71e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:37.337073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d85bc-9f23-4ab6-bb65-cd93e51b71e3 admin admin] PATH_INFO: `/v3/users/81bad16e816d42c7b119adbea5527945` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:37.338279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d85bc-9f23-4ab6-bb65-cd93e51b71e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81bad16e816d42c7b119adbea5527945)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:37.340203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d85bc-9f23-4ab6-bb65-cd93e51b71e3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:37.375473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e4049-c39a-4e74-b018-b0dcecaac282 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:37.380203 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babe2b9-9b41-405a-8b8c-cf96341f591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:37.380861 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babe2b9-9b41-405a-8b8c-cf96341f591f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:37.381141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babe2b9-9b41-405a-8b8c-cf96341f591f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:37.381411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babe2b9-9b41-405a-8b8c-cf96341f591f admin admin] PATH_INFO: `/v3/projects/9a47b1b4c929462f8a4e9d87ea541496` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:37.382533 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babe2b9-9b41-405a-8b8c-cf96341f591f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a47b1b4c929462f8a4e9d87ea541496)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:37.384437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babe2b9-9b41-405a-8b8c-cf96341f591f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:37.390204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab0d85bc-9f23-4ab6-bb65-cd93e51b71e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81bad16e816d42c7b119adbea5527945'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.399360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab0d85bc-9f23-4ab6-bb65-cd93e51b71e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81bad16e816d42c7b119adbea5527945'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.405309 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:37.413306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab0d85bc-9f23-4ab6-bb65-cd93e51b71e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81bad16e816d42c7b119adbea5527945'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.422101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab0d85bc-9f23-4ab6-bb65-cd93e51b71e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81bad16e816d42c7b119adbea5527945'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.423065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab0d85bc-9f23-4ab6-bb65-cd93e51b71e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81bad16e816d42c7b119adbea5527945'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.431260 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1129/2265] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:37 2022] DELETE /identity/v3/users/81bad16e816d42c7b119adbea5527945 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:37.442319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0babe2b9-9b41-405a-8b8c-cf96341f591f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a47b1b4c929462f8a4e9d87ea541496', 'request_id': 'req-0babe2b9-9b41-405a-8b8c-cf96341f591f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.447822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0babe2b9-9b41-405a-8b8c-cf96341f591f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a47b1b4c929462f8a4e9d87ea541496', 'request_id': 'req-0babe2b9-9b41-405a-8b8c-cf96341f591f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.459418 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0babe2b9-9b41-405a-8b8c-cf96341f591f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a47b1b4c929462f8a4e9d87ea541496', 'request_id': 'req-0babe2b9-9b41-405a-8b8c-cf96341f591f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.472831 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0babe2b9-9b41-405a-8b8c-cf96341f591f admin admin] The token cache is being invalidate because project 9a47b1b4c929462f8a4e9d87ea541496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:37.473178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0babe2b9-9b41-405a-8b8c-cf96341f591f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.474004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0babe2b9-9b41-405a-8b8c-cf96341f591f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.475600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1137/2266] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:37 2022] DELETE /identity/v3/projects/9a47b1b4c929462f8a4e9d87ea541496 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:37.481843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685dce2-ca64-44b7-80d8-71501f6015a0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:37.481943 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685dce2-ca64-44b7-80d8-71501f6015a0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:37.482134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685dce2-ca64-44b7-80d8-71501f6015a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:37.503906 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4685dce2-ca64-44b7-80d8-71501f6015a0 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:37.505508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4685dce2-ca64-44b7-80d8-71501f6015a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:37.582997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1130/2267] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:37.588296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9d36a-c026-42bd-807c-af0b66344054 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:37.588652 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9d36a-c026-42bd-807c-af0b66344054 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:37.589413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9d36a-c026-42bd-807c-af0b66344054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:37.609922 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c0d9d36a-c026-42bd-807c-af0b66344054 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:37.611146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c0d9d36a-c026-42bd-807c-af0b66344054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:37.619321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1138/2268] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:37.624106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685dce2-ca64-44b7-80d8-71501f6015a0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:37.633878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685dce2-ca64-44b7-80d8-71501f6015a0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:37.638568 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe11ec-a75a-4897-8a56-c5a20258117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:37.639159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe11ec-a75a-4897-8a56-c5a20258117a admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:37.639436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe11ec-a75a-4897-8a56-c5a20258117a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:37.639701 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe11ec-a75a-4897-8a56-c5a20258117a admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:37.640377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe11ec-a75a-4897-8a56-c5a20258117a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:37.640714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe11ec-a75a-4897-8a56-c5a20258117a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:37.642273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe11ec-a75a-4897-8a56-c5a20258117a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:37.661799 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1131/2269] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:26:37.663383 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9d36a-c026-42bd-807c-af0b66344054 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:37.673510 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9d36a-c026-42bd-807c-af0b66344054 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:37.678131 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae1851-f507-4400-87b2-6c9cd9127965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:37.678726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae1851-f507-4400-87b2-6c9cd9127965 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:37.679003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae1851-f507-4400-87b2-6c9cd9127965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:37.679273 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae1851-f507-4400-87b2-6c9cd9127965 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:37.679895 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae1851-f507-4400-87b2-6c9cd9127965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:37.681873 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae1851-f507-4400-87b2-6c9cd9127965 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:37.712616 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1139/2270] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:37 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:37.716631 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe11ec-a75a-4897-8a56-c5a20258117a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:37.721805 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae1851-f507-4400-87b2-6c9cd9127965 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:37.723489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bcae1851-f507-4400-87b2-6c9cd9127965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:37.730978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe11ec-a75a-4897-8a56-c5a20258117a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:37.774889 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:37.796434 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271be75-4010-4ced-9150-7a7f0815346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:37.797079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271be75-4010-4ced-9150-7a7f0815346b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:37.797358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271be75-4010-4ced-9150-7a7f0815346b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:37.797635 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271be75-4010-4ced-9150-7a7f0815346b admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:37.798258 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271be75-4010-4ced-9150-7a7f0815346b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:37.800181 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271be75-4010-4ced-9150-7a7f0815346b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:37.801698 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae1851-f507-4400-87b2-6c9cd9127965 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:37.806507 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664614c-7081-4f72-88cc-1344b7bb9bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:37.807162 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664614c-7081-4f72-88cc-1344b7bb9bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:37.807436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664614c-7081-4f72-88cc-1344b7bb9bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:37.807701 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664614c-7081-4f72-88cc-1344b7bb9bd2 admin admin] PATH_INFO: `/v3/projects/fc4608eec11448daadf5bb9242109424` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:37.809620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664614c-7081-4f72-88cc-1344b7bb9bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4608eec11448daadf5bb9242109424)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:37.811503 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664614c-7081-4f72-88cc-1344b7bb9bd2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:37.824705 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1132/2271] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:37 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:37.825822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271be75-4010-4ced-9150-7a7f0815346b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:37.838156 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271be75-4010-4ced-9150-7a7f0815346b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:37.844510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c7972-28cb-41d0-9aa1-0dfa8a9652ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:37.845987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c7972-28cb-41d0-9aa1-0dfa8a9652ad admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:37.846436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c7972-28cb-41d0-9aa1-0dfa8a9652ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:37.846860 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c7972-28cb-41d0-9aa1-0dfa8a9652ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:37.847754 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c7972-28cb-41d0-9aa1-0dfa8a9652ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:37.849874 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c7972-28cb-41d0-9aa1-0dfa8a9652ad admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:37.860929 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d664614c-7081-4f72-88cc-1344b7bb9bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4608eec11448daadf5bb9242109424', 'request_id': 'req-d664614c-7081-4f72-88cc-1344b7bb9bd2'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.866314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1133/2272] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:37.866674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d664614c-7081-4f72-88cc-1344b7bb9bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4608eec11448daadf5bb9242109424', 'request_id': 'req-d664614c-7081-4f72-88cc-1344b7bb9bd2'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.870571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c7972-28cb-41d0-9aa1-0dfa8a9652ad admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:37.881781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d664614c-7081-4f72-88cc-1344b7bb9bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4608eec11448daadf5bb9242109424', 'request_id': 'req-d664614c-7081-4f72-88cc-1344b7bb9bd2'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.882859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c7972-28cb-41d0-9aa1-0dfa8a9652ad admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:37.909471 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d664614c-7081-4f72-88cc-1344b7bb9bd2 admin admin] The token cache is being invalidate because project fc4608eec11448daadf5bb9242109424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:37.909835 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d664614c-7081-4f72-88cc-1344b7bb9bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.911238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d664614c-7081-4f72-88cc-1344b7bb9bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:37.913556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1140/2273] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:37 2022] DELETE /identity/v3/projects/fc4608eec11448daadf5bb9242109424 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:37.919408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5b203-05ed-499f-8695-267885c30514 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:37.919908 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5b203-05ed-499f-8695-267885c30514 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:37.920184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5b203-05ed-499f-8695-267885c30514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:37.939269 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:37.944438 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-17f5b203-05ed-499f-8695-267885c30514 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:37.945726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-17f5b203-05ed-499f-8695-267885c30514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:37.970376 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c6b08-1556-4192-a4fc-1d4fb41c625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:37.970991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c6b08-1556-4192-a4fc-1d4fb41c625c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:37.971329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c6b08-1556-4192-a4fc-1d4fb41c625c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:37.971545 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c6b08-1556-4192-a4fc-1d4fb41c625c admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:37.972538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c6b08-1556-4192-a4fc-1d4fb41c625c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:37.974053 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c6b08-1556-4192-a4fc-1d4fb41c625c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:37.995742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1134/2274] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:37.997247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c6b08-1556-4192-a4fc-1d4fb41c625c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:37.999100 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8d1c6b08-1556-4192-a4fc-1d4fb41c625c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:38.012167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c6b08-1556-4192-a4fc-1d4fb41c625c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:38.017811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47447a0-dbcf-4b7c-859e-6b004c63704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:38.018654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47447a0-dbcf-4b7c-859e-6b004c63704f admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.019086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47447a0-dbcf-4b7c-859e-6b004c63704f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.019510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47447a0-dbcf-4b7c-859e-6b004c63704f admin admin] PATH_INFO: `/v3/projects/4f508301dafd4bf2a5dff0836334dc70/users/4965e83275d44396bb608f8ef32cd227/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.021847 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1141/2275] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:38.033653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4eb60-bd9a-49e7-89db-c832e348eea6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.033946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4eb60-bd9a-49e7-89db-c832e348eea6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.034218 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4eb60-bd9a-49e7-89db-c832e348eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.039691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47447a0-dbcf-4b7c-859e-6b004c63704f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f508301dafd4bf2a5dff0836334dc70, user_id=4965e83275d44396bb608f8ef32cd227, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:38.042396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47447a0-dbcf-4b7c-859e-6b004c63704f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:38.056673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-00d4eb60-bd9a-49e7-89db-c832e348eea6 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:38.057417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1135/2276] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:37 2022] PUT /identity/v3/projects/4f508301dafd4bf2a5dff0836334dc70/users/4965e83275d44396bb608f8ef32cd227/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:38.058232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-00d4eb60-bd9a-49e7-89db-c832e348eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:38.068220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5aa41-986e-4bbf-afec-811f5f69363a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.068518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5aa41-986e-4bbf-afec-811f5f69363a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.068835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5aa41-986e-4bbf-afec-811f5f69363a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.105359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7cd5aa41-986e-4bbf-afec-811f5f69363a None None] MFA Rules not processed for user `4965e83275d44396bb608f8ef32cd227`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:38.107235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7cd5aa41-986e-4bbf-afec-811f5f69363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:38.191536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1142/2277] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:38.196669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4eb60-bd9a-49e7-89db-c832e348eea6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:38.208209 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4eb60-bd9a-49e7-89db-c832e348eea6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:38.210994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1136/2278] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:38.216215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5aa41-986e-4bbf-afec-811f5f69363a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:38.216717 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ccb79-6503-49a7-a552-63a1faad7029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:38.217406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ccb79-6503-49a7-a552-63a1faad7029 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.217696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ccb79-6503-49a7-a552-63a1faad7029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.218059 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ccb79-6503-49a7-a552-63a1faad7029 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.218741 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ccb79-6503-49a7-a552-63a1faad7029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:38.219044 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ccb79-6503-49a7-a552-63a1faad7029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:38.220795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ccb79-6503-49a7-a552-63a1faad7029 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:38.227725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5aa41-986e-4bbf-afec-811f5f69363a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:38.228482 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:38.233971 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b465346-d30f-435b-8b45-abce11726f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:38.234573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b465346-d30f-435b-8b45-abce11726f1e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.234892 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b465346-d30f-435b-8b45-abce11726f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.235167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b465346-d30f-435b-8b45-abce11726f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.235277 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1143/2279] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:26:38.235849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b465346-d30f-435b-8b45-abce11726f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:38.237819 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b465346-d30f-435b-8b45-abce11726f1e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:38.240091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ccb79-6503-49a7-a552-63a1faad7029 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:38.251219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ccb79-6503-49a7-a552-63a1faad7029 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:38.256353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ba38f-bb42-40c4-83d9-8e16c251616a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:38.256999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ba38f-bb42-40c4-83d9-8e16c251616a admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.257251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ba38f-bb42-40c4-83d9-8e16c251616a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.257523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ba38f-bb42-40c4-83d9-8e16c251616a admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.258137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ba38f-bb42-40c4-83d9-8e16c251616a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:38.260234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ba38f-bb42-40c4-83d9-8e16c251616a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:38.266838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1137/2280] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:38 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:38.270634 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b465346-d30f-435b-8b45-abce11726f1e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:38.292421 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1144/2281] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:38 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:38.296539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ba38f-bb42-40c4-83d9-8e16c251616a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:38.343622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b465346-d30f-435b-8b45-abce11726f1e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:38.365837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:38.382858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ba38f-bb42-40c4-83d9-8e16c251616a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:38.390767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56153544-ec34-4939-a0f1-6bbb995c4fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:38.391472 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56153544-ec34-4939-a0f1-6bbb995c4fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.391782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56153544-ec34-4939-a0f1-6bbb995c4fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.392058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56153544-ec34-4939-a0f1-6bbb995c4fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.392909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56153544-ec34-4939-a0f1-6bbb995c4fb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:38.395051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56153544-ec34-4939-a0f1-6bbb995c4fb1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:38.414857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728a111-a566-4506-894a-c61a122599fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:38.415539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728a111-a566-4506-894a-c61a122599fc admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.415823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728a111-a566-4506-894a-c61a122599fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.416113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728a111-a566-4506-894a-c61a122599fc admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.416768 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728a111-a566-4506-894a-c61a122599fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:38.418820 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728a111-a566-4506-894a-c61a122599fc admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:38.423689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1145/2282] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:38 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:38.427645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56153544-ec34-4939-a0f1-6bbb995c4fb1 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:38.438116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56153544-ec34-4939-a0f1-6bbb995c4fb1 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:38.444840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3ffbb-9cbe-4a6a-af9e-1afd2a4147a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:38.445566 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3ffbb-9cbe-4a6a-af9e-1afd2a4147a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.445962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3ffbb-9cbe-4a6a-af9e-1afd2a4147a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.446302 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3ffbb-9cbe-4a6a-af9e-1afd2a4147a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.447064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3ffbb-9cbe-4a6a-af9e-1afd2a4147a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:38.447791 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1138/2283] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:38 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:38.448918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3ffbb-9cbe-4a6a-af9e-1afd2a4147a0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:38.451868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728a111-a566-4506-894a-c61a122599fc admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:38.460469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1146/2284] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:38.464623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3ffbb-9cbe-4a6a-af9e-1afd2a4147a0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:38.465540 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728a111-a566-4506-894a-c61a122599fc admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:38.475827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3ffbb-9cbe-4a6a-af9e-1afd2a4147a0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:38.480716 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bcf22-7e06-482a-9e25-c1a39c242813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:38.481345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bcf22-7e06-482a-9e25-c1a39c242813 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.481625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bcf22-7e06-482a-9e25-c1a39c242813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.481901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bcf22-7e06-482a-9e25-c1a39c242813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.482552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bcf22-7e06-482a-9e25-c1a39c242813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:38.484155 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bcf22-7e06-482a-9e25-c1a39c242813 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:38.488114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801dcd2-409e-4037-8321-5a2f96c29cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:38.488766 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801dcd2-409e-4037-8321-5a2f96c29cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.489047 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801dcd2-409e-4037-8321-5a2f96c29cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.489319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801dcd2-409e-4037-8321-5a2f96c29cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.489969 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801dcd2-409e-4037-8321-5a2f96c29cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:38.491562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801dcd2-409e-4037-8321-5a2f96c29cf7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:38.496794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1147/2285] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:38.500658 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bcf22-7e06-482a-9e25-c1a39c242813 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:38.505474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1139/2286] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:38.509200 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801dcd2-409e-4037-8321-5a2f96c29cf7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:38.513804 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bcf22-7e06-482a-9e25-c1a39c242813 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:38.521474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801dcd2-409e-4037-8321-5a2f96c29cf7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:38.521678 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431528a3-8273-4039-be67-da7f2bcfcc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:38.522664 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431528a3-8273-4039-be67-da7f2bcfcc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.522664 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431528a3-8273-4039-be67-da7f2bcfcc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.522954 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431528a3-8273-4039-be67-da7f2bcfcc87 admin admin] PATH_INFO: `/v3/projects/13c879d8a65343e6b3c1d51d8aed6206/users/871a5634d6024f2f9f461ea98d7a3d0e/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.539164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431528a3-8273-4039-be67-da7f2bcfcc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c879d8a65343e6b3c1d51d8aed6206, user_id=871a5634d6024f2f9f461ea98d7a3d0e, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:38.540278 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb25579-6fed-4e35-b15d-1f1507e6d2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:38.540919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb25579-6fed-4e35-b15d-1f1507e6d2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.541249 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb25579-6fed-4e35-b15d-1f1507e6d2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.541572 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb25579-6fed-4e35-b15d-1f1507e6d2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.541920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431528a3-8273-4039-be67-da7f2bcfcc87 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:38.542219 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb25579-6fed-4e35-b15d-1f1507e6d2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:38.543968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb25579-6fed-4e35-b15d-1f1507e6d2b2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:38.557899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1148/2287] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:38 2022] PUT /identity/v3/projects/13c879d8a65343e6b3c1d51d8aed6206/users/871a5634d6024f2f9f461ea98d7a3d0e/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:38.563429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1140/2288] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:38.567503 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431528a3-8273-4039-be67-da7f2bcfcc87 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:38.568507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928ef09-ca5b-4be0-9c37-64ac0c082c46 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.568820 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928ef09-ca5b-4be0-9c37-64ac0c082c46 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.569090 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928ef09-ca5b-4be0-9c37-64ac0c082c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.598437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8928ef09-ca5b-4be0-9c37-64ac0c082c46 None None] MFA Rules not processed for user `871a5634d6024f2f9f461ea98d7a3d0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:38.599762 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8928ef09-ca5b-4be0-9c37-64ac0c082c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:38.632063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431528a3-8273-4039-be67-da7f2bcfcc87 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:38.637224 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99cd52-9e5b-4b2c-85dc-32a69ed200ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:38.637880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99cd52-9e5b-4b2c-85dc-32a69ed200ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.638153 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99cd52-9e5b-4b2c-85dc-32a69ed200ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.638420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99cd52-9e5b-4b2c-85dc-32a69ed200ad admin admin] PATH_INFO: `/v3/projects/a29f746be25a4e0784a9d34eaf721964/users/09694a49d5c4436db47c1163cdd5401f/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.657564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99cd52-9e5b-4b2c-85dc-32a69ed200ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29f746be25a4e0784a9d34eaf721964, user_id=09694a49d5c4436db47c1163cdd5401f, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:38.660599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99cd52-9e5b-4b2c-85dc-32a69ed200ad admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:38.674629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1149/2289] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:38 2022] PUT /identity/v3/projects/a29f746be25a4e0784a9d34eaf721964/users/09694a49d5c4436db47c1163cdd5401f/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:38.675156 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1141/2290] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:38.686439 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928ef09-ca5b-4be0-9c37-64ac0c082c46 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:38.686604 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c79b8-d727-4a41-a59e-e804faccdac5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.686749 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c79b8-d727-4a41-a59e-e804faccdac5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.687025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c79b8-d727-4a41-a59e-e804faccdac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.687954 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8928ef09-ca5b-4be0-9c37-64ac0c082c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:38.694575 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:38.720302 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e52c79b8-d727-4a41-a59e-e804faccdac5 None None] MFA Rules not processed for user `09694a49d5c4436db47c1163cdd5401f`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:38.721899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e52c79b8-d727-4a41-a59e-e804faccdac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:38.749730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928ef09-ca5b-4be0-9c37-64ac0c082c46 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:38.787263 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:38.800901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1150/2291] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:38.804955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9777a8-fef1-4285-94a3-71dd091636b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:38.805466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c79b8-d727-4a41-a59e-e804faccdac5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:38.805657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9777a8-fef1-4285-94a3-71dd091636b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.809449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9777a8-fef1-4285-94a3-71dd091636b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.809449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9777a8-fef1-4285-94a3-71dd091636b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.867401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9777a8-fef1-4285-94a3-71dd091636b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:38.868911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9777a8-fef1-4285-94a3-71dd091636b8 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:38.869135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c79b8-d727-4a41-a59e-e804faccdac5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:38.874370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2539ae-1302-43b0-a2ac-7fe8fcca5cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:38.874981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2539ae-1302-43b0-a2ac-7fe8fcca5cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.875266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2539ae-1302-43b0-a2ac-7fe8fcca5cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.875542 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2539ae-1302-43b0-a2ac-7fe8fcca5cf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.876168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2539ae-1302-43b0-a2ac-7fe8fcca5cf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:38.878102 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2539ae-1302-43b0-a2ac-7fe8fcca5cf9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:38.878362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1142/2292] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:38.906788 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1151/2293] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:38 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:38.910854 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9777a8-fef1-4285-94a3-71dd091636b8 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:38.924097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9777a8-fef1-4285-94a3-71dd091636b8 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:38.994268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d334127-8623-4eab-8c6d-f2696084d603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:38.995312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d334127-8623-4eab-8c6d-f2696084d603 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:38.995745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d334127-8623-4eab-8c6d-f2696084d603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:38.996493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d334127-8623-4eab-8c6d-f2696084d603 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:38.998160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d334127-8623-4eab-8c6d-f2696084d603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:39.000529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d334127-8623-4eab-8c6d-f2696084d603 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:39.025882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1143/2294] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:38 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:39.030084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2539ae-1302-43b0-a2ac-7fe8fcca5cf9 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:39.044617 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2539ae-1302-43b0-a2ac-7fe8fcca5cf9 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:39.052693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dd204-f75b-4bf3-a86b-93f4482e748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:39.053444 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dd204-f75b-4bf3-a86b-93f4482e748e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:39.053863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dd204-f75b-4bf3-a86b-93f4482e748e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:39.054140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dd204-f75b-4bf3-a86b-93f4482e748e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:39.054798 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0dd204-f75b-4bf3-a86b-93f4482e748e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:39.056473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0dd204-f75b-4bf3-a86b-93f4482e748e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:39.072099 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1152/2295] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:39.076257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d334127-8623-4eab-8c6d-f2696084d603 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:39.089733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d334127-8623-4eab-8c6d-f2696084d603 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:39.095245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a60325-f45e-4221-ab28-91b00a160d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:39.095907 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a60325-f45e-4221-ab28-91b00a160d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:39.096396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a60325-f45e-4221-ab28-91b00a160d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:39.096506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a60325-f45e-4221-ab28-91b00a160d1d admin admin] PATH_INFO: `/v3/projects/f7d972bb4ddd45d791541d8684819b64/users/bbaa3c0e80364704a38e76ef0ead43f1/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:39.117197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a60325-f45e-4221-ab28-91b00a160d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d972bb4ddd45d791541d8684819b64, user_id=bbaa3c0e80364704a38e76ef0ead43f1, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:39.119851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a60325-f45e-4221-ab28-91b00a160d1d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:39.140307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1144/2296] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:39 2022] PUT /identity/v3/projects/f7d972bb4ddd45d791541d8684819b64/users/bbaa3c0e80364704a38e76ef0ead43f1/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:39.146390 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dd204-f75b-4bf3-a86b-93f4482e748e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:39.164315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dd204-f75b-4bf3-a86b-93f4482e748e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:39.276935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdefc4f-5e47-4c07-8ce5-2ed1d35f45e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:39.278228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdefc4f-5e47-4c07-8ce5-2ed1d35f45e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:39.278454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdefc4f-5e47-4c07-8ce5-2ed1d35f45e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:39.278724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdefc4f-5e47-4c07-8ce5-2ed1d35f45e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:39.279375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdefc4f-5e47-4c07-8ce5-2ed1d35f45e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:39.281020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdefc4f-5e47-4c07-8ce5-2ed1d35f45e8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:39.299969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1153/2297] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:39.304494 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a60325-f45e-4221-ab28-91b00a160d1d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:39.333040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a60325-f45e-4221-ab28-91b00a160d1d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:39.338132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a3fb1-c209-4311-9916-611ad8b2da5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:39.338794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a3fb1-c209-4311-9916-611ad8b2da5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:39.339315 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a3fb1-c209-4311-9916-611ad8b2da5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:39.339533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a3fb1-c209-4311-9916-611ad8b2da5a admin admin] PATH_INFO: `/v3/projects/f7d972bb4ddd45d791541d8684819b64/users/bbaa3c0e80364704a38e76ef0ead43f1/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:39.342374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a3fb1-c209-4311-9916-611ad8b2da5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d972bb4ddd45d791541d8684819b64, user_id=bbaa3c0e80364704a38e76ef0ead43f1, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:39.345060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a3fb1-c209-4311-9916-611ad8b2da5a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:39.366120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1145/2298] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:39 2022] PUT /identity/v3/projects/f7d972bb4ddd45d791541d8684819b64/users/bbaa3c0e80364704a38e76ef0ead43f1/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:39.368761 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a4dcc-26bf-4418-8870-a9bd5365dab8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:39.369258 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a4dcc-26bf-4418-8870-a9bd5365dab8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:39.369743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a4dcc-26bf-4418-8870-a9bd5365dab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:39.379115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:39.420461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-000a4dcc-26bf-4418-8870-a9bd5365dab8 None None] MFA Rules not processed for user `bbaa3c0e80364704a38e76ef0ead43f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:39.422008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-000a4dcc-26bf-4418-8870-a9bd5365dab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:39.505802 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1154/2299] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:39.520205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a3fb1-c209-4311-9916-611ad8b2da5a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:39.522105 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ec8a3fb1-c209-4311-9916-611ad8b2da5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:39.572786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:39.588505 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a3fb1-c209-4311-9916-611ad8b2da5a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:39.593771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63940c1b-637c-4f46-b25a-c87dda25a839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:39.594772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63940c1b-637c-4f46-b25a-c87dda25a839 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:39.595256 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63940c1b-637c-4f46-b25a-c87dda25a839 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:39.595738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63940c1b-637c-4f46-b25a-c87dda25a839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:39.610682 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63940c1b-637c-4f46-b25a-c87dda25a839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:39.613414 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63940c1b-637c-4f46-b25a-c87dda25a839 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:39.633261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1146/2300] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:40.144267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a4dcc-26bf-4418-8870-a9bd5365dab8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:40.155118 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a4dcc-26bf-4418-8870-a9bd5365dab8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:40.158984 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dab956-0fd6-4b04-856f-ac9238e6a32f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:40.159583 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dab956-0fd6-4b04-856f-ac9238e6a32f service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:40.159861 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dab956-0fd6-4b04-856f-ac9238e6a32f service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:40.160132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dab956-0fd6-4b04-856f-ac9238e6a32f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:40.217592 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dab956-0fd6-4b04-856f-ac9238e6a32f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:40.219069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dab956-0fd6-4b04-856f-ac9238e6a32f service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:40.227853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1155/2301] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:44.313440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63940c1b-637c-4f46-b25a-c87dda25a839 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:44.322999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63940c1b-637c-4f46-b25a-c87dda25a839 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:44.327689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97466821-4645-4b66-b36b-43f0eee9c9fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:44.328387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97466821-4645-4b66-b36b-43f0eee9c9fa service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:44.328732 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97466821-4645-4b66-b36b-43f0eee9c9fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:44.329009 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97466821-4645-4b66-b36b-43f0eee9c9fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:44.405164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97466821-4645-4b66-b36b-43f0eee9c9fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:44.407255 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97466821-4645-4b66-b36b-43f0eee9c9fa service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:44.420717 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1147/2302] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:46.612657 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dab956-0fd6-4b04-856f-ac9238e6a32f service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:46.678442 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dab956-0fd6-4b04-856f-ac9238e6a32f service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:46.683263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f67dc-feb5-46f5-86f8-5cd00cc866dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:46.683917 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f67dc-feb5-46f5-86f8-5cd00cc866dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:46.684193 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f67dc-feb5-46f5-86f8-5cd00cc866dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:46.684467 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f67dc-feb5-46f5-86f8-5cd00cc866dd admin admin] PATH_INFO: `/v3/users/4965e83275d44396bb608f8ef32cd227` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:46.686079 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f67dc-feb5-46f5-86f8-5cd00cc866dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4965e83275d44396bb608f8ef32cd227)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:46.689550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f67dc-feb5-46f5-86f8-5cd00cc866dd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:46.728977 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:46.748592 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6f0f67dc-feb5-46f5-86f8-5cd00cc866dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4965e83275d44396bb608f8ef32cd227'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:46.760391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6f0f67dc-feb5-46f5-86f8-5cd00cc866dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4965e83275d44396bb608f8ef32cd227'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:46.769991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6f0f67dc-feb5-46f5-86f8-5cd00cc866dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4965e83275d44396bb608f8ef32cd227'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:46.786956 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6f0f67dc-feb5-46f5-86f8-5cd00cc866dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4965e83275d44396bb608f8ef32cd227'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:46.788047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6f0f67dc-feb5-46f5-86f8-5cd00cc866dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4965e83275d44396bb608f8ef32cd227'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:46.796933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1156/2303] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:46 2022] DELETE /identity/v3/users/4965e83275d44396bb608f8ef32cd227 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:46.801170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f2f6e-0d95-478c-a5be-df69456660d3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:46.801626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f2f6e-0d95-478c-a5be-df69456660d3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:46.801716 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f2f6e-0d95-478c-a5be-df69456660d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:46.820574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-302f2f6e-0d95-478c-a5be-df69456660d3 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:46.821803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-302f2f6e-0d95-478c-a5be-df69456660d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:46.887156 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1148/2304] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:46.896920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f67dc-feb5-46f5-86f8-5cd00cc866dd admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:46.898302 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6f0f67dc-feb5-46f5-86f8-5cd00cc866dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:46.957789 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f67dc-feb5-46f5-86f8-5cd00cc866dd admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:46.961480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f374e9-66b9-4b73-be1c-3eb44c344eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:46.962274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f374e9-66b9-4b73-be1c-3eb44c344eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:46.962553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f374e9-66b9-4b73-be1c-3eb44c344eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:46.962825 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f374e9-66b9-4b73-be1c-3eb44c344eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:46.971743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f374e9-66b9-4b73-be1c-3eb44c344eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:46.973303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f374e9-66b9-4b73-be1c-3eb44c344eb7 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:46.982990 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1157/2305] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:47.124647 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f2f6e-0d95-478c-a5be-df69456660d3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:47.126186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-302f2f6e-0d95-478c-a5be-df69456660d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:47.140364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f2f6e-0d95-478c-a5be-df69456660d3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:47.145163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6729f3f-62cb-4a49-b4a3-fac8f71ff53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:47.145860 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6729f3f-62cb-4a49-b4a3-fac8f71ff53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:47.146093 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6729f3f-62cb-4a49-b4a3-fac8f71ff53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:47.149229 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6729f3f-62cb-4a49-b4a3-fac8f71ff53b admin admin] PATH_INFO: `/v3/users/8812bdb1f3834523aab2bb94bce61085` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:47.149229 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6729f3f-62cb-4a49-b4a3-fac8f71ff53b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8812bdb1f3834523aab2bb94bce61085)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:47.149824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6729f3f-62cb-4a49-b4a3-fac8f71ff53b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:47.212437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a6729f3f-62cb-4a49-b4a3-fac8f71ff53b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8812bdb1f3834523aab2bb94bce61085'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:47.224850 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a6729f3f-62cb-4a49-b4a3-fac8f71ff53b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8812bdb1f3834523aab2bb94bce61085'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:47.252773 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a6729f3f-62cb-4a49-b4a3-fac8f71ff53b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8812bdb1f3834523aab2bb94bce61085'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:47.266037 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a6729f3f-62cb-4a49-b4a3-fac8f71ff53b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8812bdb1f3834523aab2bb94bce61085'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:47.266851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a6729f3f-62cb-4a49-b4a3-fac8f71ff53b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8812bdb1f3834523aab2bb94bce61085'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:47.268555 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:47.275521 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1149/2306] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:47 2022] DELETE /identity/v3/users/8812bdb1f3834523aab2bb94bce61085 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:47.288157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c78b6-2534-4ad6-ad97-d02429e8244e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:47.288157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c78b6-2534-4ad6-ad97-d02429e8244e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:47.288157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c78b6-2534-4ad6-ad97-d02429e8244e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:47.309826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6729f3f-62cb-4a49-b4a3-fac8f71ff53b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:47.311056 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c55c78b6-2534-4ad6-ad97-d02429e8244e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:47.311346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a6729f3f-62cb-4a49-b4a3-fac8f71ff53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:47.312480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c55c78b6-2534-4ad6-ad97-d02429e8244e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:47.379985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1158/2307] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:47.383036 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6729f3f-62cb-4a49-b4a3-fac8f71ff53b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:47.388459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272398d-ae87-46b3-97c3-0f7e240a5773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:47.389247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272398d-ae87-46b3-97c3-0f7e240a5773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:47.389526 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272398d-ae87-46b3-97c3-0f7e240a5773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:47.389799 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272398d-ae87-46b3-97c3-0f7e240a5773 admin admin] PATH_INFO: `/v3/projects/4f508301dafd4bf2a5dff0836334dc70` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:47.391050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272398d-ae87-46b3-97c3-0f7e240a5773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f508301dafd4bf2a5dff0836334dc70)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:47.393435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272398d-ae87-46b3-97c3-0f7e240a5773 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:47.395762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c78b6-2534-4ad6-ad97-d02429e8244e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:47.400624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c55c78b6-2534-4ad6-ad97-d02429e8244e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:47.461399 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:47.467211 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c78b6-2534-4ad6-ad97-d02429e8244e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:47.472883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1272398d-ae87-46b3-97c3-0f7e240a5773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f508301dafd4bf2a5dff0836334dc70', 'request_id': 'req-1272398d-ae87-46b3-97c3-0f7e240a5773'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:47.482360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1272398d-ae87-46b3-97c3-0f7e240a5773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f508301dafd4bf2a5dff0836334dc70', 'request_id': 'req-1272398d-ae87-46b3-97c3-0f7e240a5773'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:47.491694 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1272398d-ae87-46b3-97c3-0f7e240a5773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f508301dafd4bf2a5dff0836334dc70', 'request_id': 'req-1272398d-ae87-46b3-97c3-0f7e240a5773'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:47.505382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1272398d-ae87-46b3-97c3-0f7e240a5773 admin admin] The token cache is being invalidate because project 4f508301dafd4bf2a5dff0836334dc70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:47.505382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1272398d-ae87-46b3-97c3-0f7e240a5773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:47.506112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1272398d-ae87-46b3-97c3-0f7e240a5773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:47.507950 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1150/2308] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:47 2022] DELETE /identity/v3/projects/4f508301dafd4bf2a5dff0836334dc70 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:47.513104 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272398d-ae87-46b3-97c3-0f7e240a5773 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:47.514804 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1272398d-ae87-46b3-97c3-0f7e240a5773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:47.541506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3943c3-7228-4821-8b8e-d5620549af9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:47.542114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3943c3-7228-4821-8b8e-d5620549af9e service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:47.542394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3943c3-7228-4821-8b8e-d5620549af9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:47.543214 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3943c3-7228-4821-8b8e-d5620549af9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:47.545000 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4f3943c3-7228-4821-8b8e-d5620549af9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:47.589459 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272398d-ae87-46b3-97c3-0f7e240a5773 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:47.594154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d327a8f-227f-4d74-bf38-8d43cbb6865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:47.594774 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d327a8f-227f-4d74-bf38-8d43cbb6865e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:47.595052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d327a8f-227f-4d74-bf38-8d43cbb6865e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:47.595318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d327a8f-227f-4d74-bf38-8d43cbb6865e admin admin] PATH_INFO: `/v3/users/09694a49d5c4436db47c1163cdd5401f` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:47.596433 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d327a8f-227f-4d74-bf38-8d43cbb6865e admin admin] RBAC: Authorizing `identity:delete_user(user_id=09694a49d5c4436db47c1163cdd5401f)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:47.598371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d327a8f-227f-4d74-bf38-8d43cbb6865e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:47.616071 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3943c3-7228-4821-8b8e-d5620549af9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:47.617552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3943c3-7228-4821-8b8e-d5620549af9e service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:47.628693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1159/2309] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:47.638742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:47.655494 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5d327a8f-227f-4d74-bf38-8d43cbb6865e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09694a49d5c4436db47c1163cdd5401f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:47.664535 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5d327a8f-227f-4d74-bf38-8d43cbb6865e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09694a49d5c4436db47c1163cdd5401f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:47.678135 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5d327a8f-227f-4d74-bf38-8d43cbb6865e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09694a49d5c4436db47c1163cdd5401f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:47.686248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5d327a8f-227f-4d74-bf38-8d43cbb6865e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09694a49d5c4436db47c1163cdd5401f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:47.687010 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5d327a8f-227f-4d74-bf38-8d43cbb6865e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09694a49d5c4436db47c1163cdd5401f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:47.693185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1151/2310] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:47 2022] DELETE /identity/v3/users/09694a49d5c4436db47c1163cdd5401f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:47.983249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3943c3-7228-4821-8b8e-d5620549af9e service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:47.984842 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4f3943c3-7228-4821-8b8e-d5620549af9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:48.004888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3943c3-7228-4821-8b8e-d5620549af9e service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:48.064427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075535b-07a4-4f40-914c-f60389bc26e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:48.065486 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075535b-07a4-4f40-914c-f60389bc26e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:48.065763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075535b-07a4-4f40-914c-f60389bc26e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:48.066032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075535b-07a4-4f40-914c-f60389bc26e7 admin admin] PATH_INFO: `/v3/projects/0d3e14345a874baea9a66a916ac9cd51` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:48.067177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075535b-07a4-4f40-914c-f60389bc26e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3e14345a874baea9a66a916ac9cd51)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:48.069132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075535b-07a4-4f40-914c-f60389bc26e7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:48.118518 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1075535b-07a4-4f40-914c-f60389bc26e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3e14345a874baea9a66a916ac9cd51', 'request_id': 'req-1075535b-07a4-4f40-914c-f60389bc26e7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.122497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d327a8f-227f-4d74-bf38-8d43cbb6865e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:48.123968 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5d327a8f-227f-4d74-bf38-8d43cbb6865e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:48.127033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:48.129134 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1075535b-07a4-4f40-914c-f60389bc26e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3e14345a874baea9a66a916ac9cd51', 'request_id': 'req-1075535b-07a4-4f40-914c-f60389bc26e7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.148783 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1075535b-07a4-4f40-914c-f60389bc26e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3e14345a874baea9a66a916ac9cd51', 'request_id': 'req-1075535b-07a4-4f40-914c-f60389bc26e7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.154627 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d327a8f-227f-4d74-bf38-8d43cbb6865e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:48.162065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1075535b-07a4-4f40-914c-f60389bc26e7 admin admin] The token cache is being invalidate because project 0d3e14345a874baea9a66a916ac9cd51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:48.162360 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1075535b-07a4-4f40-914c-f60389bc26e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.162998 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1075535b-07a4-4f40-914c-f60389bc26e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.164494 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1160/2311] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:47 2022] DELETE /identity/v3/projects/0d3e14345a874baea9a66a916ac9cd51 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:48.223770 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ff58f-f380-4ca5-8935-813320fa3b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:48.224333 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff58f-f380-4ca5-8935-813320fa3b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:48.224644 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff58f-f380-4ca5-8935-813320fa3b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:48.224915 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff58f-f380-4ca5-8935-813320fa3b6d admin admin] PATH_INFO: `/v3/projects/a29f746be25a4e0784a9d34eaf721964` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:48.226137 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ff58f-f380-4ca5-8935-813320fa3b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a29f746be25a4e0784a9d34eaf721964)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:48.228300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ff58f-f380-4ca5-8935-813320fa3b6d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:48.287033 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee7ff58f-f380-4ca5-8935-813320fa3b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a29f746be25a4e0784a9d34eaf721964', 'request_id': 'req-ee7ff58f-f380-4ca5-8935-813320fa3b6d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.295263 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee7ff58f-f380-4ca5-8935-813320fa3b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a29f746be25a4e0784a9d34eaf721964', 'request_id': 'req-ee7ff58f-f380-4ca5-8935-813320fa3b6d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.302566 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee7ff58f-f380-4ca5-8935-813320fa3b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a29f746be25a4e0784a9d34eaf721964', 'request_id': 'req-ee7ff58f-f380-4ca5-8935-813320fa3b6d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.315084 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee7ff58f-f380-4ca5-8935-813320fa3b6d admin admin] The token cache is being invalidate because project a29f746be25a4e0784a9d34eaf721964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:48.315377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee7ff58f-f380-4ca5-8935-813320fa3b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.316037 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee7ff58f-f380-4ca5-8935-813320fa3b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.317846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1152/2312] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:48 2022] DELETE /identity/v3/projects/a29f746be25a4e0784a9d34eaf721964 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:48.321760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075535b-07a4-4f40-914c-f60389bc26e7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:48.323608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1075535b-07a4-4f40-914c-f60389bc26e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:48.338047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075535b-07a4-4f40-914c-f60389bc26e7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:48.401090 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c4d81-f741-4c58-9163-8f52e42ea700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:48.401720 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c4d81-f741-4c58-9163-8f52e42ea700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:48.402554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c4d81-f741-4c58-9163-8f52e42ea700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:48.402830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c4d81-f741-4c58-9163-8f52e42ea700 admin admin] PATH_INFO: `/v3/users/bbaa3c0e80364704a38e76ef0ead43f1` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:48.404015 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c4d81-f741-4c58-9163-8f52e42ea700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbaa3c0e80364704a38e76ef0ead43f1)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:48.405997 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c4d81-f741-4c58-9163-8f52e42ea700 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:48.454008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b43c4d81-f741-4c58-9163-8f52e42ea700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbaa3c0e80364704a38e76ef0ead43f1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.466040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b43c4d81-f741-4c58-9163-8f52e42ea700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbaa3c0e80364704a38e76ef0ead43f1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.478417 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b43c4d81-f741-4c58-9163-8f52e42ea700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbaa3c0e80364704a38e76ef0ead43f1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.486248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b43c4d81-f741-4c58-9163-8f52e42ea700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbaa3c0e80364704a38e76ef0ead43f1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.487055 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b43c4d81-f741-4c58-9163-8f52e42ea700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbaa3c0e80364704a38e76ef0ead43f1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.493433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1161/2313] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:48 2022] DELETE /identity/v3/users/bbaa3c0e80364704a38e76ef0ead43f1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:48.779035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ff58f-f380-4ca5-8935-813320fa3b6d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:48.780633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ee7ff58f-f380-4ca5-8935-813320fa3b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:48.795261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ff58f-f380-4ca5-8935-813320fa3b6d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:48.838086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:48.863251 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa99d-d8eb-4ad8-b7ab-59d219d93024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:48.863878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa99d-d8eb-4ad8-b7ab-59d219d93024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:48.864159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa99d-d8eb-4ad8-b7ab-59d219d93024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:48.864431 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa99d-d8eb-4ad8-b7ab-59d219d93024 admin admin] PATH_INFO: `/v3/projects/f7d972bb4ddd45d791541d8684819b64` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:48.865573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062aa99d-d8eb-4ad8-b7ab-59d219d93024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d972bb4ddd45d791541d8684819b64)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:48.867517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062aa99d-d8eb-4ad8-b7ab-59d219d93024 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:48.913082 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-062aa99d-d8eb-4ad8-b7ab-59d219d93024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d972bb4ddd45d791541d8684819b64', 'request_id': 'req-062aa99d-d8eb-4ad8-b7ab-59d219d93024'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.919987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-062aa99d-d8eb-4ad8-b7ab-59d219d93024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d972bb4ddd45d791541d8684819b64', 'request_id': 'req-062aa99d-d8eb-4ad8-b7ab-59d219d93024'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.926022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-062aa99d-d8eb-4ad8-b7ab-59d219d93024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d972bb4ddd45d791541d8684819b64', 'request_id': 'req-062aa99d-d8eb-4ad8-b7ab-59d219d93024'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.936076 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-062aa99d-d8eb-4ad8-b7ab-59d219d93024 admin admin] The token cache is being invalidate because project f7d972bb4ddd45d791541d8684819b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:48.936362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-062aa99d-d8eb-4ad8-b7ab-59d219d93024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.937003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-062aa99d-d8eb-4ad8-b7ab-59d219d93024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:48.938456 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1153/2314] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:48 2022] DELETE /identity/v3/projects/f7d972bb4ddd45d791541d8684819b64 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:48.944358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ade306-7b09-4477-9fd4-6ecb3202a96a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:48.944882 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ade306-7b09-4477-9fd4-6ecb3202a96a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:48.944979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ade306-7b09-4477-9fd4-6ecb3202a96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:48.964177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-81ade306-7b09-4477-9fd4-6ecb3202a96a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:48.965935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-81ade306-7b09-4477-9fd4-6ecb3202a96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:49.022903 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1162/2315] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:49.033714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa4ddc-74d4-41f3-b2be-a77016959e28 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.034010 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa4ddc-74d4-41f3-b2be-a77016959e28 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.034289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa4ddc-74d4-41f3-b2be-a77016959e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.053705 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6faa4ddc-74d4-41f3-b2be-a77016959e28 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:49.055254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6faa4ddc-74d4-41f3-b2be-a77016959e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:49.063503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1154/2316] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:49.067606 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ade306-7b09-4477-9fd4-6ecb3202a96a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:49.074478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:49.078927 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ade306-7b09-4477-9fd4-6ecb3202a96a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:49.084955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e818d7-d23f-4d47-9b88-b894cb66d137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:49.085744 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e818d7-d23f-4d47-9b88-b894cb66d137 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.086230 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e818d7-d23f-4d47-9b88-b894cb66d137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.086523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e818d7-d23f-4d47-9b88-b894cb66d137 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.087446 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e818d7-d23f-4d47-9b88-b894cb66d137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:49.087775 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e818d7-d23f-4d47-9b88-b894cb66d137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:49.090344 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e818d7-d23f-4d47-9b88-b894cb66d137 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:49.101957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1163/2317] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:26:49.106448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa4ddc-74d4-41f3-b2be-a77016959e28 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:49.116422 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa4ddc-74d4-41f3-b2be-a77016959e28 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:49.121239 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f15ec-f4c8-4963-a974-e2120915584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:49.121838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f15ec-f4c8-4963-a974-e2120915584b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.122116 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f15ec-f4c8-4963-a974-e2120915584b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.122388 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f15ec-f4c8-4963-a974-e2120915584b admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.123045 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f15ec-f4c8-4963-a974-e2120915584b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:49.124973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f15ec-f4c8-4963-a974-e2120915584b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:49.157040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1155/2318] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:49 2022] POST /identity/v3/projects => generated 407 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:49.159715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e818d7-d23f-4d47-9b88-b894cb66d137 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:49.169940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e818d7-d23f-4d47-9b88-b894cb66d137 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:49.227588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c24334-61f6-4320-a9b1-acc5985c8362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:49.228196 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c24334-61f6-4320-a9b1-acc5985c8362 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.228473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c24334-61f6-4320-a9b1-acc5985c8362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.228778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c24334-61f6-4320-a9b1-acc5985c8362 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.229398 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c24334-61f6-4320-a9b1-acc5985c8362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:49.231449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c24334-61f6-4320-a9b1-acc5985c8362 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:49.253721 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1164/2319] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:49 2022] POST /identity/v3/users => generated 304 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:49.257980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f15ec-f4c8-4963-a974-e2120915584b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:49.269300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f15ec-f4c8-4963-a974-e2120915584b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:49.274547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b0de0-fcfc-4379-b7bd-d7298f963e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:49.275044 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b0de0-fcfc-4379-b7bd-d7298f963e63 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.275368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b0de0-fcfc-4379-b7bd-d7298f963e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.275593 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b0de0-fcfc-4379-b7bd-d7298f963e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.276253 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b0de0-fcfc-4379-b7bd-d7298f963e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:49.277902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b0de0-fcfc-4379-b7bd-d7298f963e63 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:49.292663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1156/2320] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:49.293995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c24334-61f6-4320-a9b1-acc5985c8362 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:49.305058 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c24334-61f6-4320-a9b1-acc5985c8362 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:49.310199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48196e-16a7-4c0a-b668-bbb914b82837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:49.310795 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48196e-16a7-4c0a-b668-bbb914b82837 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.311076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48196e-16a7-4c0a-b668-bbb914b82837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.311466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48196e-16a7-4c0a-b668-bbb914b82837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.312122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48196e-16a7-4c0a-b668-bbb914b82837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:49.313735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48196e-16a7-4c0a-b668-bbb914b82837 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:49.325042 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1165/2321] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:49.329143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b0de0-fcfc-4379-b7bd-d7298f963e63 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:49.339238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b0de0-fcfc-4379-b7bd-d7298f963e63 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:49.343765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ef80b-8ec7-4e71-8eec-0760c20be7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:49.344394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ef80b-8ec7-4e71-8eec-0760c20be7aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.344710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ef80b-8ec7-4e71-8eec-0760c20be7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.344983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ef80b-8ec7-4e71-8eec-0760c20be7aa admin admin] PATH_INFO: `/v3/projects/1761b6f2f14e4fdfaf88419e71ec0fa2/users/637a739d98fc46fc9b3200e48ee640e1/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.359140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ef80b-8ec7-4e71-8eec-0760c20be7aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1761b6f2f14e4fdfaf88419e71ec0fa2, user_id=637a739d98fc46fc9b3200e48ee640e1, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:49.361816 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ef80b-8ec7-4e71-8eec-0760c20be7aa admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:49.375111 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1157/2322] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:49 2022] PUT /identity/v3/projects/1761b6f2f14e4fdfaf88419e71ec0fa2/users/637a739d98fc46fc9b3200e48ee640e1/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:49.386916 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0316f6-dae5-46be-8e78-6a1c3a07f0db None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.387197 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0316f6-dae5-46be-8e78-6a1c3a07f0db None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.387465 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0316f6-dae5-46be-8e78-6a1c3a07f0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.414497 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3f0316f6-dae5-46be-8e78-6a1c3a07f0db None None] MFA Rules not processed for user `637a739d98fc46fc9b3200e48ee640e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:49.415699 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3f0316f6-dae5-46be-8e78-6a1c3a07f0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:49.462963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ef80b-8ec7-4e71-8eec-0760c20be7aa admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:49.465340 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-156ef80b-8ec7-4e71-8eec-0760c20be7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:49.485076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1166/2323] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:49 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:49.489738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0316f6-dae5-46be-8e78-6a1c3a07f0db None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:49.534881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ef80b-8ec7-4e71-8eec-0760c20be7aa admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:49.539598 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b936700-e47a-4b9b-9455-0008a03ec3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:49.540217 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b936700-e47a-4b9b-9455-0008a03ec3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.540497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b936700-e47a-4b9b-9455-0008a03ec3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.540807 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b936700-e47a-4b9b-9455-0008a03ec3ca admin admin] PATH_INFO: `/v3/users/871a5634d6024f2f9f461ea98d7a3d0e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.541935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b936700-e47a-4b9b-9455-0008a03ec3ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=871a5634d6024f2f9f461ea98d7a3d0e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:49.544453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b936700-e47a-4b9b-9455-0008a03ec3ca admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:49.549695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:49.551963 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0316f6-dae5-46be-8e78-6a1c3a07f0db None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:49.556537 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0616e47-e2f4-4ae7-923a-2b2c2bbfca2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:49.557160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0616e47-e2f4-4ae7-923a-2b2c2bbfca2e admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.557433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0616e47-e2f4-4ae7-923a-2b2c2bbfca2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.557702 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0616e47-e2f4-4ae7-923a-2b2c2bbfca2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.558374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0616e47-e2f4-4ae7-923a-2b2c2bbfca2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:49.560265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0616e47-e2f4-4ae7-923a-2b2c2bbfca2e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:49.565999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:49.596532 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1167/2324] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:49 2022] POST /identity/v3/projects => generated 407 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:49.597526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0616e47-e2f4-4ae7-923a-2b2c2bbfca2e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:49.601450 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6b936700-e47a-4b9b-9455-0008a03ec3ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '871a5634d6024f2f9f461ea98d7a3d0e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:49.623029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6b936700-e47a-4b9b-9455-0008a03ec3ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '871a5634d6024f2f9f461ea98d7a3d0e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:49.637578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6b936700-e47a-4b9b-9455-0008a03ec3ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '871a5634d6024f2f9f461ea98d7a3d0e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:49.644845 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6b936700-e47a-4b9b-9455-0008a03ec3ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '871a5634d6024f2f9f461ea98d7a3d0e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:49.645588 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6b936700-e47a-4b9b-9455-0008a03ec3ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '871a5634d6024f2f9f461ea98d7a3d0e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:49.656421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1158/2325] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:49 2022] DELETE /identity/v3/users/871a5634d6024f2f9f461ea98d7a3d0e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:49.657935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3396d8-40c8-478e-b4e9-555114c76f22 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.658215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3396d8-40c8-478e-b4e9-555114c76f22 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.658509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3396d8-40c8-478e-b4e9-555114c76f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.672348 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0616e47-e2f4-4ae7-923a-2b2c2bbfca2e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:49.681166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fe3396d8-40c8-478e-b4e9-555114c76f22 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:49.682491 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fe3396d8-40c8-478e-b4e9-555114c76f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:49.739109 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa15a9-6431-4d86-bfbe-a1c91c25b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:49.739916 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa15a9-6431-4d86-bfbe-a1c91c25b8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.740206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa15a9-6431-4d86-bfbe-a1c91c25b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.740473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa15a9-6431-4d86-bfbe-a1c91c25b8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.741337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa15a9-6431-4d86-bfbe-a1c91c25b8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:49.743275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa15a9-6431-4d86-bfbe-a1c91c25b8b0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:49.752281 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1159/2326] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:49.762706 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3396d8-40c8-478e-b4e9-555114c76f22 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:49.764222 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fe3396d8-40c8-478e-b4e9-555114c76f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:49.769770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1168/2327] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:49 2022] POST /identity/v3/users => generated 310 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:49.770776 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa15a9-6431-4d86-bfbe-a1c91c25b8b0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:49.772638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4caa15a9-6431-4d86-bfbe-a1c91c25b8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:49.785739 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa15a9-6431-4d86-bfbe-a1c91c25b8b0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:49.791347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62373ee0-6e09-4e23-9814-dc37515773a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:49.791861 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62373ee0-6e09-4e23-9814-dc37515773a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.792197 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62373ee0-6e09-4e23-9814-dc37515773a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.793024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62373ee0-6e09-4e23-9814-dc37515773a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.793666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62373ee0-6e09-4e23-9814-dc37515773a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:49.795243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62373ee0-6e09-4e23-9814-dc37515773a5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:49.805560 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1169/2328] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:49.809824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62373ee0-6e09-4e23-9814-dc37515773a5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:49.820452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62373ee0-6e09-4e23-9814-dc37515773a5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:49.826473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c566f-aa39-4e2f-8bbb-95b40b64a52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:49.827207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c566f-aa39-4e2f-8bbb-95b40b64a52e admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.827387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c566f-aa39-4e2f-8bbb-95b40b64a52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.827679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c566f-aa39-4e2f-8bbb-95b40b64a52e admin admin] PATH_INFO: `/v3/projects/67ab1253ebc5472097ada0cec4b684d1/users/04a5a97448914a729647a6f274419a3a/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.830915 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3396d8-40c8-478e-b4e9-555114c76f22 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:49.835556 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedae90c-7fba-44b4-8e09-47b348285d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:49.836184 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedae90c-7fba-44b4-8e09-47b348285d63 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.836541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedae90c-7fba-44b4-8e09-47b348285d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.837148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedae90c-7fba-44b4-8e09-47b348285d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.844057 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c566f-aa39-4e2f-8bbb-95b40b64a52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ab1253ebc5472097ada0cec4b684d1, user_id=04a5a97448914a729647a6f274419a3a, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:49.847514 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c566f-aa39-4e2f-8bbb-95b40b64a52e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:49.848508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedae90c-7fba-44b4-8e09-47b348285d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:49.850160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedae90c-7fba-44b4-8e09-47b348285d63 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:49.861608 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1160/2329] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:49.866001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1170/2330] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:49 2022] PUT /identity/v3/projects/67ab1253ebc5472097ada0cec4b684d1/users/04a5a97448914a729647a6f274419a3a/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:49.870136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedae90c-7fba-44b4-8e09-47b348285d63 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:49.880094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedae90c-7fba-44b4-8e09-47b348285d63 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:49.907821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:49.945498 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db7a33-c732-4369-b4fd-0e9bb5ff88d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:49.946350 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db7a33-c732-4369-b4fd-0e9bb5ff88d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.946907 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db7a33-c732-4369-b4fd-0e9bb5ff88d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.947180 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db7a33-c732-4369-b4fd-0e9bb5ff88d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.947845 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db7a33-c732-4369-b4fd-0e9bb5ff88d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:49.950034 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db7a33-c732-4369-b4fd-0e9bb5ff88d3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:49.960439 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1161/2331] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:49.964686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c566f-aa39-4e2f-8bbb-95b40b64a52e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:49.974971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c566f-aa39-4e2f-8bbb-95b40b64a52e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:49.979601 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42926b-a41e-4f8c-a68a-22d8709c1020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:49.980278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42926b-a41e-4f8c-a68a-22d8709c1020 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:49.980558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42926b-a41e-4f8c-a68a-22d8709c1020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:49.980974 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42926b-a41e-4f8c-a68a-22d8709c1020 admin admin] PATH_INFO: `/v3/projects/67ab1253ebc5472097ada0cec4b684d1/users/04a5a97448914a729647a6f274419a3a/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:49.982948 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42926b-a41e-4f8c-a68a-22d8709c1020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ab1253ebc5472097ada0cec4b684d1, user_id=04a5a97448914a729647a6f274419a3a, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:49.985659 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42926b-a41e-4f8c-a68a-22d8709c1020 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:49.996563 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1171/2332] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:49 2022] PUT /identity/v3/projects/67ab1253ebc5472097ada0cec4b684d1/users/04a5a97448914a729647a6f274419a3a/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:50.007897 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b6400-034c-4c53-9fec-46b43a2171d6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:50.008187 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b6400-034c-4c53-9fec-46b43a2171d6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:50.008467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b6400-034c-4c53-9fec-46b43a2171d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:50.045915 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-474b6400-034c-4c53-9fec-46b43a2171d6 None None] MFA Rules not processed for user `04a5a97448914a729647a6f274419a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:50.047051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-474b6400-034c-4c53-9fec-46b43a2171d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:50.115132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1162/2333] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:50 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:50.127682 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42926b-a41e-4f8c-a68a-22d8709c1020 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:50.129468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0e42926b-a41e-4f8c-a68a-22d8709c1020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:50.144056 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b6400-034c-4c53-9fec-46b43a2171d6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:50.146864 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-474b6400-034c-4c53-9fec-46b43a2171d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:50.174925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:50.198126 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42926b-a41e-4f8c-a68a-22d8709c1020 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:50.201908 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14055a5-2409-4c83-8de9-9f43f4672a13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:50.202627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14055a5-2409-4c83-8de9-9f43f4672a13 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:50.202901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14055a5-2409-4c83-8de9-9f43f4672a13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:50.203171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14055a5-2409-4c83-8de9-9f43f4672a13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:50.213987 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14055a5-2409-4c83-8de9-9f43f4672a13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:50.215954 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14055a5-2409-4c83-8de9-9f43f4672a13 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:50.217422 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b6400-034c-4c53-9fec-46b43a2171d6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:50.222129 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:50.222748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:50.223032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:50.223300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5 admin admin] PATH_INFO: `/v3/projects/13c879d8a65343e6b3c1d51d8aed6206` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:50.224383 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c879d8a65343e6b3c1d51d8aed6206)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:50.225403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1172/2334] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:50 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:50.226387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:50.274346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c879d8a65343e6b3c1d51d8aed6206', 'request_id': 'req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:50.275993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:50.283159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c879d8a65343e6b3c1d51d8aed6206', 'request_id': 'req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:50.290064 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c879d8a65343e6b3c1d51d8aed6206', 'request_id': 'req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:50.301675 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5 admin admin] The token cache is being invalidate because project 13c879d8a65343e6b3c1d51d8aed6206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:50.301976 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:50.302690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:50.304239 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1163/2335] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:50 2022] DELETE /identity/v3/projects/13c879d8a65343e6b3c1d51d8aed6206 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:50.309252 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c455a3-f346-43eb-85a5-58bfcdd49bec None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:50.309535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c455a3-f346-43eb-85a5-58bfcdd49bec None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:50.309810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c455a3-f346-43eb-85a5-58bfcdd49bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:50.331025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b6c455a3-f346-43eb-85a5-58bfcdd49bec None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:50.332803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b6c455a3-f346-43eb-85a5-58bfcdd49bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:50.385030 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:50.387190 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:50.400491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1173/2336] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:50.409521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081a608-89f4-4836-995a-7c57946f9bc2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:50.409867 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081a608-89f4-4836-995a-7c57946f9bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:50.410206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081a608-89f4-4836-995a-7c57946f9bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:50.432264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1081a608-89f4-4836-995a-7c57946f9bc2 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:50.434272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1081a608-89f4-4836-995a-7c57946f9bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:50.443038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1174/2337] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:50.447129 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081a608-89f4-4836-995a-7c57946f9bc2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:50.455025 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0ff12-041c-4dab-a6b6-38a58438a4f5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:50.457539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081a608-89f4-4836-995a-7c57946f9bc2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:50.458954 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8977b-21c9-4f78-aff1-c7712d8daf45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:50.459565 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8977b-21c9-4f78-aff1-c7712d8daf45 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:50.459843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8977b-21c9-4f78-aff1-c7712d8daf45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:50.460119 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8977b-21c9-4f78-aff1-c7712d8daf45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:50.461986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4fa8977b-21c9-4f78-aff1-c7712d8daf45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:50.462260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc823e1-a8fb-4e5d-aac0-fe6d1b5a3c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:50.462848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc823e1-a8fb-4e5d-aac0-fe6d1b5a3c9a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:50.463181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc823e1-a8fb-4e5d-aac0-fe6d1b5a3c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:50.463454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc823e1-a8fb-4e5d-aac0-fe6d1b5a3c9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:50.464087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc823e1-a8fb-4e5d-aac0-fe6d1b5a3c9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:50.464417 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc823e1-a8fb-4e5d-aac0-fe6d1b5a3c9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:50.466029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc823e1-a8fb-4e5d-aac0-fe6d1b5a3c9a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:50.482438 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1175/2338] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:26:50.486960 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc823e1-a8fb-4e5d-aac0-fe6d1b5a3c9a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:50.496888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc823e1-a8fb-4e5d-aac0-fe6d1b5a3c9a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:50.501581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c04bf-f3b8-4f0b-bbe7-7f1e52e84d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:50.502171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c04bf-f3b8-4f0b-bbe7-7f1e52e84d43 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:50.502448 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c04bf-f3b8-4f0b-bbe7-7f1e52e84d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:50.502871 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c04bf-f3b8-4f0b-bbe7-7f1e52e84d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:50.503489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c04bf-f3b8-4f0b-bbe7-7f1e52e84d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:50.505547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c04bf-f3b8-4f0b-bbe7-7f1e52e84d43 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:50.536401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1176/2339] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:50 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:50.537515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c04bf-f3b8-4f0b-bbe7-7f1e52e84d43 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:50.537848 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8977b-21c9-4f78-aff1-c7712d8daf45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:50.539359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8977b-21c9-4f78-aff1-c7712d8daf45 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:50.549449 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1164/2340] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:50 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:26:50.600046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c04bf-f3b8-4f0b-bbe7-7f1e52e84d43 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:50.605727 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e3f74-5d39-49dd-bbad-b2854c873965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:50.606331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e3f74-5d39-49dd-bbad-b2854c873965 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:50.606604 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e3f74-5d39-49dd-bbad-b2854c873965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:50.606878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e3f74-5d39-49dd-bbad-b2854c873965 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:50.607489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e3f74-5d39-49dd-bbad-b2854c873965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:50.609437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e3f74-5d39-49dd-bbad-b2854c873965 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:50.636559 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1177/2341] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:50 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:50.640777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8977b-21c9-4f78-aff1-c7712d8daf45 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:50.654439 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8977b-21c9-4f78-aff1-c7712d8daf45 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:50.659783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094037c-9ae8-4daf-830e-d7d7f84d0e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:50.660436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094037c-9ae8-4daf-830e-d7d7f84d0e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:50.660759 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094037c-9ae8-4daf-830e-d7d7f84d0e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:50.661040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094037c-9ae8-4daf-830e-d7d7f84d0e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:50.661667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094037c-9ae8-4daf-830e-d7d7f84d0e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:50.663311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094037c-9ae8-4daf-830e-d7d7f84d0e74 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:50.674848 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1165/2342] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:50.679126 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e3f74-5d39-49dd-bbad-b2854c873965 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:50.693207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e3f74-5d39-49dd-bbad-b2854c873965 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:50.697886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439d282-c00b-4770-8b6c-f202eea019e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:50.698481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439d282-c00b-4770-8b6c-f202eea019e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:50.698798 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439d282-c00b-4770-8b6c-f202eea019e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:50.699072 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439d282-c00b-4770-8b6c-f202eea019e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:50.699712 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439d282-c00b-4770-8b6c-f202eea019e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:50.701538 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439d282-c00b-4770-8b6c-f202eea019e2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:50.712530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1178/2343] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:50.718284 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094037c-9ae8-4daf-830e-d7d7f84d0e74 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:50.731107 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094037c-9ae8-4daf-830e-d7d7f84d0e74 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:50.736143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206efe0f-59a1-4757-8cd9-641ad816936a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:50.736845 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206efe0f-59a1-4757-8cd9-641ad816936a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:50.737123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206efe0f-59a1-4757-8cd9-641ad816936a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:50.737394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206efe0f-59a1-4757-8cd9-641ad816936a admin admin] PATH_INFO: `/v3/projects/0f911b01eb464c8aa1ac59e5c1d00d53/users/8c2c37b2b45d4a029006837ff0d71b47/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:50.752628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206efe0f-59a1-4757-8cd9-641ad816936a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f911b01eb464c8aa1ac59e5c1d00d53, user_id=8c2c37b2b45d4a029006837ff0d71b47, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:50.755278 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206efe0f-59a1-4757-8cd9-641ad816936a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:50.769542 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1166/2344] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:50 2022] PUT /identity/v3/projects/0f911b01eb464c8aa1ac59e5c1d00d53/users/8c2c37b2b45d4a029006837ff0d71b47/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:50.840427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb3306-5a13-4165-a0c5-04b0a280498a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:50.840751 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb3306-5a13-4165-a0c5-04b0a280498a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:50.841071 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb3306-5a13-4165-a0c5-04b0a280498a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:50.869819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a3cb3306-5a13-4165-a0c5-04b0a280498a None None] MFA Rules not processed for user `8c2c37b2b45d4a029006837ff0d71b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:50.871065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a3cb3306-5a13-4165-a0c5-04b0a280498a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:50.880044 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:50.941239 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1179/2345] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:50.952188 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206efe0f-59a1-4757-8cd9-641ad816936a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:50.954216 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-206efe0f-59a1-4757-8cd9-641ad816936a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:51.013200 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206efe0f-59a1-4757-8cd9-641ad816936a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:51.016843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ec931-c429-473e-a8a1-df6ff9eb2fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:51.017436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ec931-c429-473e-a8a1-df6ff9eb2fcf service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:51.017712 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ec931-c429-473e-a8a1-df6ff9eb2fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:51.018001 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ec931-c429-473e-a8a1-df6ff9eb2fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:51.026198 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ec931-c429-473e-a8a1-df6ff9eb2fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:51.028928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ec931-c429-473e-a8a1-df6ff9eb2fcf service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:51.034056 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:51.038778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1167/2346] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:52.404934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347f05a-61e8-434d-abf8-789ec06398d2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:52.405461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347f05a-61e8-434d-abf8-789ec06398d2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:52.407552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347f05a-61e8-434d-abf8-789ec06398d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:52.427007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c347f05a-61e8-434d-abf8-789ec06398d2 None None] MFA Rules not processed for user `8c2c37b2b45d4a029006837ff0d71b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:52.428223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c347f05a-61e8-434d-abf8-789ec06398d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:52.435110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1180/2347] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:53.191576 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ec931-c429-473e-a8a1-df6ff9eb2fcf service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:53.193790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8f3ec931-c429-473e-a8a1-df6ff9eb2fcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:53.293166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ec931-c429-473e-a8a1-df6ff9eb2fcf service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:53.302437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a5a2a-f58d-41d4-8a19-378cd4566901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:53.303527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a5a2a-f58d-41d4-8a19-378cd4566901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:53.305115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a5a2a-f58d-41d4-8a19-378cd4566901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:53.305356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a5a2a-f58d-41d4-8a19-378cd4566901 admin admin] PATH_INFO: `/v3/users/213d8f95da3f4c66a2bd11e64f812085` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:53.308392 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a5a2a-f58d-41d4-8a19-378cd4566901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=213d8f95da3f4c66a2bd11e64f812085)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:53.311261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a5a2a-f58d-41d4-8a19-378cd4566901 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:53.376643 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f29a5a2a-f58d-41d4-8a19-378cd4566901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '213d8f95da3f4c66a2bd11e64f812085'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:53.391913 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f29a5a2a-f58d-41d4-8a19-378cd4566901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '213d8f95da3f4c66a2bd11e64f812085'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:53.427988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f29a5a2a-f58d-41d4-8a19-378cd4566901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '213d8f95da3f4c66a2bd11e64f812085'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:53.455986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f29a5a2a-f58d-41d4-8a19-378cd4566901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '213d8f95da3f4c66a2bd11e64f812085'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:53.457899 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f29a5a2a-f58d-41d4-8a19-378cd4566901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '213d8f95da3f4c66a2bd11e64f812085'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:53.482987 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1168/2348] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:53 2022] DELETE /identity/v3/users/213d8f95da3f4c66a2bd11e64f812085 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:53.487677 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148a7c6-21e2-47cb-bd5a-b029d829bae6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:53.488113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148a7c6-21e2-47cb-bd5a-b029d829bae6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:53.488419 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148a7c6-21e2-47cb-bd5a-b029d829bae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:53.517368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e148a7c6-21e2-47cb-bd5a-b029d829bae6 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:53.519278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e148a7c6-21e2-47cb-bd5a-b029d829bae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:53.616636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1181/2349] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:53.624540 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a5a2a-f58d-41d4-8a19-378cd4566901 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:53.626213 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f29a5a2a-f58d-41d4-8a19-378cd4566901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:53.711211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a5a2a-f58d-41d4-8a19-378cd4566901 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:53.717507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847528ff-ea0e-4a1b-acc4-a075357f5e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:53.718123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847528ff-ea0e-4a1b-acc4-a075357f5e63 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:53.718387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847528ff-ea0e-4a1b-acc4-a075357f5e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:53.718658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847528ff-ea0e-4a1b-acc4-a075357f5e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:53.729123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847528ff-ea0e-4a1b-acc4-a075357f5e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:53.731151 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847528ff-ea0e-4a1b-acc4-a075357f5e63 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:53.744381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1169/2350] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:54.264645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148a7c6-21e2-47cb-bd5a-b029d829bae6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:54.266075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e148a7c6-21e2-47cb-bd5a-b029d829bae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:54.278609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148a7c6-21e2-47cb-bd5a-b029d829bae6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:54.283916 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56295549-a869-4cf9-bcf6-e02fa0c27f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:54.284634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56295549-a869-4cf9-bcf6-e02fa0c27f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:54.285051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56295549-a869-4cf9-bcf6-e02fa0c27f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:54.285320 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56295549-a869-4cf9-bcf6-e02fa0c27f9e admin admin] PATH_INFO: `/v3/projects/72ee2dba72704f62a048743b75c346dc` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:54.286464 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56295549-a869-4cf9-bcf6-e02fa0c27f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ee2dba72704f62a048743b75c346dc)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:54.288471 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56295549-a869-4cf9-bcf6-e02fa0c27f9e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:54.341246 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-56295549-a869-4cf9-bcf6-e02fa0c27f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ee2dba72704f62a048743b75c346dc', 'request_id': 'req-56295549-a869-4cf9-bcf6-e02fa0c27f9e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:54.347070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-56295549-a869-4cf9-bcf6-e02fa0c27f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ee2dba72704f62a048743b75c346dc', 'request_id': 'req-56295549-a869-4cf9-bcf6-e02fa0c27f9e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:54.355317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-56295549-a869-4cf9-bcf6-e02fa0c27f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ee2dba72704f62a048743b75c346dc', 'request_id': 'req-56295549-a869-4cf9-bcf6-e02fa0c27f9e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:54.366871 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-56295549-a869-4cf9-bcf6-e02fa0c27f9e admin admin] The token cache is being invalidate because project 72ee2dba72704f62a048743b75c346dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:54.367240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-56295549-a869-4cf9-bcf6-e02fa0c27f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:54.367982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-56295549-a869-4cf9-bcf6-e02fa0c27f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:54.369569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1182/2351] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:54 2022] DELETE /identity/v3/projects/72ee2dba72704f62a048743b75c346dc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:54.374745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf54574-ea27-4709-9606-daf5d9d895bc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:54.375626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf54574-ea27-4709-9606-daf5d9d895bc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:54.375903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf54574-ea27-4709-9606-daf5d9d895bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:54.395455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fbf54574-ea27-4709-9606-daf5d9d895bc None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:54.396685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fbf54574-ea27-4709-9606-daf5d9d895bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:54.414735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:54.459230 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1170/2352] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:54.469995 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc2376-37d7-470e-a8b7-09207f993dda None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:54.470283 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc2376-37d7-470e-a8b7-09207f993dda None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:54.470589 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc2376-37d7-470e-a8b7-09207f993dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:54.493214 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-13bc2376-37d7-470e-a8b7-09207f993dda None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:54.494418 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-13bc2376-37d7-470e-a8b7-09207f993dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:54.503181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1183/2353] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:54.507663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf54574-ea27-4709-9606-daf5d9d895bc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:54.518174 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf54574-ea27-4709-9606-daf5d9d895bc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:54.522768 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba70a1-e1a7-4d2e-8a3d-03ccedb91b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:54.523391 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba70a1-e1a7-4d2e-8a3d-03ccedb91b89 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:54.523670 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba70a1-e1a7-4d2e-8a3d-03ccedb91b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:54.523942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba70a1-e1a7-4d2e-8a3d-03ccedb91b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:54.524593 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba70a1-e1a7-4d2e-8a3d-03ccedb91b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:54.524914 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba70a1-e1a7-4d2e-8a3d-03ccedb91b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:54.526509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba70a1-e1a7-4d2e-8a3d-03ccedb91b89 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:54.541471 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1171/2354] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:26:54.548194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc2376-37d7-470e-a8b7-09207f993dda None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:54.559084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc2376-37d7-470e-a8b7-09207f993dda None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:54.564657 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d82b9-bf42-4268-90e9-2332f3b6761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:54.565566 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d82b9-bf42-4268-90e9-2332f3b6761d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:54.566248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d82b9-bf42-4268-90e9-2332f3b6761d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:54.566808 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d82b9-bf42-4268-90e9-2332f3b6761d admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:54.567608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d82b9-bf42-4268-90e9-2332f3b6761d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:54.569719 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d82b9-bf42-4268-90e9-2332f3b6761d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:54.590617 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:54.633719 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1184/2355] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:54 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:54.644769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba70a1-e1a7-4d2e-8a3d-03ccedb91b89 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:54.660380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba70a1-e1a7-4d2e-8a3d-03ccedb91b89 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:54.736284 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29825d6-b495-4a24-bbb2-117949eb1585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:54.737045 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29825d6-b495-4a24-bbb2-117949eb1585 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:54.737324 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29825d6-b495-4a24-bbb2-117949eb1585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:54.737589 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29825d6-b495-4a24-bbb2-117949eb1585 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:54.738272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29825d6-b495-4a24-bbb2-117949eb1585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:54.740475 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29825d6-b495-4a24-bbb2-117949eb1585 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:54.766905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1172/2356] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:54 2022] POST /identity/v3/users => generated 284 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:26:54.770991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d82b9-bf42-4268-90e9-2332f3b6761d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:54.783194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d82b9-bf42-4268-90e9-2332f3b6761d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:54.789639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11936ec-716c-4741-8a9e-e6d19aa04734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:54.790523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11936ec-716c-4741-8a9e-e6d19aa04734 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:54.790812 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11936ec-716c-4741-8a9e-e6d19aa04734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:54.791140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11936ec-716c-4741-8a9e-e6d19aa04734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:54.791806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11936ec-716c-4741-8a9e-e6d19aa04734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:54.794238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11936ec-716c-4741-8a9e-e6d19aa04734 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:54.811911 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1185/2357] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:54.816881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29825d6-b495-4a24-bbb2-117949eb1585 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:54.833205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29825d6-b495-4a24-bbb2-117949eb1585 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:54.860790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0602644-5675-4da9-bfd0-59a99ebb51fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:54.861513 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0602644-5675-4da9-bfd0-59a99ebb51fb admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:54.861959 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0602644-5675-4da9-bfd0-59a99ebb51fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:54.862310 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0602644-5675-4da9-bfd0-59a99ebb51fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:54.863370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0602644-5675-4da9-bfd0-59a99ebb51fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:54.865218 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0602644-5675-4da9-bfd0-59a99ebb51fb admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:54.878013 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1173/2358] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:54.882134 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11936ec-716c-4741-8a9e-e6d19aa04734 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:54.899160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11936ec-716c-4741-8a9e-e6d19aa04734 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:54.910584 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b78700-ef14-49ff-a930-460775fb8fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:54.911515 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b78700-ef14-49ff-a930-460775fb8fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:54.911945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b78700-ef14-49ff-a930-460775fb8fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:54.912376 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b78700-ef14-49ff-a930-460775fb8fe2 admin admin] PATH_INFO: `/v3/projects/b85a720598944fbfbafa18e35d7b0545/users/67b708d5cc294d99a1183717487966a0/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:54.932962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b78700-ef14-49ff-a930-460775fb8fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85a720598944fbfbafa18e35d7b0545, user_id=67b708d5cc294d99a1183717487966a0, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:54.936180 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b78700-ef14-49ff-a930-460775fb8fe2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:54.972328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1186/2359] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:54 2022] PUT /identity/v3/projects/b85a720598944fbfbafa18e35d7b0545/users/67b708d5cc294d99a1183717487966a0/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:26:54.980775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6158c2-a3b0-4745-865f-9269b3f9fd00 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:54.981438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6158c2-a3b0-4745-865f-9269b3f9fd00 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:54.981972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6158c2-a3b0-4745-865f-9269b3f9fd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:55.019202 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fe6158c2-a3b0-4745-865f-9269b3f9fd00 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:55.020667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fe6158c2-a3b0-4745-865f-9269b3f9fd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:55.109975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1174/2360] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:55.118752 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b78700-ef14-49ff-a930-460775fb8fe2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:55.121824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d7b78700-ef14-49ff-a930-460775fb8fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:55.224735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b78700-ef14-49ff-a930-460775fb8fe2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:55.228850 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6fa61-e290-4461-b634-2572d0dc3dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:55.229738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6fa61-e290-4461-b634-2572d0dc3dde service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:55.230206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6fa61-e290-4461-b634-2572d0dc3dde service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:55.230674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6fa61-e290-4461-b634-2572d0dc3dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:55.246925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6fa61-e290-4461-b634-2572d0dc3dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:55.248566 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6fa61-e290-4461-b634-2572d0dc3dde service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:55.267325 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1187/2361] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:56.305773 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6158c2-a3b0-4745-865f-9269b3f9fd00 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:56.308122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fe6158c2-a3b0-4745-865f-9269b3f9fd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:56.326316 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6158c2-a3b0-4745-865f-9269b3f9fd00 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:56.332672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837db332-8655-4fcd-9726-4b9c64abdd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:56.333781 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837db332-8655-4fcd-9726-4b9c64abdd5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:56.334492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837db332-8655-4fcd-9726-4b9c64abdd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:56.335022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837db332-8655-4fcd-9726-4b9c64abdd5c admin admin] PATH_INFO: `/v3/users/637a739d98fc46fc9b3200e48ee640e1` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:56.336401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837db332-8655-4fcd-9726-4b9c64abdd5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=637a739d98fc46fc9b3200e48ee640e1)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:56.340115 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837db332-8655-4fcd-9726-4b9c64abdd5c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:56.372440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:56.422387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-837db332-8655-4fcd-9726-4b9c64abdd5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '637a739d98fc46fc9b3200e48ee640e1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:56.435590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-837db332-8655-4fcd-9726-4b9c64abdd5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '637a739d98fc46fc9b3200e48ee640e1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:56.455824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-837db332-8655-4fcd-9726-4b9c64abdd5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '637a739d98fc46fc9b3200e48ee640e1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:56.474376 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-837db332-8655-4fcd-9726-4b9c64abdd5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '637a739d98fc46fc9b3200e48ee640e1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:56.475191 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-837db332-8655-4fcd-9726-4b9c64abdd5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '637a739d98fc46fc9b3200e48ee640e1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:56.498022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1175/2362] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:56 2022] DELETE /identity/v3/users/637a739d98fc46fc9b3200e48ee640e1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:56.502586 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008b740-76f2-446d-b2c7-7a484b5a5d7a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:56.503080 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008b740-76f2-446d-b2c7-7a484b5a5d7a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:56.503334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008b740-76f2-446d-b2c7-7a484b5a5d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:56.524686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e008b740-76f2-446d-b2c7-7a484b5a5d7a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:56.526015 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e008b740-76f2-446d-b2c7-7a484b5a5d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:56.604838 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1188/2363] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:56.612642 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837db332-8655-4fcd-9726-4b9c64abdd5c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:56.614258 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-837db332-8655-4fcd-9726-4b9c64abdd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:56.706602 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837db332-8655-4fcd-9726-4b9c64abdd5c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:56.710867 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef818f-1da6-47e8-a306-5a232cc97bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:56.711584 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef818f-1da6-47e8-a306-5a232cc97bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:56.711934 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef818f-1da6-47e8-a306-5a232cc97bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:56.712270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef818f-1da6-47e8-a306-5a232cc97bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:56.725496 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef818f-1da6-47e8-a306-5a232cc97bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:56.727097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef818f-1da6-47e8-a306-5a232cc97bc3 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:56.739701 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1176/2364] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:26:57.068935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008b740-76f2-446d-b2c7-7a484b5a5d7a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:57.070707 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e008b740-76f2-446d-b2c7-7a484b5a5d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:57.089579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008b740-76f2-446d-b2c7-7a484b5a5d7a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:57.095411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:57.096128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:57.096574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:57.096972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81 admin admin] PATH_INFO: `/v3/projects/1761b6f2f14e4fdfaf88419e71ec0fa2` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:57.099021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1761b6f2f14e4fdfaf88419e71ec0fa2)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:57.101048 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:57.166365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1761b6f2f14e4fdfaf88419e71ec0fa2', 'request_id': 'req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:57.172776 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:57.177038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1761b6f2f14e4fdfaf88419e71ec0fa2', 'request_id': 'req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:57.193154 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1761b6f2f14e4fdfaf88419e71ec0fa2', 'request_id': 'req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:57.214971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81 admin admin] The token cache is being invalidate because project 1761b6f2f14e4fdfaf88419e71ec0fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:57.215356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:57.217223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:57.221907 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1189/2365] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:57 2022] DELETE /identity/v3/projects/1761b6f2f14e4fdfaf88419e71ec0fa2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:57.223253 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef818f-1da6-47e8-a306-5a232cc97bc3 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:57.235074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef818f-1da6-47e8-a306-5a232cc97bc3 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:57.315843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab8f74-c4b2-4d32-b4b8-5051ebcf918c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:57.317351 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab8f74-c4b2-4d32-b4b8-5051ebcf918c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:57.318479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab8f74-c4b2-4d32-b4b8-5051ebcf918c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:57.318983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab8f74-c4b2-4d32-b4b8-5051ebcf918c admin admin] PATH_INFO: `/v3/users/04a5a97448914a729647a6f274419a3a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:57.321821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab8f74-c4b2-4d32-b4b8-5051ebcf918c admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a5a97448914a729647a6f274419a3a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:57.324506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab8f74-c4b2-4d32-b4b8-5051ebcf918c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:57.445802 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:57.448451 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a9ab8f74-c4b2-4d32-b4b8-5051ebcf918c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a5a97448914a729647a6f274419a3a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:57.460732 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a9ab8f74-c4b2-4d32-b4b8-5051ebcf918c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a5a97448914a729647a6f274419a3a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:57.484257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a9ab8f74-c4b2-4d32-b4b8-5051ebcf918c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a5a97448914a729647a6f274419a3a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:57.502708 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a9ab8f74-c4b2-4d32-b4b8-5051ebcf918c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a5a97448914a729647a6f274419a3a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:57.504627 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a9ab8f74-c4b2-4d32-b4b8-5051ebcf918c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a5a97448914a729647a6f274419a3a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:57.524932 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1177/2366] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:26:57 2022] DELETE /identity/v3/users/04a5a97448914a729647a6f274419a3a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:58.420887 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:58.422409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:58.444904 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692f6f1-ddb0-4336-bd36-48be8d1b4e81 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:58.549067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b21a9-99cc-4aff-a474-1a8a59d842dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:58.549794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b21a9-99cc-4aff-a474-1a8a59d842dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:58.550132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b21a9-99cc-4aff-a474-1a8a59d842dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:58.550477 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b21a9-99cc-4aff-a474-1a8a59d842dd admin admin] PATH_INFO: `/v3/projects/67ab1253ebc5472097ada0cec4b684d1` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:58.551855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b21a9-99cc-4aff-a474-1a8a59d842dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ab1253ebc5472097ada0cec4b684d1)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:58.553949 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b21a9-99cc-4aff-a474-1a8a59d842dd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:58.632103 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-238b21a9-99cc-4aff-a474-1a8a59d842dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ab1253ebc5472097ada0cec4b684d1', 'request_id': 'req-238b21a9-99cc-4aff-a474-1a8a59d842dd'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:58.641569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-238b21a9-99cc-4aff-a474-1a8a59d842dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ab1253ebc5472097ada0cec4b684d1', 'request_id': 'req-238b21a9-99cc-4aff-a474-1a8a59d842dd'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:58.660789 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-238b21a9-99cc-4aff-a474-1a8a59d842dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ab1253ebc5472097ada0cec4b684d1', 'request_id': 'req-238b21a9-99cc-4aff-a474-1a8a59d842dd'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:58.682757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-238b21a9-99cc-4aff-a474-1a8a59d842dd admin admin] The token cache is being invalidate because project 67ab1253ebc5472097ada0cec4b684d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:26:58.683555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-238b21a9-99cc-4aff-a474-1a8a59d842dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:58.684529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-238b21a9-99cc-4aff-a474-1a8a59d842dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:26:58.686423 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1190/2367] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:26:58 2022] DELETE /identity/v3/projects/67ab1253ebc5472097ada0cec4b684d1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:58.691286 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f876c-3ecf-456c-898d-2dbef2533ced None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:58.691767 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f876c-3ecf-456c-898d-2dbef2533ced None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:58.691869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f876c-3ecf-456c-898d-2dbef2533ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:58.751850 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-575f876c-3ecf-456c-898d-2dbef2533ced None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:58.753857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-575f876c-3ecf-456c-898d-2dbef2533ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:58.851709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1178/2368] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:58.859497 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f7fb1-2371-49b1-a4c5-eba04bb18cf7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:58.863220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f7fb1-2371-49b1-a4c5-eba04bb18cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:58.863220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f7fb1-2371-49b1-a4c5-eba04bb18cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:58.896807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-375f7fb1-2371-49b1-a4c5-eba04bb18cf7 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:58.898150 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-375f7fb1-2371-49b1-a4c5-eba04bb18cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:58.911487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1191/2369] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:26:58.916071 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f876c-3ecf-456c-898d-2dbef2533ced None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:58.932483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f876c-3ecf-456c-898d-2dbef2533ced None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:58.942026 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327f4da-0d93-438a-8120-e0d653b76c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:58.942767 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327f4da-0d93-438a-8120-e0d653b76c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:58.943146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327f4da-0d93-438a-8120-e0d653b76c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:58.943569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327f4da-0d93-438a-8120-e0d653b76c5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:58.944621 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327f4da-0d93-438a-8120-e0d653b76c5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:26:58.945346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327f4da-0d93-438a-8120-e0d653b76c5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:58.949548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327f4da-0d93-438a-8120-e0d653b76c5d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:58.973356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1179/2370] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:26:58.976067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f7fb1-2371-49b1-a4c5-eba04bb18cf7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:58.991891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f7fb1-2371-49b1-a4c5-eba04bb18cf7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:59.014673 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a2399-a8cc-4aca-a901-69443f094aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:59.015498 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a2399-a8cc-4aca-a901-69443f094aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:59.015803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a2399-a8cc-4aca-a901-69443f094aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:59.016176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a2399-a8cc-4aca-a901-69443f094aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:59.017919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a2399-a8cc-4aca-a901-69443f094aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:59.019777 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a2399-a8cc-4aca-a901-69443f094aa9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:59.078916 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1192/2371] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:26:58 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:59.084245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327f4da-0d93-438a-8120-e0d653b76c5d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:59.095446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327f4da-0d93-438a-8120-e0d653b76c5d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:59.165656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc887e-f858-4835-a09c-a8210efb4259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:59.166247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc887e-f858-4835-a09c-a8210efb4259 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:59.166526 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc887e-f858-4835-a09c-a8210efb4259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:59.166799 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc887e-f858-4835-a09c-a8210efb4259 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:59.167452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc887e-f858-4835-a09c-a8210efb4259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:59.169415 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc887e-f858-4835-a09c-a8210efb4259 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:59.196965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1180/2372] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:26:59 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:26:59.203386 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a2399-a8cc-4aca-a901-69443f094aa9 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:59.218029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a2399-a8cc-4aca-a901-69443f094aa9 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:59.222657 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e028242-4bfb-465c-bdad-8118be766db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:59.223256 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e028242-4bfb-465c-bdad-8118be766db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:59.223530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e028242-4bfb-465c-bdad-8118be766db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:59.223796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e028242-4bfb-465c-bdad-8118be766db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:59.224437 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e028242-4bfb-465c-bdad-8118be766db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:59.226086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e028242-4bfb-465c-bdad-8118be766db6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:59.236636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1193/2373] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:26:59.240527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc887e-f858-4835-a09c-a8210efb4259 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:59.251212 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc887e-f858-4835-a09c-a8210efb4259 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:59.255888 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70254a42-7d59-4073-a24e-9cd22f1a18ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:59.256490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70254a42-7d59-4073-a24e-9cd22f1a18ee admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:59.256798 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70254a42-7d59-4073-a24e-9cd22f1a18ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:59.257069 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70254a42-7d59-4073-a24e-9cd22f1a18ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:59.257712 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70254a42-7d59-4073-a24e-9cd22f1a18ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:59.259306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70254a42-7d59-4073-a24e-9cd22f1a18ee admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:59.271945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1181/2374] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:26:59.276043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e028242-4bfb-465c-bdad-8118be766db6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:59.286386 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e028242-4bfb-465c-bdad-8118be766db6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:59.291404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04172d18-1ab5-402e-a7ee-20baf4223559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:59.292725 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04172d18-1ab5-402e-a7ee-20baf4223559 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:59.293004 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04172d18-1ab5-402e-a7ee-20baf4223559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:59.293274 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04172d18-1ab5-402e-a7ee-20baf4223559 admin admin] PATH_INFO: `/v3/projects/8222169642354e599347b7ecd20e8d39/users/a5844ae5d49544f28fd496b7952f82f6/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:59.308448 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04172d18-1ab5-402e-a7ee-20baf4223559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8222169642354e599347b7ecd20e8d39, user_id=a5844ae5d49544f28fd496b7952f82f6, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:59.311148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04172d18-1ab5-402e-a7ee-20baf4223559 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:59.327735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1194/2375] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:26:59 2022] PUT /identity/v3/projects/8222169642354e599347b7ecd20e8d39/users/a5844ae5d49544f28fd496b7952f82f6/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:26:59.338152 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b7854-6cf9-4190-87d4-c5b33f36a64f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:59.338430 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b7854-6cf9-4190-87d4-c5b33f36a64f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:59.338692 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b7854-6cf9-4190-87d4-c5b33f36a64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:59.367642 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-671b7854-6cf9-4190-87d4-c5b33f36a64f None None] MFA Rules not processed for user `a5844ae5d49544f28fd496b7952f82f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:26:59.369536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-671b7854-6cf9-4190-87d4-c5b33f36a64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:59.387955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:59.461311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1182/2376] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:26:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:26:59.473093 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04172d18-1ab5-402e-a7ee-20baf4223559 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:26:59.475446 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-04172d18-1ab5-402e-a7ee-20baf4223559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:26:59.488478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:59.540182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04172d18-1ab5-402e-a7ee-20baf4223559 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:26:59.544918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35077917-bb08-4f90-937a-cb61aa552598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:26:59.545526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35077917-bb08-4f90-937a-cb61aa552598 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:26:59.545802 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35077917-bb08-4f90-937a-cb61aa552598 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:26:59.546071 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35077917-bb08-4f90-937a-cb61aa552598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:26:59.554989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35077917-bb08-4f90-937a-cb61aa552598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:26:59.556415 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35077917-bb08-4f90-937a-cb61aa552598 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:26:59.567769 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1195/2377] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:26:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:27:01.268564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b7854-6cf9-4190-87d4-c5b33f36a64f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:01.273063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-671b7854-6cf9-4190-87d4-c5b33f36a64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:01.411915 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b7854-6cf9-4190-87d4-c5b33f36a64f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:01.429834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40e77e-bb00-4739-b40e-57abe03616ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:01.430842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40e77e-bb00-4739-b40e-57abe03616ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:01.432117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40e77e-bb00-4739-b40e-57abe03616ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:01.433306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40e77e-bb00-4739-b40e-57abe03616ba admin admin] PATH_INFO: `/v3/users/ddde994edc874eb29f8ceea4a40b75e0` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:01.435080 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40e77e-bb00-4739-b40e-57abe03616ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddde994edc874eb29f8ceea4a40b75e0)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:01.437981 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40e77e-bb00-4739-b40e-57abe03616ba admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:01.523633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c40e77e-bb00-4739-b40e-57abe03616ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddde994edc874eb29f8ceea4a40b75e0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:01.535422 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c40e77e-bb00-4739-b40e-57abe03616ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddde994edc874eb29f8ceea4a40b75e0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:01.558767 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c40e77e-bb00-4739-b40e-57abe03616ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddde994edc874eb29f8ceea4a40b75e0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:01.575012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c40e77e-bb00-4739-b40e-57abe03616ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddde994edc874eb29f8ceea4a40b75e0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:01.576649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c40e77e-bb00-4739-b40e-57abe03616ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddde994edc874eb29f8ceea4a40b75e0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:01.585720 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1183/2378] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:27:01 2022] DELETE /identity/v3/users/ddde994edc874eb29f8ceea4a40b75e0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:27:01.589938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469d7cb-fc3d-4715-a07e-8e5da4c926ee None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:01.590926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469d7cb-fc3d-4715-a07e-8e5da4c926ee None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:01.591356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469d7cb-fc3d-4715-a07e-8e5da4c926ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:01.627001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6469d7cb-fc3d-4715-a07e-8e5da4c926ee None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:01.629021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6469d7cb-fc3d-4715-a07e-8e5da4c926ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:01.774448 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1196/2379] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:01.782618 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40e77e-bb00-4739-b40e-57abe03616ba admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:01.784605 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2c40e77e-bb00-4739-b40e-57abe03616ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:01.837558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f11cc-85af-42e5-bea6-7fdce6088afd None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:01.837850 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f11cc-85af-42e5-bea6-7fdce6088afd None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:01.838138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f11cc-85af-42e5-bea6-7fdce6088afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:01.874564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:01.891281 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d81f11cc-85af-42e5-bea6-7fdce6088afd None None] MFA Rules not processed for user `67b708d5cc294d99a1183717487966a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:01.892525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d81f11cc-85af-42e5-bea6-7fdce6088afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:01.908248 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40e77e-bb00-4739-b40e-57abe03616ba admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:01.913372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb3cb5-7fc2-4cba-bd7a-c36c58327a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:01.914271 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb3cb5-7fc2-4cba-bd7a-c36c58327a35 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:01.914559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb3cb5-7fc2-4cba-bd7a-c36c58327a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:01.914872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb3cb5-7fc2-4cba-bd7a-c36c58327a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:01.943580 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb3cb5-7fc2-4cba-bd7a-c36c58327a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:01.945666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb3cb5-7fc2-4cba-bd7a-c36c58327a35 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:01.963531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1184/2380] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:27:02.020319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1197/2381] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:02.025237 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb3cb5-7fc2-4cba-bd7a-c36c58327a35 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:02.026736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b2eb3cb5-7fc2-4cba-bd7a-c36c58327a35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:02.042358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb3cb5-7fc2-4cba-bd7a-c36c58327a35 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:02.049195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3273-f08c-4bf3-815c-241b554cfed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:02.049841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3273-f08c-4bf3-815c-241b554cfed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:02.050119 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3273-f08c-4bf3-815c-241b554cfed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:02.050387 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3273-f08c-4bf3-815c-241b554cfed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:02.051018 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f3273-f08c-4bf3-815c-241b554cfed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:02.053087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f3273-f08c-4bf3-815c-241b554cfed5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:02.098112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1185/2382] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:27:02 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:27:02.099144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f11cc-85af-42e5-bea6-7fdce6088afd None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:02.112314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f11cc-85af-42e5-bea6-7fdce6088afd None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:02.172220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:02.193334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10908e9-2213-45ad-a7b4-44b574ceec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:02.194366 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10908e9-2213-45ad-a7b4-44b574ceec0e admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:02.194648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10908e9-2213-45ad-a7b4-44b574ceec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:02.194918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10908e9-2213-45ad-a7b4-44b574ceec0e admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:02.195637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10908e9-2213-45ad-a7b4-44b574ceec0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:02.197500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10908e9-2213-45ad-a7b4-44b574ceec0e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:02.227939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3273-f08c-4bf3-815c-241b554cfed5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:02.229943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1198/2383] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:27:02 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:27:02.238743 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3273-f08c-4bf3-815c-241b554cfed5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:02.244493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537f9d6-af8f-46f9-81f3-82666af90b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:02.245666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537f9d6-af8f-46f9-81f3-82666af90b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:02.245943 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537f9d6-af8f-46f9-81f3-82666af90b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:02.246215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537f9d6-af8f-46f9-81f3-82666af90b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:02.247159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537f9d6-af8f-46f9-81f3-82666af90b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:02.248884 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537f9d6-af8f-46f9-81f3-82666af90b58 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:02.267929 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10908e9-2213-45ad-a7b4-44b574ceec0e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:02.273204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1186/2384] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:27:02.279556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10908e9-2213-45ad-a7b4-44b574ceec0e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:02.285093 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf94ae5-0c24-41e3-bb2f-b1cd55d819fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:02.285747 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf94ae5-0c24-41e3-bb2f-b1cd55d819fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:02.286019 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf94ae5-0c24-41e3-bb2f-b1cd55d819fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:02.286361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf94ae5-0c24-41e3-bb2f-b1cd55d819fc admin admin] PATH_INFO: `/v3/projects/c70d4e282e2a46cdb0adf1c5afa44877/users/68e3ade64abc425f8cbdac88f5177e0d/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:02.303808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537f9d6-af8f-46f9-81f3-82666af90b58 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:02.306579 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0537f9d6-af8f-46f9-81f3-82666af90b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:02.315930 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf94ae5-0c24-41e3-bb2f-b1cd55d819fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70d4e282e2a46cdb0adf1c5afa44877, user_id=68e3ade64abc425f8cbdac88f5177e0d, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:02.319427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf94ae5-0c24-41e3-bb2f-b1cd55d819fc admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:02.326022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537f9d6-af8f-46f9-81f3-82666af90b58 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:02.334551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:02.335305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:02.335657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:02.336245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb admin admin] PATH_INFO: `/v3/projects/dbd9625a4af44dc491ff983cfd51b22f` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:02.338458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd9625a4af44dc491ff983cfd51b22f)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:02.339689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1199/2385] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:27:02 2022] PUT /identity/v3/projects/c70d4e282e2a46cdb0adf1c5afa44877/users/68e3ade64abc425f8cbdac88f5177e0d/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:27:02.340872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf94ae5-0c24-41e3-bb2f-b1cd55d819fc admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:02.341011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:02.417808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd9625a4af44dc491ff983cfd51b22f', 'request_id': 'req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:02.427356 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd9625a4af44dc491ff983cfd51b22f', 'request_id': 'req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:02.435984 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd9625a4af44dc491ff983cfd51b22f', 'request_id': 'req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:02.438283 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf94ae5-0c24-41e3-bb2f-b1cd55d819fc admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:02.451308 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb admin admin] The token cache is being invalidate because project dbd9625a4af44dc491ff983cfd51b22f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:27:02.451898 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:02.453160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:02.472624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1187/2386] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:27:02 2022] DELETE /identity/v3/projects/dbd9625a4af44dc491ff983cfd51b22f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:27:02.517350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a7629-4bac-44a8-a468-4ba7894cbc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:02.518246 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a7629-4bac-44a8-a468-4ba7894cbc1d admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:02.518872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a7629-4bac-44a8-a468-4ba7894cbc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:02.519252 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a7629-4bac-44a8-a468-4ba7894cbc1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:02.520074 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a7629-4bac-44a8-a468-4ba7894cbc1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:02.522362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a7629-4bac-44a8-a468-4ba7894cbc1d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:02.537727 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1200/2387] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:27:02.542027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:02.543909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:02.565688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0229a-74ff-43d5-9b66-50ef8a7ecdfb admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:02.571154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c183e-e869-48b1-8b18-0abc0ed334c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:02.571982 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c183e-e869-48b1-8b18-0abc0ed334c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:02.572278 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c183e-e869-48b1-8b18-0abc0ed334c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:02.572558 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c183e-e869-48b1-8b18-0abc0ed334c8 admin admin] PATH_INFO: `/v3/projects/c70d4e282e2a46cdb0adf1c5afa44877/users/68e3ade64abc425f8cbdac88f5177e0d/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:02.575302 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c183e-e869-48b1-8b18-0abc0ed334c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70d4e282e2a46cdb0adf1c5afa44877, user_id=68e3ade64abc425f8cbdac88f5177e0d, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:02.578188 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c183e-e869-48b1-8b18-0abc0ed334c8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:02.604525 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1188/2388] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:27:02 2022] PUT /identity/v3/projects/c70d4e282e2a46cdb0adf1c5afa44877/users/68e3ade64abc425f8cbdac88f5177e0d/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:27:05.716020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a7629-4bac-44a8-a468-4ba7894cbc1d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:05.717897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ef7a7629-4bac-44a8-a468-4ba7894cbc1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:05.742720 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a7629-4bac-44a8-a468-4ba7894cbc1d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:05.818500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:05.836618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593c250-42a1-43c8-89ab-e9f7eef97ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:05.837345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593c250-42a1-43c8-89ab-e9f7eef97ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:05.837934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593c250-42a1-43c8-89ab-e9f7eef97ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:05.838314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593c250-42a1-43c8-89ab-e9f7eef97ad1 admin admin] PATH_INFO: `/v3/users/a5844ae5d49544f28fd496b7952f82f6` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:05.841293 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593c250-42a1-43c8-89ab-e9f7eef97ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5844ae5d49544f28fd496b7952f82f6)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:05.843489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593c250-42a1-43c8-89ab-e9f7eef97ad1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:05.936690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d593c250-42a1-43c8-89ab-e9f7eef97ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5844ae5d49544f28fd496b7952f82f6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:05.952690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d593c250-42a1-43c8-89ab-e9f7eef97ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5844ae5d49544f28fd496b7952f82f6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:05.965749 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d593c250-42a1-43c8-89ab-e9f7eef97ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5844ae5d49544f28fd496b7952f82f6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:05.980643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d593c250-42a1-43c8-89ab-e9f7eef97ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5844ae5d49544f28fd496b7952f82f6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:05.981644 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d593c250-42a1-43c8-89ab-e9f7eef97ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5844ae5d49544f28fd496b7952f82f6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:05.989658 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1201/2389] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:27:05 2022] DELETE /identity/v3/users/a5844ae5d49544f28fd496b7952f82f6 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:27:05.995816 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eda90-6c44-4364-8377-1a85ad1f33bc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:05.996331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eda90-6c44-4364-8377-1a85ad1f33bc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:05.997159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eda90-6c44-4364-8377-1a85ad1f33bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:06.050798 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-661eda90-6c44-4364-8377-1a85ad1f33bc None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:06.057488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-661eda90-6c44-4364-8377-1a85ad1f33bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:06.205540 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1189/2390] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:06.261936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593c250-42a1-43c8-89ab-e9f7eef97ad1 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:06.263488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d593c250-42a1-43c8-89ab-e9f7eef97ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:06.357616 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593c250-42a1-43c8-89ab-e9f7eef97ad1 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:06.367429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf38d65-f8e0-4151-a333-89d222458b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:06.368363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf38d65-f8e0-4151-a333-89d222458b63 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:06.368847 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf38d65-f8e0-4151-a333-89d222458b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:06.369280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf38d65-f8e0-4151-a333-89d222458b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:06.380102 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf38d65-f8e0-4151-a333-89d222458b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:06.381685 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf38d65-f8e0-4151-a333-89d222458b63 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:06.394243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1202/2391] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:27:07.273377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661eda90-6c44-4364-8377-1a85ad1f33bc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:07.275443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-661eda90-6c44-4364-8377-1a85ad1f33bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:07.294255 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661eda90-6c44-4364-8377-1a85ad1f33bc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:07.309727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837f625-1ab6-4ffb-99b1-8b03a2fe38a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:07.310375 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837f625-1ab6-4ffb-99b1-8b03a2fe38a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:07.310655 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837f625-1ab6-4ffb-99b1-8b03a2fe38a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:07.310997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837f625-1ab6-4ffb-99b1-8b03a2fe38a8 admin admin] PATH_INFO: `/v3/projects/8222169642354e599347b7ecd20e8d39` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:07.312054 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837f625-1ab6-4ffb-99b1-8b03a2fe38a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8222169642354e599347b7ecd20e8d39)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:07.313985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837f625-1ab6-4ffb-99b1-8b03a2fe38a8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:07.353319 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:07.437397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f837f625-1ab6-4ffb-99b1-8b03a2fe38a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8222169642354e599347b7ecd20e8d39', 'request_id': 'req-f837f625-1ab6-4ffb-99b1-8b03a2fe38a8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:07.453268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f837f625-1ab6-4ffb-99b1-8b03a2fe38a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8222169642354e599347b7ecd20e8d39', 'request_id': 'req-f837f625-1ab6-4ffb-99b1-8b03a2fe38a8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:07.465777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f837f625-1ab6-4ffb-99b1-8b03a2fe38a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8222169642354e599347b7ecd20e8d39', 'request_id': 'req-f837f625-1ab6-4ffb-99b1-8b03a2fe38a8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:07.499195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f837f625-1ab6-4ffb-99b1-8b03a2fe38a8 admin admin] The token cache is being invalidate because project 8222169642354e599347b7ecd20e8d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:27:07.499598 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f837f625-1ab6-4ffb-99b1-8b03a2fe38a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:07.500367 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f837f625-1ab6-4ffb-99b1-8b03a2fe38a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:07.502707 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1190/2392] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:27:07 2022] DELETE /identity/v3/projects/8222169642354e599347b7ecd20e8d39 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:27:07.507499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e2f97-fdc5-4e66-86e3-fdb0cfadac62 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:07.507997 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e2f97-fdc5-4e66-86e3-fdb0cfadac62 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:07.508362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e2f97-fdc5-4e66-86e3-fdb0cfadac62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:07.539824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-322e2f97-fdc5-4e66-86e3-fdb0cfadac62 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:07.541222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-322e2f97-fdc5-4e66-86e3-fdb0cfadac62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:07.617107 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1203/2393] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:07.627396 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4d78-4e35-4c47-97aa-7648602b1cbd None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:07.628690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4d78-4e35-4c47-97aa-7648602b1cbd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:07.629020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4d78-4e35-4c47-97aa-7648602b1cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:07.681162 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-454c4d78-4e35-4c47-97aa-7648602b1cbd None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:07.690217 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-454c4d78-4e35-4c47-97aa-7648602b1cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:07.720824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1191/2394] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:07.725137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e2f97-fdc5-4e66-86e3-fdb0cfadac62 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:07.736106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e2f97-fdc5-4e66-86e3-fdb0cfadac62 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:07.748275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871679c-74e9-4e57-9bee-eedc091bba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:07.750246 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871679c-74e9-4e57-9bee-eedc091bba92 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:07.751315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871679c-74e9-4e57-9bee-eedc091bba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:07.751781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871679c-74e9-4e57-9bee-eedc091bba92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:07.752461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871679c-74e9-4e57-9bee-eedc091bba92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:27:07.752814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871679c-74e9-4e57-9bee-eedc091bba92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:07.754422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871679c-74e9-4e57-9bee-eedc091bba92 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:07.768953 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:07.780121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1204/2395] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:27:07.780516 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c4d78-4e35-4c47-97aa-7648602b1cbd None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:07.790822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c4d78-4e35-4c47-97aa-7648602b1cbd None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:07.797785 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023fa73-0ec0-4f1f-8548-731881ab2f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:07.798399 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023fa73-0ec0-4f1f-8548-731881ab2f72 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:07.799085 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023fa73-0ec0-4f1f-8548-731881ab2f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:07.799085 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023fa73-0ec0-4f1f-8548-731881ab2f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:07.799570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023fa73-0ec0-4f1f-8548-731881ab2f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:07.801664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023fa73-0ec0-4f1f-8548-731881ab2f72 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:07.835296 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1192/2396] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:27:07 2022] POST /identity/v3/projects => generated 359 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:27:07.839518 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871679c-74e9-4e57-9bee-eedc091bba92 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:07.851513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871679c-74e9-4e57-9bee-eedc091bba92 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:07.922182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d4676-b42c-4bfb-b140-62d4e13f1557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:07.923035 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d4676-b42c-4bfb-b140-62d4e13f1557 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:07.923161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d4676-b42c-4bfb-b140-62d4e13f1557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:07.923328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d4676-b42c-4bfb-b140-62d4e13f1557 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:07.924007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d4676-b42c-4bfb-b140-62d4e13f1557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:07.926041 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d4676-b42c-4bfb-b140-62d4e13f1557 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:07.960432 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1205/2397] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:27:07 2022] POST /identity/v3/users => generated 280 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:27:07.965160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023fa73-0ec0-4f1f-8548-731881ab2f72 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:07.978826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023fa73-0ec0-4f1f-8548-731881ab2f72 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:07.984850 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b819f-2a29-4188-8525-fd64a304708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:07.987007 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b819f-2a29-4188-8525-fd64a304708e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:07.987500 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b819f-2a29-4188-8525-fd64a304708e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:07.987983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b819f-2a29-4188-8525-fd64a304708e admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:07.989938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b819f-2a29-4188-8525-fd64a304708e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:07.997023 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b819f-2a29-4188-8525-fd64a304708e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:08.024896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1193/2398] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:27:08.025353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d4676-b42c-4bfb-b140-62d4e13f1557 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:08.036619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d4676-b42c-4bfb-b140-62d4e13f1557 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:08.048704 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0ba8a-63f9-4482-be24-0dce4a8a0a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:08.052818 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0ba8a-63f9-4482-be24-0dce4a8a0a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:08.055040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0ba8a-63f9-4482-be24-0dce4a8a0a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:08.055603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0ba8a-63f9-4482-be24-0dce4a8a0a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:08.056668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0ba8a-63f9-4482-be24-0dce4a8a0a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:08.058788 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0ba8a-63f9-4482-be24-0dce4a8a0a86 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:08.076393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1206/2399] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:27:08.080540 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b819f-2a29-4188-8525-fd64a304708e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:08.092096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b819f-2a29-4188-8525-fd64a304708e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:08.099475 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cead0-2c9f-4cf3-98d3-646d4d045286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:08.100262 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cead0-2c9f-4cf3-98d3-646d4d045286 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:08.100673 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cead0-2c9f-4cf3-98d3-646d4d045286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:08.101043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cead0-2c9f-4cf3-98d3-646d4d045286 admin admin] PATH_INFO: `/v3/projects/228c1a622a844499ae11590efbb71068/users/698a4765c1b1451bba955b03ceacb93d/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:08.126443 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cead0-2c9f-4cf3-98d3-646d4d045286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=228c1a622a844499ae11590efbb71068, user_id=698a4765c1b1451bba955b03ceacb93d, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:08.129909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cead0-2c9f-4cf3-98d3-646d4d045286 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:08.150457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1194/2400] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:27:08 2022] PUT /identity/v3/projects/228c1a622a844499ae11590efbb71068/users/698a4765c1b1451bba955b03ceacb93d/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:27:08.161897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee411c-e432-49af-ad39-a9bdcecaba2b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:08.162449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee411c-e432-49af-ad39-a9bdcecaba2b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:08.162887 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee411c-e432-49af-ad39-a9bdcecaba2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:08.209848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-deee411c-e432-49af-ad39-a9bdcecaba2b None None] MFA Rules not processed for user `698a4765c1b1451bba955b03ceacb93d`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:08.212617 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-deee411c-e432-49af-ad39-a9bdcecaba2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:08.324080 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1207/2401] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:27:08.366056 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cead0-2c9f-4cf3-98d3-646d4d045286 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:08.367832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-517cead0-2c9f-4cf3-98d3-646d4d045286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:08.449592 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cead0-2c9f-4cf3-98d3-646d4d045286 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:08.452960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2204c-197b-4a60-af6d-1b78fdc8b68c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:08.453710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2204c-197b-4a60-af6d-1b78fdc8b68c service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:08.454060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2204c-197b-4a60-af6d-1b78fdc8b68c service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:08.454584 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2204c-197b-4a60-af6d-1b78fdc8b68c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:08.466583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2204c-197b-4a60-af6d-1b78fdc8b68c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:08.472814 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2204c-197b-4a60-af6d-1b78fdc8b68c service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:08.485029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1195/2402] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:27:08 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:27:08.497857 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee411c-e432-49af-ad39-a9bdcecaba2b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:08.603587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee411c-e432-49af-ad39-a9bdcecaba2b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:08.608751 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba103f-b897-4e77-9346-59f7315de74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:08.609945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba103f-b897-4e77-9346-59f7315de74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:08.609945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba103f-b897-4e77-9346-59f7315de74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:08.610189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba103f-b897-4e77-9346-59f7315de74e admin admin] PATH_INFO: `/v3/users/698a4765c1b1451bba955b03ceacb93d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:08.611986 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba103f-b897-4e77-9346-59f7315de74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=698a4765c1b1451bba955b03ceacb93d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:08.614718 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba103f-b897-4e77-9346-59f7315de74e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:08.627963 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:08.685279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-36ba103f-b897-4e77-9346-59f7315de74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '698a4765c1b1451bba955b03ceacb93d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:08.695545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-36ba103f-b897-4e77-9346-59f7315de74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '698a4765c1b1451bba955b03ceacb93d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:08.709469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-36ba103f-b897-4e77-9346-59f7315de74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '698a4765c1b1451bba955b03ceacb93d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:08.719875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-36ba103f-b897-4e77-9346-59f7315de74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '698a4765c1b1451bba955b03ceacb93d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:08.720751 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-36ba103f-b897-4e77-9346-59f7315de74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '698a4765c1b1451bba955b03ceacb93d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:08.729941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1208/2403] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:27:08 2022] DELETE /identity/v3/users/698a4765c1b1451bba955b03ceacb93d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:27:08.734646 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940bf04-ab02-44b4-b50a-588ab5bb7980 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:08.734991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940bf04-ab02-44b4-b50a-588ab5bb7980 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:08.735402 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940bf04-ab02-44b4-b50a-588ab5bb7980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:08.762633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9940bf04-ab02-44b4-b50a-588ab5bb7980 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:08.765419 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9940bf04-ab02-44b4-b50a-588ab5bb7980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:08.820997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:08.860147 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1196/2404] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:08.872773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba103f-b897-4e77-9346-59f7315de74e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:08.874319 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-36ba103f-b897-4e77-9346-59f7315de74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:08.951744 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba103f-b897-4e77-9346-59f7315de74e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:08.960206 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a122e-787b-4f6f-a2e0-53c2d0b81898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:08.961185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a122e-787b-4f6f-a2e0-53c2d0b81898 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:08.961547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a122e-787b-4f6f-a2e0-53c2d0b81898 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:08.962236 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a122e-787b-4f6f-a2e0-53c2d0b81898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:08.983708 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a122e-787b-4f6f-a2e0-53c2d0b81898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:08.986343 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a122e-787b-4f6f-a2e0-53c2d0b81898 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:09.003750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1209/2405] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:27:09.415486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542c4ad-6c11-4391-bab9-20deb0f26696 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:09.417270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542c4ad-6c11-4391-bab9-20deb0f26696 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:09.417730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542c4ad-6c11-4391-bab9-20deb0f26696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:09.467698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a542c4ad-6c11-4391-bab9-20deb0f26696 None None] MFA Rules not processed for user `68e3ade64abc425f8cbdac88f5177e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:09.469226 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a542c4ad-6c11-4391-bab9-20deb0f26696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:09.613863 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1197/2406] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:09.626940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a122e-787b-4f6f-a2e0-53c2d0b81898 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:09.628402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-658a122e-787b-4f6f-a2e0-53c2d0b81898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:09.725609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a122e-787b-4f6f-a2e0-53c2d0b81898 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:09.733754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bb764-571f-41b9-8f0d-f6582b739bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:09.734413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bb764-571f-41b9-8f0d-f6582b739bc1 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:09.734695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bb764-571f-41b9-8f0d-f6582b739bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:09.735496 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bb764-571f-41b9-8f0d-f6582b739bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:09.737373 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-832bb764-571f-41b9-8f0d-f6582b739bc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:09.785977 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:09.842778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bb764-571f-41b9-8f0d-f6582b739bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:09.844728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bb764-571f-41b9-8f0d-f6582b739bc1 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:09.856658 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1210/2407] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:27:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:27:09.888203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542c4ad-6c11-4391-bab9-20deb0f26696 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:09.889741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a542c4ad-6c11-4391-bab9-20deb0f26696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:09.905124 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542c4ad-6c11-4391-bab9-20deb0f26696 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:09.911409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4207e8-f56c-43f2-aff4-3253701a0617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:09.911409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4207e8-f56c-43f2-aff4-3253701a0617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:09.911748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4207e8-f56c-43f2-aff4-3253701a0617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:09.912122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4207e8-f56c-43f2-aff4-3253701a0617 admin admin] PATH_INFO: `/v3/projects/228c1a622a844499ae11590efbb71068` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:09.913592 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4207e8-f56c-43f2-aff4-3253701a0617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=228c1a622a844499ae11590efbb71068)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:09.916089 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4207e8-f56c-43f2-aff4-3253701a0617 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:09.991676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab4207e8-f56c-43f2-aff4-3253701a0617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228c1a622a844499ae11590efbb71068', 'request_id': 'req-ab4207e8-f56c-43f2-aff4-3253701a0617'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:10.002962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab4207e8-f56c-43f2-aff4-3253701a0617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228c1a622a844499ae11590efbb71068', 'request_id': 'req-ab4207e8-f56c-43f2-aff4-3253701a0617'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:10.010685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab4207e8-f56c-43f2-aff4-3253701a0617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228c1a622a844499ae11590efbb71068', 'request_id': 'req-ab4207e8-f56c-43f2-aff4-3253701a0617'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:10.023180 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab4207e8-f56c-43f2-aff4-3253701a0617 admin admin] The token cache is being invalidate because project 228c1a622a844499ae11590efbb71068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:27:10.023508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab4207e8-f56c-43f2-aff4-3253701a0617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:10.024117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab4207e8-f56c-43f2-aff4-3253701a0617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:10.025630 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1198/2408] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:27:09 2022] DELETE /identity/v3/projects/228c1a622a844499ae11590efbb71068 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:27:10.031615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949eb0c-8af9-49d0-806a-1f2763c9e5de None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:10.031901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949eb0c-8af9-49d0-806a-1f2763c9e5de None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:10.032172 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949eb0c-8af9-49d0-806a-1f2763c9e5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:10.058219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8949eb0c-8af9-49d0-806a-1f2763c9e5de None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:10.059436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8949eb0c-8af9-49d0-806a-1f2763c9e5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:10.177629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1211/2409] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:10.179966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a36f6-6452-4d30-b0cd-a5a485922537 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:10.181146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a36f6-6452-4d30-b0cd-a5a485922537 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:10.181672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a36f6-6452-4d30-b0cd-a5a485922537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:10.210955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-200a36f6-6452-4d30-b0cd-a5a485922537 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:10.213039 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-200a36f6-6452-4d30-b0cd-a5a485922537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:10.235466 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1199/2410] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:27:10.240652 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949eb0c-8af9-49d0-806a-1f2763c9e5de None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:10.252170 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949eb0c-8af9-49d0-806a-1f2763c9e5de None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:10.261305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b8ae7-5414-42ac-8abf-a7fb2822ad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:10.261926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b8ae7-5414-42ac-8abf-a7fb2822ad01 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:10.262204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b8ae7-5414-42ac-8abf-a7fb2822ad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:10.262475 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b8ae7-5414-42ac-8abf-a7fb2822ad01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:10.263135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b8ae7-5414-42ac-8abf-a7fb2822ad01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:27:10.263439 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b8ae7-5414-42ac-8abf-a7fb2822ad01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:10.265672 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b8ae7-5414-42ac-8abf-a7fb2822ad01 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:10.279052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1212/2411] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:27:10.283611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a36f6-6452-4d30-b0cd-a5a485922537 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:10.296651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a36f6-6452-4d30-b0cd-a5a485922537 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:10.301562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c71772-c441-4aea-bd2d-ee2965a936c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:10.302350 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c71772-c441-4aea-bd2d-ee2965a936c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:10.302781 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c71772-c441-4aea-bd2d-ee2965a936c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:10.303205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c71772-c441-4aea-bd2d-ee2965a936c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:10.303833 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c71772-c441-4aea-bd2d-ee2965a936c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:10.305809 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c71772-c441-4aea-bd2d-ee2965a936c7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:10.342142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1200/2412] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:27:10 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:27:10.343657 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b8ae7-5414-42ac-8abf-a7fb2822ad01 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:10.356450 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b8ae7-5414-42ac-8abf-a7fb2822ad01 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:10.421251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1e71c-617b-4f48-9339-56c075505814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:10.421785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1e71c-617b-4f48-9339-56c075505814 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:10.422077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1e71c-617b-4f48-9339-56c075505814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:10.422339 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1e71c-617b-4f48-9339-56c075505814 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:10.422957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1e71c-617b-4f48-9339-56c075505814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:10.426396 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1e71c-617b-4f48-9339-56c075505814 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:10.472532 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1213/2413] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:27:10 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:27:10.476803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c71772-c441-4aea-bd2d-ee2965a936c7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:10.512359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c71772-c441-4aea-bd2d-ee2965a936c7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:10.528305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecabec5-1d7b-4c8c-b76d-d5a5e1444325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:10.528955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecabec5-1d7b-4c8c-b76d-d5a5e1444325 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:10.529765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecabec5-1d7b-4c8c-b76d-d5a5e1444325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:10.530057 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecabec5-1d7b-4c8c-b76d-d5a5e1444325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:10.530713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecabec5-1d7b-4c8c-b76d-d5a5e1444325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:10.532719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecabec5-1d7b-4c8c-b76d-d5a5e1444325 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:10.568132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1201/2414] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:27:10.572168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1e71c-617b-4f48-9339-56c075505814 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:10.596677 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1e71c-617b-4f48-9339-56c075505814 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:10.609642 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f9ff2-ba05-4595-89e4-168eeba8ed94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:10.610354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f9ff2-ba05-4595-89e4-168eeba8ed94 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:10.610742 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f9ff2-ba05-4595-89e4-168eeba8ed94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:10.611128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f9ff2-ba05-4595-89e4-168eeba8ed94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:10.611878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f9ff2-ba05-4595-89e4-168eeba8ed94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:10.613938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f9ff2-ba05-4595-89e4-168eeba8ed94 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:10.646107 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1214/2415] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:27:10.649991 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecabec5-1d7b-4c8c-b76d-d5a5e1444325 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:10.662261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecabec5-1d7b-4c8c-b76d-d5a5e1444325 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:10.669638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fb12d-3e12-4e6f-8569-239decec794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:10.670648 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fb12d-3e12-4e6f-8569-239decec794f admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:10.671043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fb12d-3e12-4e6f-8569-239decec794f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:10.671382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fb12d-3e12-4e6f-8569-239decec794f admin admin] PATH_INFO: `/v3/projects/21ae4154efbb49c3ae28f5f50625eab8/users/7f8d3e9c40874475b52f15ebadcb4894/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:10.676958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:10.705774 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fb12d-3e12-4e6f-8569-239decec794f admin admin] RBAC: Authorizing `identity:create_grant(project_id=21ae4154efbb49c3ae28f5f50625eab8, user_id=7f8d3e9c40874475b52f15ebadcb4894, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:10.709397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fb12d-3e12-4e6f-8569-239decec794f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:10.733022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1202/2416] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:27:10 2022] PUT /identity/v3/projects/21ae4154efbb49c3ae28f5f50625eab8/users/7f8d3e9c40874475b52f15ebadcb4894/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:27:10.739877 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8813d22-2336-4dea-bd73-3994b56b65c2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:10.740288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8813d22-2336-4dea-bd73-3994b56b65c2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:10.740647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8813d22-2336-4dea-bd73-3994b56b65c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:10.769543 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c8813d22-2336-4dea-bd73-3994b56b65c2 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:10.771687 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c8813d22-2336-4dea-bd73-3994b56b65c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:10.813455 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:10.884577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1215/2417] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:10.904484 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fb12d-3e12-4e6f-8569-239decec794f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:10.906778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-781fb12d-3e12-4e6f-8569-239decec794f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:11.055522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fb12d-3e12-4e6f-8569-239decec794f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:11.061063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc50719-3d0a-498b-a967-51c30545bdf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:11.063219 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc50719-3d0a-498b-a967-51c30545bdf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:11.073511 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc50719-3d0a-498b-a967-51c30545bdf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:11.075574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc50719-3d0a-498b-a967-51c30545bdf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:11.100696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc50719-3d0a-498b-a967-51c30545bdf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:11.102283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc50719-3d0a-498b-a967-51c30545bdf7 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:11.120538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1203/2418] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:27:11.564940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020a48b-e31c-459b-b759-05a1314e48c8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:11.565429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020a48b-e31c-459b-b759-05a1314e48c8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:11.565784 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020a48b-e31c-459b-b759-05a1314e48c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:11.587792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a020a48b-e31c-459b-b759-05a1314e48c8 None None] MFA Rules not processed for user `67b708d5cc294d99a1183717487966a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:11.589617 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a020a48b-e31c-459b-b759-05a1314e48c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:11.676631 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1216/2419] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:12.509391 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3c1c9-53b6-4f34-bb32-4e0f195c1e63 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:12.509916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3c1c9-53b6-4f34-bb32-4e0f195c1e63 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:12.510315 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3c1c9-53b6-4f34-bb32-4e0f195c1e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:12.540825 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4ac3c1c9-53b6-4f34-bb32-4e0f195c1e63 None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:12.543676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4ac3c1c9-53b6-4f34-bb32-4e0f195c1e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:12.694052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1204/2420] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Aug 11 16:27:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:12.754950 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020a48b-e31c-459b-b759-05a1314e48c8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:12.757886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a020a48b-e31c-459b-b759-05a1314e48c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:12.968108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020a48b-e31c-459b-b759-05a1314e48c8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:12.974946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2563bd9-5e9f-4bf6-99d3-6a3f4b4db089 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:12.975824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2563bd9-5e9f-4bf6-99d3-6a3f4b4db089 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:12.976263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2563bd9-5e9f-4bf6-99d3-6a3f4b4db089 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:12.976714 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2563bd9-5e9f-4bf6-99d3-6a3f4b4db089 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:12.998720 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2563bd9-5e9f-4bf6-99d3-6a3f4b4db089 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:13.001223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2563bd9-5e9f-4bf6-99d3-6a3f4b4db089 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:13.011181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1217/2421] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:27:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:27:13.986300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df44c2-79d9-4c62-b15e-8c67cd1c953c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:13.991677 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df44c2-79d9-4c62-b15e-8c67cd1c953c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:13.992354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df44c2-79d9-4c62-b15e-8c67cd1c953c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:14.020487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-94df44c2-79d9-4c62-b15e-8c67cd1c953c None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:14.020487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-94df44c2-79d9-4c62-b15e-8c67cd1c953c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:14.033998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1205/2422] 10.222.0.40 () {58 vars in 967 bytes} [Thu Aug 11 16:27:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:14.052752 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2563bd9-5e9f-4bf6-99d3-6a3f4b4db089 service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:14.067938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2563bd9-5e9f-4bf6-99d3-6a3f4b4db089 service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:14.081122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979b908-a47c-4e3c-9234-834a2ca34d7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:14.081964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979b908-a47c-4e3c-9234-834a2ca34d7c service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:14.082231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979b908-a47c-4e3c-9234-834a2ca34d7c service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:14.082628 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979b908-a47c-4e3c-9234-834a2ca34d7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:14.102067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979b908-a47c-4e3c-9234-834a2ca34d7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:14.104076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979b908-a47c-4e3c-9234-834a2ca34d7c service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:14.117547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1218/2423] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:27:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:27:14.703353 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac0a73-d77e-405c-8695-543fdbc7eeba None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:14.704112 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac0a73-d77e-405c-8695-543fdbc7eeba None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:14.704624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac0a73-d77e-405c-8695-543fdbc7eeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:14.733595 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-dcac0a73-d77e-405c-8695-543fdbc7eeba None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:14.735730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dcac0a73-d77e-405c-8695-543fdbc7eeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:14.745545 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1206/2424] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Aug 11 16:27:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:14.761064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979b908-a47c-4e3c-9234-834a2ca34d7c service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:14.778760 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979b908-a47c-4e3c-9234-834a2ca34d7c service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:14.786786 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b0031-3eac-49de-8e4e-b3cbdad99ee3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:14.787494 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b0031-3eac-49de-8e4e-b3cbdad99ee3 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:14.787818 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b0031-3eac-49de-8e4e-b3cbdad99ee3 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:14.788262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b0031-3eac-49de-8e4e-b3cbdad99ee3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:14.811536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b0031-3eac-49de-8e4e-b3cbdad99ee3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:14.824354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b0031-3eac-49de-8e4e-b3cbdad99ee3 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:14.847490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1219/2425] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:27:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:27:15.408765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469699eb-0224-4bf2-93b0-e201754c4912 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:15.410211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469699eb-0224-4bf2-93b0-e201754c4912 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:15.410975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469699eb-0224-4bf2-93b0-e201754c4912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:15.440990 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-469699eb-0224-4bf2-93b0-e201754c4912 None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:15.442706 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-469699eb-0224-4bf2-93b0-e201754c4912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:15.464418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1207/2426] 10.222.0.40 () {58 vars in 967 bytes} [Thu Aug 11 16:27:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:15.489949 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b0031-3eac-49de-8e4e-b3cbdad99ee3 service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:15.505317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b0031-3eac-49de-8e4e-b3cbdad99ee3 service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:15.522883 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d380de-fe2c-4cce-9f3d-e1d1b3a918de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:15.523700 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d380de-fe2c-4cce-9f3d-e1d1b3a918de service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:15.524019 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d380de-fe2c-4cce-9f3d-e1d1b3a918de service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:15.524426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d380de-fe2c-4cce-9f3d-e1d1b3a918de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:15.555696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d380de-fe2c-4cce-9f3d-e1d1b3a918de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:15.558453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d380de-fe2c-4cce-9f3d-e1d1b3a918de service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:15.591204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1220/2427] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:27:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:27:18.553392 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469699eb-0224-4bf2-93b0-e201754c4912 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:18.560842 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d64152-6404-40e7-aebd-9107ae37a731 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:18.561330 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d64152-6404-40e7-aebd-9107ae37a731 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:18.561430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d64152-6404-40e7-aebd-9107ae37a731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:18.562549 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-469699eb-0224-4bf2-93b0-e201754c4912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:18.583646 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469699eb-0224-4bf2-93b0-e201754c4912 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:18.594369 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cfc57-07a7-413d-bfd4-591c86442ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:18.595019 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cfc57-07a7-413d-bfd4-591c86442ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:18.595318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cfc57-07a7-413d-bfd4-591c86442ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:18.595801 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cfc57-07a7-413d-bfd4-591c86442ddb admin admin] PATH_INFO: `/v3/users/8c2c37b2b45d4a029006837ff0d71b47` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:18.602133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cfc57-07a7-413d-bfd4-591c86442ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2c37b2b45d4a029006837ff0d71b47)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:18.617327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cfc57-07a7-413d-bfd4-591c86442ddb admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:18.641019 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c4d64152-6404-40e7-aebd-9107ae37a731 None None] MFA Rules not processed for user `7f8d3e9c40874475b52f15ebadcb4894`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:18.642262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c4d64152-6404-40e7-aebd-9107ae37a731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:18.679936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:18.696785 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3c7cfc57-07a7-413d-bfd4-591c86442ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2c37b2b45d4a029006837ff0d71b47'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:18.717136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3c7cfc57-07a7-413d-bfd4-591c86442ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2c37b2b45d4a029006837ff0d71b47'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:18.739483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:18.745417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3c7cfc57-07a7-413d-bfd4-591c86442ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2c37b2b45d4a029006837ff0d71b47'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:18.765502 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3c7cfc57-07a7-413d-bfd4-591c86442ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2c37b2b45d4a029006837ff0d71b47'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:18.766490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3c7cfc57-07a7-413d-bfd4-591c86442ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2c37b2b45d4a029006837ff0d71b47'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:18.767517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1221/2428] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:18.771551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d64152-6404-40e7-aebd-9107ae37a731 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:18.773944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1208/2429] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:27:18 2022] DELETE /identity/v3/users/8c2c37b2b45d4a029006837ff0d71b47 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:27:18.781898 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ffcd4-1e2b-44fb-af22-8c25c32de189 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:18.782410 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ffcd4-1e2b-44fb-af22-8c25c32de189 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:18.785819 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ffcd4-1e2b-44fb-af22-8c25c32de189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:18.789067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d64152-6404-40e7-aebd-9107ae37a731 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:18.835097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f87ffcd4-1e2b-44fb-af22-8c25c32de189 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:18.836323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f87ffcd4-1e2b-44fb-af22-8c25c32de189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:18.893538 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d4730-e999-41d0-93f0-8bffcfb25a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:18.894474 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4730-e999-41d0-93f0-8bffcfb25a3e admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:18.894729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4730-e999-41d0-93f0-8bffcfb25a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:18.895159 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4730-e999-41d0-93f0-8bffcfb25a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:18.895981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d4730-e999-41d0-93f0-8bffcfb25a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:18.898111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d4730-e999-41d0-93f0-8bffcfb25a3e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:18.953039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1222/2430] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:27:18 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:27:18.954463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d4730-e999-41d0-93f0-8bffcfb25a3e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:18.959197 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-309d4730-e999-41d0-93f0-8bffcfb25a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:19.004448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1209/2431] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:19.014910 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ffcd4-1e2b-44fb-af22-8c25c32de189 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:19.022219 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f87ffcd4-1e2b-44fb-af22-8c25c32de189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:19.039772 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d4730-e999-41d0-93f0-8bffcfb25a3e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:19.047176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a4a67-7d2d-4990-a6a9-737b412f442e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:19.048153 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a4a67-7d2d-4990-a6a9-737b412f442e admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:19.048440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a4a67-7d2d-4990-a6a9-737b412f442e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:19.048794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a4a67-7d2d-4990-a6a9-737b412f442e admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:19.049425 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a4a67-7d2d-4990-a6a9-737b412f442e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:19.051358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a4a67-7d2d-4990-a6a9-737b412f442e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:19.083254 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1223/2432] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:27:18 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:27:19.093341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a4a67-7d2d-4990-a6a9-737b412f442e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:19.101162 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a4a67-7d2d-4990-a6a9-737b412f442e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:19.112833 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be6947-bac4-4cfe-9896-58ffa5475ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:19.113453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be6947-bac4-4cfe-9896-58ffa5475ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:19.113731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be6947-bac4-4cfe-9896-58ffa5475ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:19.114002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be6947-bac4-4cfe-9896-58ffa5475ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:19.114660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be6947-bac4-4cfe-9896-58ffa5475ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:19.116362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be6947-bac4-4cfe-9896-58ffa5475ad1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:19.128394 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1224/2433] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:27:19.130335 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001dfce-ea26-4859-80c7-6f0cd8d2b8b6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:19.130624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001dfce-ea26-4859-80c7-6f0cd8d2b8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:19.130899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001dfce-ea26-4859-80c7-6f0cd8d2b8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:19.138364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ffcd4-1e2b-44fb-af22-8c25c32de189 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:19.157131 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1001dfce-ea26-4859-80c7-6f0cd8d2b8b6 None None] MFA Rules not processed for user `8f34b288e7b1499ea30c2c87023cb917`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:19.158689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1001dfce-ea26-4859-80c7-6f0cd8d2b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:19.179858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:19.211052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410bbb3-e475-4e7c-b0a6-73eeee10ff47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:19.211645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410bbb3-e475-4e7c-b0a6-73eeee10ff47 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:19.211922 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410bbb3-e475-4e7c-b0a6-73eeee10ff47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:19.212205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410bbb3-e475-4e7c-b0a6-73eeee10ff47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:19.227965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410bbb3-e475-4e7c-b0a6-73eeee10ff47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:19.230437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410bbb3-e475-4e7c-b0a6-73eeee10ff47 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:19.236638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1225/2434] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:19.242267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1210/2435] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:27:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:27:19.253848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001dfce-ea26-4859-80c7-6f0cd8d2b8b6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:19.266285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001dfce-ea26-4859-80c7-6f0cd8d2b8b6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:19.271468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f0192-d9e4-4246-90fa-f6cd1a7500e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:19.272911 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f0192-d9e4-4246-90fa-f6cd1a7500e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:19.273311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f0192-d9e4-4246-90fa-f6cd1a7500e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:19.273803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f0192-d9e4-4246-90fa-f6cd1a7500e2 admin admin] PATH_INFO: `/v3/projects/640e0b252a324c5f97d92c38eedb6b35/users/519c50bdd05a4362b25fa3bb1602b54e/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:19.313105 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f0192-d9e4-4246-90fa-f6cd1a7500e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=640e0b252a324c5f97d92c38eedb6b35, user_id=519c50bdd05a4362b25fa3bb1602b54e, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:19.323750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f0192-d9e4-4246-90fa-f6cd1a7500e2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:19.346105 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1226/2436] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:27:19 2022] PUT /identity/v3/projects/640e0b252a324c5f97d92c38eedb6b35/users/519c50bdd05a4362b25fa3bb1602b54e/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:27:19.350203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410bbb3-e475-4e7c-b0a6-73eeee10ff47 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:19.363327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410bbb3-e475-4e7c-b0a6-73eeee10ff47 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:19.413515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:19.465524 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7cc2f-a64c-4b23-b217-d210666e7b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:19.466161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7cc2f-a64c-4b23-b217-d210666e7b31 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:19.466439 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7cc2f-a64c-4b23-b217-d210666e7b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:19.466969 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7cc2f-a64c-4b23-b217-d210666e7b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:19.467670 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7cc2f-a64c-4b23-b217-d210666e7b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:19.469458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7cc2f-a64c-4b23-b217-d210666e7b31 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:19.494165 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1211/2437] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:27:19.498059 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f0192-d9e4-4246-90fa-f6cd1a7500e2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:19.509200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f0192-d9e4-4246-90fa-f6cd1a7500e2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:19.514951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb99e45-62be-465a-8952-b8fa87d31cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:19.515628 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb99e45-62be-465a-8952-b8fa87d31cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:19.515923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb99e45-62be-465a-8952-b8fa87d31cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:19.516189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb99e45-62be-465a-8952-b8fa87d31cc7 admin admin] PATH_INFO: `/v3/projects/640e0b252a324c5f97d92c38eedb6b35/users/519c50bdd05a4362b25fa3bb1602b54e/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:19.518660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb99e45-62be-465a-8952-b8fa87d31cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=640e0b252a324c5f97d92c38eedb6b35, user_id=519c50bdd05a4362b25fa3bb1602b54e, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:19.521685 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb99e45-62be-465a-8952-b8fa87d31cc7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:19.536359 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1227/2438] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:27:19 2022] PUT /identity/v3/projects/640e0b252a324c5f97d92c38eedb6b35/users/519c50bdd05a4362b25fa3bb1602b54e/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:27:19.538488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7cc2f-a64c-4b23-b217-d210666e7b31 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:19.540379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-70b7cc2f-a64c-4b23-b217-d210666e7b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:19.556494 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7cc2f-a64c-4b23-b217-d210666e7b31 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:19.622538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:19.623175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:19.623505 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:19.623714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00 admin admin] PATH_INFO: `/v3/projects/0f911b01eb464c8aa1ac59e5c1d00d53` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:19.625314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f911b01eb464c8aa1ac59e5c1d00d53)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:19.626775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:19.705140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f911b01eb464c8aa1ac59e5c1d00d53', 'request_id': 'req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:19.715531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f911b01eb464c8aa1ac59e5c1d00d53', 'request_id': 'req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:19.725446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f911b01eb464c8aa1ac59e5c1d00d53', 'request_id': 'req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:19.750557 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00 admin admin] The token cache is being invalidate because project 0f911b01eb464c8aa1ac59e5c1d00d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:27:19.753029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:19.753921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:27:19.757266 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1212/2439] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:27:19 2022] DELETE /identity/v3/projects/0f911b01eb464c8aa1ac59e5c1d00d53 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:27:26.054985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4f16c-c566-469e-9c4c-40c62aac3833 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:26.055466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4f16c-c566-469e-9c4c-40c62aac3833 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:26.055546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4f16c-c566-469e-9c4c-40c62aac3833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:26.092285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d7a4f16c-c566-469e-9c4c-40c62aac3833 None None] MFA Rules not processed for user `519c50bdd05a4362b25fa3bb1602b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:26.092285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d7a4f16c-c566-469e-9c4c-40c62aac3833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:26.195101 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1228/2440] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:26.207846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:26.210163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:26.290068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144ebf5-3964-44d6-a99d-1a3b2bff2a00 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:26.293978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556eebd-105b-441c-8ff9-079c72d22e9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9158ce9d8a4aadbf86405657958c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:26.294939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556eebd-105b-441c-8ff9-079c72d22e9a service glance] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:26.295318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556eebd-105b-441c-8ff9-079c72d22e9a service glance] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:26.295709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556eebd-105b-441c-8ff9-079c72d22e9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:26.297722 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3556eebd-105b-441c-8ff9-079c72d22e9a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:26.330543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:26.373728 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556eebd-105b-441c-8ff9-079c72d22e9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:26.375451 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556eebd-105b-441c-8ff9-079c72d22e9a service glance] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:26.387092 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1213/2441] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:27:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:27:26.623509 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4a516-7a28-44e2-b3a1-253135f592ea None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:26.624416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4a516-7a28-44e2-b3a1-253135f592ea None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:26.624416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4a516-7a28-44e2-b3a1-253135f592ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:26.647958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-59b4a516-7a28-44e2-b3a1-253135f592ea None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:26.650694 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-59b4a516-7a28-44e2-b3a1-253135f592ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:26.780440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1229/2442] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Aug 11 16:27:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:26.795733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556eebd-105b-441c-8ff9-079c72d22e9a service glance] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:26.797455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3556eebd-105b-441c-8ff9-079c72d22e9a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:26.946949 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556eebd-105b-441c-8ff9-079c72d22e9a service glance] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:26.957617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d618752-4625-4f25-9579-0c85a9d0dde4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:26.958504 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d618752-4625-4f25-9579-0c85a9d0dde4 service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:26.958641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d618752-4625-4f25-9579-0c85a9d0dde4 service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:26.959065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d618752-4625-4f25-9579-0c85a9d0dde4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:26.968798 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d618752-4625-4f25-9579-0c85a9d0dde4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:26.970621 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d618752-4625-4f25-9579-0c85a9d0dde4 service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:26.980429 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1214/2443] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:27:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:27:28.251737 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef28c3-a078-4806-8bd4-578995ff2c42 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:28.252746 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef28c3-a078-4806-8bd4-578995ff2c42 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:28.253157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef28c3-a078-4806-8bd4-578995ff2c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:28.293353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d3ef28c3-a078-4806-8bd4-578995ff2c42 None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:28.295945 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d3ef28c3-a078-4806-8bd4-578995ff2c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:28.320611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1230/2444] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Aug 11 16:27:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:28.343705 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d618752-4625-4f25-9579-0c85a9d0dde4 service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:28.367615 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d618752-4625-4f25-9579-0c85a9d0dde4 service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:28.379186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f673022-9003-407d-824f-24b09dcb6ccf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:28.382078 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f673022-9003-407d-824f-24b09dcb6ccf service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:28.384111 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f673022-9003-407d-824f-24b09dcb6ccf service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:28.385725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f673022-9003-407d-824f-24b09dcb6ccf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:28.418640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f673022-9003-407d-824f-24b09dcb6ccf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:28.421693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f673022-9003-407d-824f-24b09dcb6ccf service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:28.445907 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1215/2445] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:27:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:27:38.281465 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:38.435472 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=54 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:42.125344 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee51eb-4338-43c4-b1f8-91fa7792f74b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:42.126163 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee51eb-4338-43c4-b1f8-91fa7792f74b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:42.126163 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee51eb-4338-43c4-b1f8-91fa7792f74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:42.157565 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-63ee51eb-4338-43c4-b1f8-91fa7792f74b None None] MFA Rules not processed for user `7f8d3e9c40874475b52f15ebadcb4894`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:42.159413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-63ee51eb-4338-43c4-b1f8-91fa7792f74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:42.167856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1231/2446] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:27:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:44.694308 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f673022-9003-407d-824f-24b09dcb6ccf service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:44.695887 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9f673022-9003-407d-824f-24b09dcb6ccf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:44.761088 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f673022-9003-407d-824f-24b09dcb6ccf service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:44.765523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0244a-a879-4411-9c58-74223c5abfef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:44.766527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0244a-a879-4411-9c58-74223c5abfef service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:44.766527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0244a-a879-4411-9c58-74223c5abfef service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:44.767548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0244a-a879-4411-9c58-74223c5abfef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:44.769436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9bf0244a-a879-4411-9c58-74223c5abfef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:44.852878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0244a-a879-4411-9c58-74223c5abfef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:44.854382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0244a-a879-4411-9c58-74223c5abfef service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:44.864830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1216/2447] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:27:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:27:44.999910 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0877da-4fd2-4d35-8138-355d18951db5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:45.000446 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0877da-4fd2-4d35-8138-355d18951db5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:45.000446 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0877da-4fd2-4d35-8138-355d18951db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:45.022882 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4b0877da-4fd2-4d35-8138-355d18951db5 None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:45.024337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4b0877da-4fd2-4d35-8138-355d18951db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:45.034032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1232/2448] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Aug 11 16:27:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:45.046961 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0244a-a879-4411-9c58-74223c5abfef service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:45.062456 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0244a-a879-4411-9c58-74223c5abfef service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:45.067511 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbab91-5f84-495f-a2da-d119c82bb3f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:45.068117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbab91-5f84-495f-a2da-d119c82bb3f3 service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:45.068399 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbab91-5f84-495f-a2da-d119c82bb3f3 service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:45.068919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbab91-5f84-495f-a2da-d119c82bb3f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:45.080945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbab91-5f84-495f-a2da-d119c82bb3f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:45.083494 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbab91-5f84-495f-a2da-d119c82bb3f3 service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:45.094591 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1217/2449] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:27:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:27:55.015387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:55.090371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=56 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:59.683666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82217e2-87c8-48df-a665-39aa86a3c94e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:59.684253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82217e2-87c8-48df-a665-39aa86a3c94e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:59.684489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82217e2-87c8-48df-a665-39aa86a3c94e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:59.685999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1233/2450] 10.222.0.40 () {54 vars in 921 bytes} [Thu Aug 11 16:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:27:59.691827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694e8d1-958d-4c08-893c-00d2ecf75993 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:59.692307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694e8d1-958d-4c08-893c-00d2ecf75993 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:59.692566 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694e8d1-958d-4c08-893c-00d2ecf75993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:59.714499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c694e8d1-958d-4c08-893c-00d2ecf75993 None None] MFA Rules not processed for user `4e91f3fbe098459dba0acf8ec1fb7098`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:59.715935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c694e8d1-958d-4c08-893c-00d2ecf75993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:59.787720 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1218/2451] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Aug 11 16:27:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:27:59.800302 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82217e2-87c8-48df-a665-39aa86a3c94e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:59.802000 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b82217e2-87c8-48df-a665-39aa86a3c94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:59.815200 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82217e2-87c8-48df-a665-39aa86a3c94e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:59.818666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5940860-bce4-4a09-abb3-d7fa292938ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9158ce9d8a4aadbf86405657958c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:59.819251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5940860-bce4-4a09-abb3-d7fa292938ea service glance] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:59.819525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5940860-bce4-4a09-abb3-d7fa292938ea service glance] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:59.819793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5940860-bce4-4a09-abb3-d7fa292938ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:59.829832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5940860-bce4-4a09-abb3-d7fa292938ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:59.831226 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5940860-bce4-4a09-abb3-d7fa292938ea service glance] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:59.842329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1234/2452] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:27:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:27:59.909086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045cfbb-bff9-41cb-ae17-ff288e900f18 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:59.909303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045cfbb-bff9-41cb-ae17-ff288e900f18 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:59.909578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045cfbb-bff9-41cb-ae17-ff288e900f18 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:59.910979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1219/2453] 10.222.0.40 () {54 vars in 921 bytes} [Thu Aug 11 16:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:27:59.916098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff93b5-4cf6-46e9-a250-68fe840d293c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:59.916377 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff93b5-4cf6-46e9-a250-68fe840d293c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:59.916696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff93b5-4cf6-46e9-a250-68fe840d293c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:59.935388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7eff93b5-4cf6-46e9-a250-68fe840d293c None None] MFA Rules not processed for user `16d2570f97234d62948762562616000c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:27:59.936563 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7eff93b5-4cf6-46e9-a250-68fe840d293c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:27:59.942923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1235/2454] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Aug 11 16:27:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:27:59.954748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045cfbb-bff9-41cb-ae17-ff288e900f18 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:27:59.966066 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045cfbb-bff9-41cb-ae17-ff288e900f18 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:27:59.969658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5ee40-f6dc-4f18-a580-9dfd5811569a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:27:59.970235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5ee40-f6dc-4f18-a580-9dfd5811569a service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:27:59.970513 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5ee40-f6dc-4f18-a580-9dfd5811569a service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:27:59.970783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5ee40-f6dc-4f18-a580-9dfd5811569a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:27:59.978381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5ee40-f6dc-4f18-a580-9dfd5811569a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:27:59.979947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5ee40-f6dc-4f18-a580-9dfd5811569a service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:27:59.987583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1220/2455] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:27:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:28:00.066779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb594a-5204-4f6c-8fa7-50b47316a2f2 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:28:00.067059 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb594a-5204-4f6c-8fa7-50b47316a2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:28:00.067329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb594a-5204-4f6c-8fa7-50b47316a2f2 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:28:00.068733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1236/2456] 10.222.0.40 () {54 vars in 921 bytes} [Thu Aug 11 16:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:28:00.074255 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a1d6c-ec17-44a2-86f3-6a8e55daeb9d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:28:00.074556 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a1d6c-ec17-44a2-86f3-6a8e55daeb9d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:28:00.074827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a1d6c-ec17-44a2-86f3-6a8e55daeb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:28:00.094373 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c71a1d6c-ec17-44a2-86f3-6a8e55daeb9d None None] MFA Rules not processed for user `4e91f3fbe098459dba0acf8ec1fb7098`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:28:00.095548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c71a1d6c-ec17-44a2-86f3-6a8e55daeb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:28:00.104530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1221/2457] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Aug 11 16:28:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:28:00.114724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb594a-5204-4f6c-8fa7-50b47316a2f2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:28:00.125478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb594a-5204-4f6c-8fa7-50b47316a2f2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:28:00.128968 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e049c68-bb74-4d15-a5eb-897872addd8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:28:00.129544 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e049c68-bb74-4d15-a5eb-897872addd8e service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:28:00.129818 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e049c68-bb74-4d15-a5eb-897872addd8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:28:00.130086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e049c68-bb74-4d15-a5eb-897872addd8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:28:00.140316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e049c68-bb74-4d15-a5eb-897872addd8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:28:00.141774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e049c68-bb74-4d15-a5eb-897872addd8e service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:28:00.152643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1237/2458] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:28:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:28:02.331858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a71c96-6543-4dcc-bff2-eae7c598069c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:28:02.332329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a71c96-6543-4dcc-bff2-eae7c598069c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:28:02.332418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a71c96-6543-4dcc-bff2-eae7c598069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:28:02.350878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-12a71c96-6543-4dcc-bff2-eae7c598069c None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:28:02.352056 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-12a71c96-6543-4dcc-bff2-eae7c598069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:28:02.359582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1222/2459] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Aug 11 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:28:02.371987 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e049c68-bb74-4d15-a5eb-897872addd8e service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:28:02.383021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e049c68-bb74-4d15-a5eb-897872addd8e service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:28:02.388839 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7402e-611a-4965-8893-e40b643f3767 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:28:02.389436 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7402e-611a-4965-8893-e40b643f3767 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:28:02.389714 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7402e-611a-4965-8893-e40b643f3767 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:28:02.389983 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7402e-611a-4965-8893-e40b643f3767 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:28:02.398153 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7402e-611a-4965-8893-e40b643f3767 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:28:02.400329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7402e-611a-4965-8893-e40b643f3767 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:28:02.409376 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1238/2460] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:28:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:28:12.345675 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=43 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:12.405458 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=21 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:17.008984 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a71c96-6543-4dcc-bff2-eae7c598069c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:28:17.010437 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-12a71c96-6543-4dcc-bff2-eae7c598069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:28:17.083277 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a71c96-6543-4dcc-bff2-eae7c598069c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:28:17.088337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae8112-8d1a-46a9-9f88-55dbcdfa52c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e1c7e6ee814b47912760cf7daf54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:28:17.088971 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae8112-8d1a-46a9-9f88-55dbcdfa52c7 service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:28:17.089251 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae8112-8d1a-46a9-9f88-55dbcdfa52c7 service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:28:17.089522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae8112-8d1a-46a9-9f88-55dbcdfa52c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:28:17.091242 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e4ae8112-8d1a-46a9-9f88-55dbcdfa52c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:28:17.102722 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae8112-8d1a-46a9-9f88-55dbcdfa52c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:28:17.104278 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae8112-8d1a-46a9-9f88-55dbcdfa52c7 service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:28:17.115057 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1223/2461] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:28:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:28:20.440037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da7402-980a-4789-8020-21c02ddc11b3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:28:20.440544 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da7402-980a-4789-8020-21c02ddc11b3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:28:20.440544 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da7402-980a-4789-8020-21c02ddc11b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:28:20.463337 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b7da7402-980a-4789-8020-21c02ddc11b3 None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:28:20.464956 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b7da7402-980a-4789-8020-21c02ddc11b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:28:20.472492 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1239/2462] 10.222.0.40 () {58 vars in 967 bytes} [Thu Aug 11 16:28:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:28:20.499574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae8112-8d1a-46a9-9f88-55dbcdfa52c7 service placement] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:28:20.511640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae8112-8d1a-46a9-9f88-55dbcdfa52c7 service placement] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:28:20.516626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8e981-59f6-4acf-93ee-2cd3bbd23ea9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:28:20.517226 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e981-59f6-4acf-93ee-2cd3bbd23ea9 service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:28:20.517499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e981-59f6-4acf-93ee-2cd3bbd23ea9 service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:28:20.517768 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e981-59f6-4acf-93ee-2cd3bbd23ea9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:28:20.527053 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8e981-59f6-4acf-93ee-2cd3bbd23ea9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:28:20.528634 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8e981-59f6-4acf-93ee-2cd3bbd23ea9 service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:28:20.536909 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1224/2463] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:28:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:28:22.714654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da7402-980a-4789-8020-21c02ddc11b3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:28:22.723935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da7402-980a-4789-8020-21c02ddc11b3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:28:22.728012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fef86-4252-4d04-81e1-b82a4ae13d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:28:22.728608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fef86-4252-4d04-81e1-b82a4ae13d10 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:28:22.728912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fef86-4252-4d04-81e1-b82a4ae13d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:28:22.729184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fef86-4252-4d04-81e1-b82a4ae13d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:28:22.737912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fef86-4252-4d04-81e1-b82a4ae13d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:28:22.739334 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fef86-4252-4d04-81e1-b82a4ae13d10 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:28:22.749300 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1240/2464] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:28:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:28:30.533671 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=38 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:32.745154 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=9 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:51.671006 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43097cb2-ede0-4f21-a995-45a8d78c5683 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:28:51.671525 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43097cb2-ede0-4f21-a995-45a8d78c5683 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:28:51.671525 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43097cb2-ede0-4f21-a995-45a8d78c5683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:28:51.689746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-43097cb2-ede0-4f21-a995-45a8d78c5683 None None] MFA Rules not processed for user `8f34b288e7b1499ea30c2c87023cb917`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:28:51.690916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-43097cb2-ede0-4f21-a995-45a8d78c5683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:28:51.743282 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1225/2465] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:28:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:29:01.736745 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=25 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:07.465902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9588a36-72ee-4986-a7a7-f002736ef9c5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:29:07.466406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9588a36-72ee-4986-a7a7-f002736ef9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:29:07.466556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9588a36-72ee-4986-a7a7-f002736ef9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:29:07.485889 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c9588a36-72ee-4986-a7a7-f002736ef9c5 None None] MFA Rules not processed for user `a9f0bcfc9c4b48d98cd3385309adaafb`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:29:07.487075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c9588a36-72ee-4986-a7a7-f002736ef9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:29:07.543309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1241/2466] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:29:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:29:17.536043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=25 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:36.030368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb1b87-57fc-41f6-9955-896f768581ae None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:29:36.030879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb1b87-57fc-41f6-9955-896f768581ae None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:29:36.030994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb1b87-57fc-41f6-9955-896f768581ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:29:36.050215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3fdb1b87-57fc-41f6-9955-896f768581ae None None] MFA Rules not processed for user `7b0f9418982c4a8e8ebd5cf4419c5418`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:29:36.051422 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3fdb1b87-57fc-41f6-9955-896f768581ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:29:36.109345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1226/2467] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:29:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:29:46.102583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=25 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:59.254714 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f3c53-c242-4b0e-aa84-4045641870fb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:29:59.255248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f3c53-c242-4b0e-aa84-4045641870fb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:29:59.255248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f3c53-c242-4b0e-aa84-4045641870fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:29:59.276763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0b8f3c53-c242-4b0e-aa84-4045641870fb None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:29:59.277994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0b8f3c53-c242-4b0e-aa84-4045641870fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:29:59.287149 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1242/2468] 10.222.0.40 () {58 vars in 967 bytes} [Thu Aug 11 16:29:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:29:59.334531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb1b87-57fc-41f6-9955-896f768581ae None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:29:59.347094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb1b87-57fc-41f6-9955-896f768581ae None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:29:59.352038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38512a64-dbd3-4fbb-b9c9-1c782725d946 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:29:59.352683 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38512a64-dbd3-4fbb-b9c9-1c782725d946 service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:29:59.352962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38512a64-dbd3-4fbb-b9c9-1c782725d946 service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:29:59.353232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38512a64-dbd3-4fbb-b9c9-1c782725d946 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:29:59.361376 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38512a64-dbd3-4fbb-b9c9-1c782725d946 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:29:59.362951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38512a64-dbd3-4fbb-b9c9-1c782725d946 service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:29:59.371069 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1227/2469] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:29:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:30:00.353133 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f3c53-c242-4b0e-aa84-4045641870fb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:00.354596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0b8f3c53-c242-4b0e-aa84-4045641870fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:00.427962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f3c53-c242-4b0e-aa84-4045641870fb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:00.433179 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a9806-8bed-435b-b9dd-ff29c191e191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:00.433894 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a9806-8bed-435b-b9dd-ff29c191e191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:00.434239 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a9806-8bed-435b-b9dd-ff29c191e191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:00.434518 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a9806-8bed-435b-b9dd-ff29c191e191 admin admin] PATH_INFO: `/v3/users/8f34b288e7b1499ea30c2c87023cb917` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:00.435758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a9806-8bed-435b-b9dd-ff29c191e191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f34b288e7b1499ea30c2c87023cb917)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:00.437756 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a9806-8bed-435b-b9dd-ff29c191e191 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:00.505774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ef9a9806-8bed-435b-b9dd-ff29c191e191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f34b288e7b1499ea30c2c87023cb917'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:00.519807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ef9a9806-8bed-435b-b9dd-ff29c191e191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f34b288e7b1499ea30c2c87023cb917'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:00.529218 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ef9a9806-8bed-435b-b9dd-ff29c191e191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f34b288e7b1499ea30c2c87023cb917'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:00.538918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ef9a9806-8bed-435b-b9dd-ff29c191e191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f34b288e7b1499ea30c2c87023cb917'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:00.539681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ef9a9806-8bed-435b-b9dd-ff29c191e191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f34b288e7b1499ea30c2c87023cb917'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:00.548412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1243/2470] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:30:00 2022] DELETE /identity/v3/users/8f34b288e7b1499ea30c2c87023cb917 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:30:00.792082 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38512a64-dbd3-4fbb-b9c9-1c782725d946 service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:00.812858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38512a64-dbd3-4fbb-b9c9-1c782725d946 service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:00.896759 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef53c4-dfa2-4c14-90dc-9de45b985bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:00.897405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef53c4-dfa2-4c14-90dc-9de45b985bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:00.897871 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef53c4-dfa2-4c14-90dc-9de45b985bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:00.898145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef53c4-dfa2-4c14-90dc-9de45b985bb0 admin admin] PATH_INFO: `/v3/projects/a80b4ce3aaff4063afa0f7db3812aeb0` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:00.899327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef53c4-dfa2-4c14-90dc-9de45b985bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a80b4ce3aaff4063afa0f7db3812aeb0)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:00.901320 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef53c4-dfa2-4c14-90dc-9de45b985bb0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:00.964522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-81ef53c4-dfa2-4c14-90dc-9de45b985bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a80b4ce3aaff4063afa0f7db3812aeb0', 'request_id': 'req-81ef53c4-dfa2-4c14-90dc-9de45b985bb0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:00.975072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-81ef53c4-dfa2-4c14-90dc-9de45b985bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a80b4ce3aaff4063afa0f7db3812aeb0', 'request_id': 'req-81ef53c4-dfa2-4c14-90dc-9de45b985bb0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:00.983818 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-81ef53c4-dfa2-4c14-90dc-9de45b985bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a80b4ce3aaff4063afa0f7db3812aeb0', 'request_id': 'req-81ef53c4-dfa2-4c14-90dc-9de45b985bb0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:00.997620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-81ef53c4-dfa2-4c14-90dc-9de45b985bb0 admin admin] The token cache is being invalidate because project a80b4ce3aaff4063afa0f7db3812aeb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:30:00.997952 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-81ef53c4-dfa2-4c14-90dc-9de45b985bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:00.998593 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-81ef53c4-dfa2-4c14-90dc-9de45b985bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:01.004470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1228/2471] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:30:00 2022] DELETE /identity/v3/projects/a80b4ce3aaff4063afa0f7db3812aeb0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:30:01.006096 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9feffb-3a05-435f-ad79-ccdd191ecbdb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:01.006384 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9feffb-3a05-435f-ad79-ccdd191ecbdb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:01.006689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9feffb-3a05-435f-ad79-ccdd191ecbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:01.032025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-be9feffb-3a05-435f-ad79-ccdd191ecbdb None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:30:01.033290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-be9feffb-3a05-435f-ad79-ccdd191ecbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:01.116761 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1244/2472] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:30:01.125657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018e5cd-c35e-484d-81a9-d237af8ba0d8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:01.125938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018e5cd-c35e-484d-81a9-d237af8ba0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:01.126212 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018e5cd-c35e-484d-81a9-d237af8ba0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:01.146157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c018e5cd-c35e-484d-81a9-d237af8ba0d8 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:30:01.147346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c018e5cd-c35e-484d-81a9-d237af8ba0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:01.156191 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1229/2473] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:30:01.160805 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9feffb-3a05-435f-ad79-ccdd191ecbdb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:01.171501 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9feffb-3a05-435f-ad79-ccdd191ecbdb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:01.177137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22231541-3fc1-4119-871c-8ef1589264a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:01.177820 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22231541-3fc1-4119-871c-8ef1589264a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:01.178099 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22231541-3fc1-4119-871c-8ef1589264a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:01.178368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22231541-3fc1-4119-871c-8ef1589264a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:01.179052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22231541-3fc1-4119-871c-8ef1589264a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:30:01.179347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22231541-3fc1-4119-871c-8ef1589264a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:01.181062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22231541-3fc1-4119-871c-8ef1589264a5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:01.191793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:01.195619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1245/2474] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:30:01.200230 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018e5cd-c35e-484d-81a9-d237af8ba0d8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:01.211457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018e5cd-c35e-484d-81a9-d237af8ba0d8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:01.216883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274f916-2c53-4231-a62e-e717a53dff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:01.217487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274f916-2c53-4231-a62e-e717a53dff47 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:01.217766 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274f916-2c53-4231-a62e-e717a53dff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:01.218040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274f916-2c53-4231-a62e-e717a53dff47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:01.218703 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274f916-2c53-4231-a62e-e717a53dff47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:01.220640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274f916-2c53-4231-a62e-e717a53dff47 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:01.254452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1230/2475] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:30:01 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:30:01.258713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22231541-3fc1-4119-871c-8ef1589264a5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:01.270164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22231541-3fc1-4119-871c-8ef1589264a5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:01.335396 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d7dc3-ff88-4186-883d-7061e53527a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:01.336032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d7dc3-ff88-4186-883d-7061e53527a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:01.336295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d7dc3-ff88-4186-883d-7061e53527a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:01.336631 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d7dc3-ff88-4186-883d-7061e53527a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:01.337842 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d7dc3-ff88-4186-883d-7061e53527a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:01.339816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d7dc3-ff88-4186-883d-7061e53527a6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:01.372462 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1246/2476] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:30:01 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:30:01.374853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274f916-2c53-4231-a62e-e717a53dff47 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:01.386488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274f916-2c53-4231-a62e-e717a53dff47 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:01.391420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d57142-2ead-4716-b4ee-965fc890ba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:01.392110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d57142-2ead-4716-b4ee-965fc890ba7b admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:01.392385 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d57142-2ead-4716-b4ee-965fc890ba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:01.392680 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d57142-2ead-4716-b4ee-965fc890ba7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:01.393315 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d57142-2ead-4716-b4ee-965fc890ba7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:01.395056 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d57142-2ead-4716-b4ee-965fc890ba7b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:01.406696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1231/2477] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:30:01.410843 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d7dc3-ff88-4186-883d-7061e53527a6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:01.421028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d7dc3-ff88-4186-883d-7061e53527a6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:01.430198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e3585-f174-4074-9976-4e54a3d68481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:01.430809 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e3585-f174-4074-9976-4e54a3d68481 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:01.431089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e3585-f174-4074-9976-4e54a3d68481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:01.431360 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e3585-f174-4074-9976-4e54a3d68481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:01.432015 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e3585-f174-4074-9976-4e54a3d68481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:01.433714 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e3585-f174-4074-9976-4e54a3d68481 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:01.445001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1247/2478] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:30:01.449718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d57142-2ead-4716-b4ee-965fc890ba7b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:01.459703 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d57142-2ead-4716-b4ee-965fc890ba7b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:01.465054 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272fe5c-4601-4812-9586-2cf9e9b1ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:01.465770 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272fe5c-4601-4812-9586-2cf9e9b1ce82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:01.466053 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272fe5c-4601-4812-9586-2cf9e9b1ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:01.466322 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272fe5c-4601-4812-9586-2cf9e9b1ce82 admin admin] PATH_INFO: `/v3/projects/d1ca98e5c1f14b7681c7b58ba09e7cc3/users/73f4899822d64aa0972702d6a1a735e2/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:01.484123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272fe5c-4601-4812-9586-2cf9e9b1ce82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ca98e5c1f14b7681c7b58ba09e7cc3, user_id=73f4899822d64aa0972702d6a1a735e2, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:01.487774 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272fe5c-4601-4812-9586-2cf9e9b1ce82 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:01.506684 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1232/2479] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:30:01 2022] PUT /identity/v3/projects/d1ca98e5c1f14b7681c7b58ba09e7cc3/users/73f4899822d64aa0972702d6a1a735e2/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:30:01.513221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309f231-4a8c-4ef8-8b46-ad634eae16b8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:01.513517 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309f231-4a8c-4ef8-8b46-ad634eae16b8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:01.513794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309f231-4a8c-4ef8-8b46-ad634eae16b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:01.534141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e309f231-4a8c-4ef8-8b46-ad634eae16b8 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:30:01.535645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e309f231-4a8c-4ef8-8b46-ad634eae16b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:01.612668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1248/2480] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:30:01.620832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272fe5c-4601-4812-9586-2cf9e9b1ce82 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:01.623614 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b272fe5c-4601-4812-9586-2cf9e9b1ce82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:01.643034 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:01.695789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272fe5c-4601-4812-9586-2cf9e9b1ce82 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:01.700625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75187c8a-e74d-40df-a2c5-cbf258c57ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:01.701013 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75187c8a-e74d-40df-a2c5-cbf258c57ebb service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:01.701288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75187c8a-e74d-40df-a2c5-cbf258c57ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:01.701564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75187c8a-e74d-40df-a2c5-cbf258c57ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:01.712247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75187c8a-e74d-40df-a2c5-cbf258c57ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:01.713440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75187c8a-e74d-40df-a2c5-cbf258c57ebb service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:01.726524 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1233/2481] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:30:06.771335 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309f231-4a8c-4ef8-8b46-ad634eae16b8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:06.783747 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309f231-4a8c-4ef8-8b46-ad634eae16b8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:06.788745 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfffdb-2f85-4beb-a747-cf4fa5b484f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:06.790228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfffdb-2f85-4beb-a747-cf4fa5b484f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:06.790708 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfffdb-2f85-4beb-a747-cf4fa5b484f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:06.791123 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfffdb-2f85-4beb-a747-cf4fa5b484f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:06.793184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-abbfffdb-2f85-4beb-a747-cf4fa5b484f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:06.928836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfffdb-2f85-4beb-a747-cf4fa5b484f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:06.930621 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfffdb-2f85-4beb-a747-cf4fa5b484f5 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:06.953518 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1249/2482] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:30:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:30:08.866821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75187c8a-e74d-40df-a2c5-cbf258c57ebb service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:08.887597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75187c8a-e74d-40df-a2c5-cbf258c57ebb service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:08.895421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210c146-8e0d-4ad5-9025-3f7d95278c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:08.900915 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210c146-8e0d-4ad5-9025-3f7d95278c91 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:08.901466 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210c146-8e0d-4ad5-9025-3f7d95278c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:08.903659 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210c146-8e0d-4ad5-9025-3f7d95278c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:08.928321 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f210c146-8e0d-4ad5-9025-3f7d95278c91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:08.954094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210c146-8e0d-4ad5-9025-3f7d95278c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:08.958782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210c146-8e0d-4ad5-9025-3f7d95278c91 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:08.979932 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1234/2483] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:30:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:30:09.097998 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfffdb-2f85-4beb-a747-cf4fa5b484f5 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:09.099475 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-abbfffdb-2f85-4beb-a747-cf4fa5b484f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:09.113289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:09.128079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d942-5858-40ed-b189-662849f5864e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:09.128637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d942-5858-40ed-b189-662849f5864e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:09.129492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d942-5858-40ed-b189-662849f5864e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:09.133547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfffdb-2f85-4beb-a747-cf4fa5b484f5 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:09.140665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a73c7-eb60-4d5d-be20-f3191a64dadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:09.141682 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a73c7-eb60-4d5d-be20-f3191a64dadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:09.142171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a73c7-eb60-4d5d-be20-f3191a64dadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:09.142679 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a73c7-eb60-4d5d-be20-f3191a64dadc admin admin] PATH_INFO: `/v3/users/7f8d3e9c40874475b52f15ebadcb4894` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:09.145184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a73c7-eb60-4d5d-be20-f3191a64dadc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f8d3e9c40874475b52f15ebadcb4894)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:09.147555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a73c7-eb60-4d5d-be20-f3191a64dadc admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:09.200769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-15f6d942-5858-40ed-b189-662849f5864e None None] MFA Rules not processed for user `73f4899822d64aa0972702d6a1a735e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:30:09.202366 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-15f6d942-5858-40ed-b189-662849f5864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:09.254141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-608a73c7-eb60-4d5d-be20-f3191a64dadc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f8d3e9c40874475b52f15ebadcb4894'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:09.276225 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-608a73c7-eb60-4d5d-be20-f3191a64dadc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f8d3e9c40874475b52f15ebadcb4894'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:09.288635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-608a73c7-eb60-4d5d-be20-f3191a64dadc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f8d3e9c40874475b52f15ebadcb4894'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:09.298176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-608a73c7-eb60-4d5d-be20-f3191a64dadc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f8d3e9c40874475b52f15ebadcb4894'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:09.299204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-608a73c7-eb60-4d5d-be20-f3191a64dadc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f8d3e9c40874475b52f15ebadcb4894'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:09.307303 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1250/2484] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:30:09 2022] DELETE /identity/v3/users/7f8d3e9c40874475b52f15ebadcb4894 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:30:09.309656 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1235/2485] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:30:09.324333 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a73c7-eb60-4d5d-be20-f3191a64dadc admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:09.326779 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-608a73c7-eb60-4d5d-be20-f3191a64dadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:09.422358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a73c7-eb60-4d5d-be20-f3191a64dadc admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:09.428249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b8835-6bce-443a-ad69-950ecca0917f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:09.429039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b8835-6bce-443a-ad69-950ecca0917f service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:09.429412 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b8835-6bce-443a-ad69-950ecca0917f service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:09.430212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b8835-6bce-443a-ad69-950ecca0917f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:09.431978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-386b8835-6bce-443a-ad69-950ecca0917f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:09.528976 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b8835-6bce-443a-ad69-950ecca0917f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:09.530742 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b8835-6bce-443a-ad69-950ecca0917f service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:09.541679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6d942-5858-40ed-b189-662849f5864e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:09.554074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6d942-5858-40ed-b189-662849f5864e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:09.555930 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1251/2486] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:30:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:30:09.672850 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29daa8da-9f79-40a8-bd75-d89720fda84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:09.672850 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daa8da-9f79-40a8-bd75-d89720fda84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:09.672850 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daa8da-9f79-40a8-bd75-d89720fda84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:09.672850 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daa8da-9f79-40a8-bd75-d89720fda84c admin admin] PATH_INFO: `/v3/projects/21ae4154efbb49c3ae28f5f50625eab8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:09.673241 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29daa8da-9f79-40a8-bd75-d89720fda84c admin admin] RBAC: Authorizing `identity:delete_project(project_id=21ae4154efbb49c3ae28f5f50625eab8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:09.675516 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29daa8da-9f79-40a8-bd75-d89720fda84c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:09.739670 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:09.754788 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-29daa8da-9f79-40a8-bd75-d89720fda84c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21ae4154efbb49c3ae28f5f50625eab8', 'request_id': 'req-29daa8da-9f79-40a8-bd75-d89720fda84c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:09.768789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-29daa8da-9f79-40a8-bd75-d89720fda84c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21ae4154efbb49c3ae28f5f50625eab8', 'request_id': 'req-29daa8da-9f79-40a8-bd75-d89720fda84c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:09.778997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-29daa8da-9f79-40a8-bd75-d89720fda84c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21ae4154efbb49c3ae28f5f50625eab8', 'request_id': 'req-29daa8da-9f79-40a8-bd75-d89720fda84c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:09.792765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-29daa8da-9f79-40a8-bd75-d89720fda84c admin admin] The token cache is being invalidate because project 21ae4154efbb49c3ae28f5f50625eab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:30:09.793067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-29daa8da-9f79-40a8-bd75-d89720fda84c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:09.801986 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-29daa8da-9f79-40a8-bd75-d89720fda84c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:09.806672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1236/2487] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:30:09 2022] DELETE /identity/v3/projects/21ae4154efbb49c3ae28f5f50625eab8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:30:09.811589 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b8835-6bce-443a-ad69-950ecca0917f service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:09.813066 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-386b8835-6bce-443a-ad69-950ecca0917f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:09.835687 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b8835-6bce-443a-ad69-950ecca0917f service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:09.851194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:09.920157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f8758-268c-4ecd-8c94-e9a52f5c5d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:09.921476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f8758-268c-4ecd-8c94-e9a52f5c5d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:09.922155 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f8758-268c-4ecd-8c94-e9a52f5c5d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:09.922801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f8758-268c-4ecd-8c94-e9a52f5c5d08 admin admin] PATH_INFO: `/v3/users/519c50bdd05a4362b25fa3bb1602b54e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:09.924380 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f8758-268c-4ecd-8c94-e9a52f5c5d08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=519c50bdd05a4362b25fa3bb1602b54e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:09.926980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f8758-268c-4ecd-8c94-e9a52f5c5d08 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:09.940458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6d2a5-8f9b-4baa-b5c7-d82dd8f506e2 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:09.941061 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6d2a5-8f9b-4baa-b5c7-d82dd8f506e2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:09.941346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6d2a5-8f9b-4baa-b5c7-d82dd8f506e2 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:09.942845 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1237/2488] 10.222.0.40 () {54 vars in 921 bytes} [Thu Aug 11 16:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:30:09.949942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29f849-4b0b-482e-82f5-3f07e4ff0e2e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:09.950275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29f849-4b0b-482e-82f5-3f07e4ff0e2e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:09.950550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29f849-4b0b-482e-82f5-3f07e4ff0e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:09.978272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-dc29f849-4b0b-482e-82f5-3f07e4ff0e2e None None] MFA Rules not processed for user `16d2570f97234d62948762562616000c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:30:09.981205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dc29f849-4b0b-482e-82f5-3f07e4ff0e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:10.021761 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-928f8758-268c-4ecd-8c94-e9a52f5c5d08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '519c50bdd05a4362b25fa3bb1602b54e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:10.040724 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-928f8758-268c-4ecd-8c94-e9a52f5c5d08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '519c50bdd05a4362b25fa3bb1602b54e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:10.053882 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-928f8758-268c-4ecd-8c94-e9a52f5c5d08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '519c50bdd05a4362b25fa3bb1602b54e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:10.067322 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-928f8758-268c-4ecd-8c94-e9a52f5c5d08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '519c50bdd05a4362b25fa3bb1602b54e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:10.068157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-928f8758-268c-4ecd-8c94-e9a52f5c5d08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '519c50bdd05a4362b25fa3bb1602b54e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:10.073315 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1238/2489] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Aug 11 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:30:10.085376 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1252/2490] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:30:09 2022] DELETE /identity/v3/users/519c50bdd05a4362b25fa3bb1602b54e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:30:10.095142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29f849-4b0b-482e-82f5-3f07e4ff0e2e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:10.096658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dc29f849-4b0b-482e-82f5-3f07e4ff0e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:10.107723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29f849-4b0b-482e-82f5-3f07e4ff0e2e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:10.193605 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f640589-0a7a-4c03-9614-fd79e8c5632d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:10.195562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f640589-0a7a-4c03-9614-fd79e8c5632d service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:10.196103 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f640589-0a7a-4c03-9614-fd79e8c5632d service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:10.197476 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f640589-0a7a-4c03-9614-fd79e8c5632d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:10.200368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9f640589-0a7a-4c03-9614-fd79e8c5632d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:10.215920 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f640589-0a7a-4c03-9614-fd79e8c5632d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:10.217725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f640589-0a7a-4c03-9614-fd79e8c5632d service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:10.233247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1239/2491] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:30:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:30:10.320444 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f8758-268c-4ecd-8c94-e9a52f5c5d08 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:10.321949 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-928f8758-268c-4ecd-8c94-e9a52f5c5d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:10.405691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae94121-811b-4f12-842e-2ce6aac5a69f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:10.405982 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae94121-811b-4f12-842e-2ce6aac5a69f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:10.406262 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae94121-811b-4f12-842e-2ce6aac5a69f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:10.407835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1240/2492] 10.222.0.40 () {54 vars in 921 bytes} [Thu Aug 11 16:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:30:10.413416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e5a29-5eae-4529-b162-173f898713e8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:10.413695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e5a29-5eae-4529-b162-173f898713e8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:10.413964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e5a29-5eae-4529-b162-173f898713e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:10.443914 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e90e5a29-5eae-4529-b162-173f898713e8 None None] MFA Rules not processed for user `4e91f3fbe098459dba0acf8ec1fb7098`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:30:10.445561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e90e5a29-5eae-4529-b162-173f898713e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:10.450276 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f8758-268c-4ecd-8c94-e9a52f5c5d08 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:10.455535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259106b2-aedb-4cad-8220-3f1e23f5c813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:10.456158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259106b2-aedb-4cad-8220-3f1e23f5c813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:10.456720 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259106b2-aedb-4cad-8220-3f1e23f5c813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:10.457103 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259106b2-aedb-4cad-8220-3f1e23f5c813 admin admin] PATH_INFO: `/v3/projects/640e0b252a324c5f97d92c38eedb6b35` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:10.464160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259106b2-aedb-4cad-8220-3f1e23f5c813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=640e0b252a324c5f97d92c38eedb6b35)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:10.466429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259106b2-aedb-4cad-8220-3f1e23f5c813 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:10.526968 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:10.543742 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-259106b2-aedb-4cad-8220-3f1e23f5c813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '640e0b252a324c5f97d92c38eedb6b35', 'request_id': 'req-259106b2-aedb-4cad-8220-3f1e23f5c813'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:10.550855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-259106b2-aedb-4cad-8220-3f1e23f5c813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '640e0b252a324c5f97d92c38eedb6b35', 'request_id': 'req-259106b2-aedb-4cad-8220-3f1e23f5c813'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:10.557499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1241/2493] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Aug 11 16:30:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:30:10.568557 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-259106b2-aedb-4cad-8220-3f1e23f5c813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '640e0b252a324c5f97d92c38eedb6b35', 'request_id': 'req-259106b2-aedb-4cad-8220-3f1e23f5c813'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:10.573669 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e5a29-5eae-4529-b162-173f898713e8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:10.576081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e90e5a29-5eae-4529-b162-173f898713e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:10.594888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-259106b2-aedb-4cad-8220-3f1e23f5c813 admin admin] The token cache is being invalidate because project 640e0b252a324c5f97d92c38eedb6b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:30:10.595363 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-259106b2-aedb-4cad-8220-3f1e23f5c813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:10.596610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-259106b2-aedb-4cad-8220-3f1e23f5c813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:30:10.599235 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1253/2494] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:30:10 2022] DELETE /identity/v3/projects/640e0b252a324c5f97d92c38eedb6b35 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:30:10.601338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e5a29-5eae-4529-b162-173f898713e8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:10.606843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:10.687257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5391e-fb4b-4801-a1b2-9bf4f00bce12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:10.687979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5391e-fb4b-4801-a1b2-9bf4f00bce12 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:10.688274 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5391e-fb4b-4801-a1b2-9bf4f00bce12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:10.688527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5391e-fb4b-4801-a1b2-9bf4f00bce12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:10.690672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7ea5391e-fb4b-4801-a1b2-9bf4f00bce12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:10.829246 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5391e-fb4b-4801-a1b2-9bf4f00bce12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:10.831121 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5391e-fb4b-4801-a1b2-9bf4f00bce12 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:10.863096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1242/2495] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:30:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:30:11.846927 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46102748-75de-45a6-a17c-9ff61fe88180 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:11.847456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46102748-75de-45a6-a17c-9ff61fe88180 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:11.847563 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46102748-75de-45a6-a17c-9ff61fe88180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:11.897735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-46102748-75de-45a6-a17c-9ff61fe88180 None None] MFA Rules not processed for user `73f4899822d64aa0972702d6a1a735e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:30:11.904877 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-46102748-75de-45a6-a17c-9ff61fe88180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:11.987765 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1254/2496] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:30:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:30:19.718790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00b589-28ff-426a-91c8-c62d6c5554d4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:19.719298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00b589-28ff-426a-91c8-c62d6c5554d4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:19.719391 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00b589-28ff-426a-91c8-c62d6c5554d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:19.738242 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8b00b589-28ff-426a-91c8-c62d6c5554d4 None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:30:19.739422 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8b00b589-28ff-426a-91c8-c62d6c5554d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:19.796423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1243/2497] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Aug 11 16:30:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:30:19.809470 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46102748-75de-45a6-a17c-9ff61fe88180 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:19.810842 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-46102748-75de-45a6-a17c-9ff61fe88180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:19.878092 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46102748-75de-45a6-a17c-9ff61fe88180 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:19.883213 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc690c-506d-4b15-9d90-c4af30763e1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:19.883809 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc690c-506d-4b15-9d90-c4af30763e1f service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:19.884082 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc690c-506d-4b15-9d90-c4af30763e1f service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:19.884350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc690c-506d-4b15-9d90-c4af30763e1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:19.892404 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc690c-506d-4b15-9d90-c4af30763e1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:19.894395 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc690c-506d-4b15-9d90-c4af30763e1f service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:19.902802 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1255/2498] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:30:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:30:28.775903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00b589-28ff-426a-91c8-c62d6c5554d4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:28.779153 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8b00b589-28ff-426a-91c8-c62d6c5554d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:28.803595 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00b589-28ff-426a-91c8-c62d6c5554d4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:28.810814 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4674a07-7ccd-474b-9f6a-bf72eaa4e4aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:28.812490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4674a07-7ccd-474b-9f6a-bf72eaa4e4aa service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:28.812490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4674a07-7ccd-474b-9f6a-bf72eaa4e4aa service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:28.812490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4674a07-7ccd-474b-9f6a-bf72eaa4e4aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:28.813741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f4674a07-7ccd-474b-9f6a-bf72eaa4e4aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:28.891153 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:28.909354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4674a07-7ccd-474b-9f6a-bf72eaa4e4aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:28.911176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4674a07-7ccd-474b-9f6a-bf72eaa4e4aa service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:28.923378 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1244/2499] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:30:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:30:29.899634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=5,keystone:SELECT=68,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:33.637765 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04303519-4561-45d7-951d-56d3c59537ac None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:33.638352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04303519-4561-45d7-951d-56d3c59537ac None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:33.638571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04303519-4561-45d7-951d-56d3c59537ac None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:33.640095 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1256/2500] 10.222.0.40 () {54 vars in 921 bytes} [Thu Aug 11 16:30:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 16:30:33.645577 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cad53-9e6f-47bb-83d4-cc89035f4c2a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:33.646537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cad53-9e6f-47bb-83d4-cc89035f4c2a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:33.646984 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cad53-9e6f-47bb-83d4-cc89035f4c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:33.668622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-071cad53-9e6f-47bb-83d4-cc89035f4c2a None None] MFA Rules not processed for user `4e91f3fbe098459dba0acf8ec1fb7098`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:30:33.669763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-071cad53-9e6f-47bb-83d4-cc89035f4c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:33.680146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1245/2501] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Aug 11 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:30:33.692266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04303519-4561-45d7-951d-56d3c59537ac None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:33.694051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-04303519-4561-45d7-951d-56d3c59537ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:33.758061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04303519-4561-45d7-951d-56d3c59537ac None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:33.762299 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408218bd-8559-4fb4-b875-2bba667eba52 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9158ce9d8a4aadbf86405657958c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:33.762905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408218bd-8559-4fb4-b875-2bba667eba52 service glance] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:33.763181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408218bd-8559-4fb4-b875-2bba667eba52 service glance] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:33.763451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408218bd-8559-4fb4-b875-2bba667eba52 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:33.774905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408218bd-8559-4fb4-b875-2bba667eba52 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:33.776434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408218bd-8559-4fb4-b875-2bba667eba52 service glance] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:33.790245 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1257/2502] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:30:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:30:33.990767 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cad53-9e6f-47bb-83d4-cc89035f4c2a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:33.992282 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-071cad53-9e6f-47bb-83d4-cc89035f4c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:34.065326 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cad53-9e6f-47bb-83d4-cc89035f4c2a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:34.070326 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dabf8-0e50-4e2f-8075-ad63b626b406 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e1c7e6ee814b47912760cf7daf54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:34.071324 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dabf8-0e50-4e2f-8075-ad63b626b406 service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:34.071604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dabf8-0e50-4e2f-8075-ad63b626b406 service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:34.071873 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dabf8-0e50-4e2f-8075-ad63b626b406 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:34.073575 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cf9dabf8-0e50-4e2f-8075-ad63b626b406 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:34.086620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9dabf8-0e50-4e2f-8075-ad63b626b406 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:34.088205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9dabf8-0e50-4e2f-8075-ad63b626b406 service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:34.099021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1246/2503] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:30:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:30:34.832981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408218bd-8559-4fb4-b875-2bba667eba52 service glance] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:34.834451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-408218bd-8559-4fb4-b875-2bba667eba52 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:34.862852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408218bd-8559-4fb4-b875-2bba667eba52 service glance] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:34.871324 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4df82-71de-4ae3-a86b-22ebfb2299d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:34.872084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4df82-71de-4ae3-a86b-22ebfb2299d9 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:34.872465 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4df82-71de-4ae3-a86b-22ebfb2299d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:34.872873 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4df82-71de-4ae3-a86b-22ebfb2299d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:34.875402 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-87b4df82-71de-4ae3-a86b-22ebfb2299d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:34.897577 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dabf8-0e50-4e2f-8075-ad63b626b406 service placement] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:34.901402 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cf9dabf8-0e50-4e2f-8075-ad63b626b406 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:34.925339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dabf8-0e50-4e2f-8075-ad63b626b406 service placement] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:34.930594 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7460a25-4cd3-4f30-9f64-8a83db268f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:34.931327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7460a25-4cd3-4f30-9f64-8a83db268f16 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:34.931610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7460a25-4cd3-4f30-9f64-8a83db268f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:34.931885 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7460a25-4cd3-4f30-9f64-8a83db268f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:34.933821 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e7460a25-4cd3-4f30-9f64-8a83db268f16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:34.945885 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7460a25-4cd3-4f30-9f64-8a83db268f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:34.947515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7460a25-4cd3-4f30-9f64-8a83db268f16 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:34.955316 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4df82-71de-4ae3-a86b-22ebfb2299d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:34.957027 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4df82-71de-4ae3-a86b-22ebfb2299d9 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:34.960151 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1247/2504] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:30:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:30:34.984671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1258/2505] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:30:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:30:35.785613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ca149-7573-4dea-8d7a-9301f816c169 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:35.785902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ca149-7573-4dea-8d7a-9301f816c169 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:35.786181 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ca149-7573-4dea-8d7a-9301f816c169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:35.805746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-790ca149-7573-4dea-8d7a-9301f816c169 None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:30:35.806943 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-790ca149-7573-4dea-8d7a-9301f816c169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:35.814138 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1248/2506] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Aug 11 16:30:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:30:35.825957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4df82-71de-4ae3-a86b-22ebfb2299d9 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:35.837606 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4df82-71de-4ae3-a86b-22ebfb2299d9 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:35.842529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1fcb-3342-41fa-afce-844ba8f44fda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:35.843118 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1fcb-3342-41fa-afce-844ba8f44fda service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:35.843399 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1fcb-3342-41fa-afce-844ba8f44fda service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:35.843671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1fcb-3342-41fa-afce-844ba8f44fda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:35.852212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e1fcb-3342-41fa-afce-844ba8f44fda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:35.853851 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e1fcb-3342-41fa-afce-844ba8f44fda service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:35.861849 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1259/2507] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:30:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:30:45.800247 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=48 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:45.858605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=60 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:50.882571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecbf1c-9ffb-444b-a7ca-f9705734f055 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:50.883096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecbf1c-9ffb-444b-a7ca-f9705734f055 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:50.883096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecbf1c-9ffb-444b-a7ca-f9705734f055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:50.903666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7aecbf1c-9ffb-444b-a7ca-f9705734f055 None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:30:50.904884 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7aecbf1c-9ffb-444b-a7ca-f9705734f055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:50.912104 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1249/2508] 10.222.0.40 () {58 vars in 967 bytes} [Thu Aug 11 16:30:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:30:50.924576 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1fcb-3342-41fa-afce-844ba8f44fda service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:50.935559 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1fcb-3342-41fa-afce-844ba8f44fda service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:50.940498 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e908d6e-1927-49f9-86e7-4fc21a951e9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:50.941144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e908d6e-1927-49f9-86e7-4fc21a951e9b service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:50.941422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e908d6e-1927-49f9-86e7-4fc21a951e9b service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:50.941689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e908d6e-1927-49f9-86e7-4fc21a951e9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:50.949618 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e908d6e-1927-49f9-86e7-4fc21a951e9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:50.951182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e908d6e-1927-49f9-86e7-4fc21a951e9b service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:50.959236 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1260/2509] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:30:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:30:59.269284 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecbf1c-9ffb-444b-a7ca-f9705734f055 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:30:59.286668 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecbf1c-9ffb-444b-a7ca-f9705734f055 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:30:59.292341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9ea54-2d1b-4452-83b2-7fffa58badbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:30:59.293083 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9ea54-2d1b-4452-83b2-7fffa58badbb service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:30:59.293491 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9ea54-2d1b-4452-83b2-7fffa58badbb service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:30:59.293769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9ea54-2d1b-4452-83b2-7fffa58badbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:30:59.295515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d3c9ea54-2d1b-4452-83b2-7fffa58badbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:30:59.309151 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9ea54-2d1b-4452-83b2-7fffa58badbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:30:59.312523 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9ea54-2d1b-4452-83b2-7fffa58badbb service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:30:59.324860 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1250/2510] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:30:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:31:00.956041 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:04.036735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e908d6e-1927-49f9-86e7-4fc21a951e9b service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:04.046153 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e908d6e-1927-49f9-86e7-4fc21a951e9b service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:04.049772 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf077f38-c157-487a-a127-45bf13df4d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:04.050357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf077f38-c157-487a-a127-45bf13df4d1d service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:04.050636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf077f38-c157-487a-a127-45bf13df4d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:04.050909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf077f38-c157-487a-a127-45bf13df4d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:04.052663 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cf077f38-c157-487a-a127-45bf13df4d1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:04.114124 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf077f38-c157-487a-a127-45bf13df4d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:04.115538 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf077f38-c157-487a-a127-45bf13df4d1d service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:04.125488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1261/2511] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:07.461183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9ea54-2d1b-4452-83b2-7fffa58badbb service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:07.462575 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d3c9ea54-2d1b-4452-83b2-7fffa58badbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:07.479620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9ea54-2d1b-4452-83b2-7fffa58badbb service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:07.484892 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc3305-8019-4716-936e-9cf453bd8885 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e1c7e6ee814b47912760cf7daf54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:07.485490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc3305-8019-4716-936e-9cf453bd8885 service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:07.485769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc3305-8019-4716-936e-9cf453bd8885 service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:07.486043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc3305-8019-4716-936e-9cf453bd8885 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:07.487772 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-18cc3305-8019-4716-936e-9cf453bd8885 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:07.500083 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc3305-8019-4716-936e-9cf453bd8885 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:07.501685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc3305-8019-4716-936e-9cf453bd8885 service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:07.511564 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1251/2512] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:07.531874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf077f38-c157-487a-a127-45bf13df4d1d service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:07.533343 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cf077f38-c157-487a-a127-45bf13df4d1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:07.546035 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf077f38-c157-487a-a127-45bf13df4d1d service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:07.550978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bf71b-438e-4be7-a0f7-b3400eefe05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:07.551603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bf71b-438e-4be7-a0f7-b3400eefe05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:07.551878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bf71b-438e-4be7-a0f7-b3400eefe05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:07.552147 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bf71b-438e-4be7-a0f7-b3400eefe05b admin admin] PATH_INFO: `/v3/users/7b0f9418982c4a8e8ebd5cf4419c5418` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:07.553277 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bf71b-438e-4be7-a0f7-b3400eefe05b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0f9418982c4a8e8ebd5cf4419c5418)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:07.555783 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bf71b-438e-4be7-a0f7-b3400eefe05b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:07.604837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e6bf71b-438e-4be7-a0f7-b3400eefe05b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0f9418982c4a8e8ebd5cf4419c5418'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:07.616280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e6bf71b-438e-4be7-a0f7-b3400eefe05b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0f9418982c4a8e8ebd5cf4419c5418'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:07.625078 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e6bf71b-438e-4be7-a0f7-b3400eefe05b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0f9418982c4a8e8ebd5cf4419c5418'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:07.631949 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e6bf71b-438e-4be7-a0f7-b3400eefe05b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0f9418982c4a8e8ebd5cf4419c5418'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:07.632572 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e6bf71b-438e-4be7-a0f7-b3400eefe05b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0f9418982c4a8e8ebd5cf4419c5418'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:07.638472 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1262/2513] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:07 2022] DELETE /identity/v3/users/7b0f9418982c4a8e8ebd5cf4419c5418 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:07.806141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc3305-8019-4716-936e-9cf453bd8885 service placement] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:07.821999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc3305-8019-4716-936e-9cf453bd8885 service placement] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:07.878214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780baa72-8d9f-467d-84a5-12e2a4c23021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:07.878839 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780baa72-8d9f-467d-84a5-12e2a4c23021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:07.879118 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780baa72-8d9f-467d-84a5-12e2a4c23021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:07.879391 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780baa72-8d9f-467d-84a5-12e2a4c23021 admin admin] PATH_INFO: `/v3/projects/e86b8ea96eab4b46bd1c76c6dbe7f716` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:07.880512 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780baa72-8d9f-467d-84a5-12e2a4c23021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86b8ea96eab4b46bd1c76c6dbe7f716)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:07.882432 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780baa72-8d9f-467d-84a5-12e2a4c23021 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:07.927654 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-780baa72-8d9f-467d-84a5-12e2a4c23021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86b8ea96eab4b46bd1c76c6dbe7f716', 'request_id': 'req-780baa72-8d9f-467d-84a5-12e2a4c23021'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:07.935121 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-780baa72-8d9f-467d-84a5-12e2a4c23021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86b8ea96eab4b46bd1c76c6dbe7f716', 'request_id': 'req-780baa72-8d9f-467d-84a5-12e2a4c23021'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:07.941291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-780baa72-8d9f-467d-84a5-12e2a4c23021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86b8ea96eab4b46bd1c76c6dbe7f716', 'request_id': 'req-780baa72-8d9f-467d-84a5-12e2a4c23021'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:07.951587 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-780baa72-8d9f-467d-84a5-12e2a4c23021 admin admin] The token cache is being invalidate because project e86b8ea96eab4b46bd1c76c6dbe7f716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:07.951879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-780baa72-8d9f-467d-84a5-12e2a4c23021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:07.952512 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-780baa72-8d9f-467d-84a5-12e2a4c23021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:07.954063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1252/2514] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:07 2022] DELETE /identity/v3/projects/e86b8ea96eab4b46bd1c76c6dbe7f716 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:07.959041 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3cd74-415b-4f10-8c60-3fd08e6fccad None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:07.959352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3cd74-415b-4f10-8c60-3fd08e6fccad None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:07.959629 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3cd74-415b-4f10-8c60-3fd08e6fccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:07.985687 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-34b3cd74-415b-4f10-8c60-3fd08e6fccad None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:07.986893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-34b3cd74-415b-4f10-8c60-3fd08e6fccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:08.044726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1263/2515] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:08.052537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9638611-478b-4830-af73-7d6c3d0de144 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:08.052853 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9638611-478b-4830-af73-7d6c3d0de144 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:08.053123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9638611-478b-4830-af73-7d6c3d0de144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:08.072755 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b9638611-478b-4830-af73-7d6c3d0de144 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:08.073930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b9638611-478b-4830-af73-7d6c3d0de144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:08.081811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1253/2516] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:08.086560 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3cd74-415b-4f10-8c60-3fd08e6fccad None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:08.096295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3cd74-415b-4f10-8c60-3fd08e6fccad None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:08.100865 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b9f04-7cb8-4832-8772-a8453cc3dd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:08.101504 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b9f04-7cb8-4832-8772-a8453cc3dd33 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:08.101788 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b9f04-7cb8-4832-8772-a8453cc3dd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:08.102062 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b9f04-7cb8-4832-8772-a8453cc3dd33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:08.102704 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b9f04-7cb8-4832-8772-a8453cc3dd33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:31:08.103006 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b9f04-7cb8-4832-8772-a8453cc3dd33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:08.104603 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b9f04-7cb8-4832-8772-a8453cc3dd33 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:08.106020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:08.118635 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1264/2517] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:31:08.122534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9638611-478b-4830-af73-7d6c3d0de144 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:08.133571 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9638611-478b-4830-af73-7d6c3d0de144 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:08.138173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704a765-fb7f-40cb-95aa-8bb1b540fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:08.138787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704a765-fb7f-40cb-95aa-8bb1b540fbd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:08.139089 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704a765-fb7f-40cb-95aa-8bb1b540fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:08.139352 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704a765-fb7f-40cb-95aa-8bb1b540fbd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:08.139971 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704a765-fb7f-40cb-95aa-8bb1b540fbd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:08.141865 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704a765-fb7f-40cb-95aa-8bb1b540fbd1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:08.173187 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1254/2518] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:08 2022] POST /identity/v3/projects => generated 357 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:31:08.176216 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b9f04-7cb8-4832-8772-a8453cc3dd33 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:08.186510 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b9f04-7cb8-4832-8772-a8453cc3dd33 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:08.247085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc497a9-9f6e-434f-8521-4156a71b138e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:08.247693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc497a9-9f6e-434f-8521-4156a71b138e admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:08.247972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc497a9-9f6e-434f-8521-4156a71b138e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:08.248246 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc497a9-9f6e-434f-8521-4156a71b138e admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:08.248919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc497a9-9f6e-434f-8521-4156a71b138e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:08.250907 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc497a9-9f6e-434f-8521-4156a71b138e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:08.272552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1265/2519] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:08 2022] POST /identity/v3/users => generated 279 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:08.277078 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704a765-fb7f-40cb-95aa-8bb1b540fbd1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:08.287616 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704a765-fb7f-40cb-95aa-8bb1b540fbd1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:08.293261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431ce7d-f03a-4e5e-9a68-9259b5d8d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:08.294224 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431ce7d-f03a-4e5e-9a68-9259b5d8d782 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:08.294717 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431ce7d-f03a-4e5e-9a68-9259b5d8d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:08.295174 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431ce7d-f03a-4e5e-9a68-9259b5d8d782 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:08.296114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431ce7d-f03a-4e5e-9a68-9259b5d8d782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:08.298421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431ce7d-f03a-4e5e-9a68-9259b5d8d782 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:08.309893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1255/2520] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:31:08.313936 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc497a9-9f6e-434f-8521-4156a71b138e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:08.329025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc497a9-9f6e-434f-8521-4156a71b138e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:08.334834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c91c2a-8655-487c-9f55-77939e21b298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:08.335447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c91c2a-8655-487c-9f55-77939e21b298 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:08.335742 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c91c2a-8655-487c-9f55-77939e21b298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:08.336036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c91c2a-8655-487c-9f55-77939e21b298 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:08.336739 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c91c2a-8655-487c-9f55-77939e21b298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:08.338619 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c91c2a-8655-487c-9f55-77939e21b298 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:08.350128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1266/2521] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:08.354910 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431ce7d-f03a-4e5e-9a68-9259b5d8d782 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:08.365927 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431ce7d-f03a-4e5e-9a68-9259b5d8d782 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:08.371479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd1be8-a87a-43a8-a5a5-cd1e642aa22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:08.372339 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd1be8-a87a-43a8-a5a5-cd1e642aa22e admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:08.372822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd1be8-a87a-43a8-a5a5-cd1e642aa22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:08.373094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd1be8-a87a-43a8-a5a5-cd1e642aa22e admin admin] PATH_INFO: `/v3/projects/88277cfcc4d946b1b7e585b3948348c7/users/b3f52b0eca814101a543ddf25a5d2a3d/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:08.389107 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd1be8-a87a-43a8-a5a5-cd1e642aa22e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88277cfcc4d946b1b7e585b3948348c7, user_id=b3f52b0eca814101a543ddf25a5d2a3d, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:08.391744 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd1be8-a87a-43a8-a5a5-cd1e642aa22e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:08.393973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:08.407877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1256/2522] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:08 2022] PUT /identity/v3/projects/88277cfcc4d946b1b7e585b3948348c7/users/b3f52b0eca814101a543ddf25a5d2a3d/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:08.418941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0b5fa-84db-4c5e-9ef0-713f51ae9048 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:08.419339 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0b5fa-84db-4c5e-9ef0-713f51ae9048 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:08.419919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0b5fa-84db-4c5e-9ef0-713f51ae9048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:08.454797 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-86c0b5fa-84db-4c5e-9ef0-713f51ae9048 None None] MFA Rules not processed for user `b3f52b0eca814101a543ddf25a5d2a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:08.456007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-86c0b5fa-84db-4c5e-9ef0-713f51ae9048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:08.522915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1267/2523] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:08.528786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd1be8-a87a-43a8-a5a5-cd1e642aa22e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:08.595263 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd1be8-a87a-43a8-a5a5-cd1e642aa22e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:08.600868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dd23d-c8a7-4c8c-bf7b-a001aaeb5453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:08.602283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dd23d-c8a7-4c8c-bf7b-a001aaeb5453 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:08.602565 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dd23d-c8a7-4c8c-bf7b-a001aaeb5453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:08.602840 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dd23d-c8a7-4c8c-bf7b-a001aaeb5453 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:08.603487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53dd23d-c8a7-4c8c-bf7b-a001aaeb5453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:08.605441 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53dd23d-c8a7-4c8c-bf7b-a001aaeb5453 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:08.640760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1257/2524] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:08 2022] POST /identity/v3/projects => generated 357 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:08.642201 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0b5fa-84db-4c5e-9ef0-713f51ae9048 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:08.654485 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0b5fa-84db-4c5e-9ef0-713f51ae9048 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:08.725232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edff01-aaf1-4edf-a37b-14f53b18d458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:08.725929 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edff01-aaf1-4edf-a37b-14f53b18d458 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:08.726251 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edff01-aaf1-4edf-a37b-14f53b18d458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:08.727082 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edff01-aaf1-4edf-a37b-14f53b18d458 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:08.727746 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edff01-aaf1-4edf-a37b-14f53b18d458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:08.729750 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edff01-aaf1-4edf-a37b-14f53b18d458 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:08.738905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:08.752632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1268/2525] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:08 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:08.755348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dd23d-c8a7-4c8c-bf7b-a001aaeb5453 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:08.765460 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dd23d-c8a7-4c8c-bf7b-a001aaeb5453 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:08.770010 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eedb68-5f5f-41e5-87c1-1267dcd9c961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:08.770802 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eedb68-5f5f-41e5-87c1-1267dcd9c961 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:08.771077 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eedb68-5f5f-41e5-87c1-1267dcd9c961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:08.771346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eedb68-5f5f-41e5-87c1-1267dcd9c961 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:08.771973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eedb68-5f5f-41e5-87c1-1267dcd9c961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:08.774156 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eedb68-5f5f-41e5-87c1-1267dcd9c961 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:08.784945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1258/2526] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:08.789794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edff01-aaf1-4edf-a37b-14f53b18d458 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:08.799941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edff01-aaf1-4edf-a37b-14f53b18d458 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:08.804685 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad12362-2ece-4108-a9ee-fa5969aca6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:08.805328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad12362-2ece-4108-a9ee-fa5969aca6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:08.805610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad12362-2ece-4108-a9ee-fa5969aca6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:08.805892 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad12362-2ece-4108-a9ee-fa5969aca6ea admin admin] PATH_INFO: `/v3/projects/e1ad08b7aaf84dc0a462354af1263aa8/users/73ec1e642c714666b171421cc040bcd0/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:08.821821 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad12362-2ece-4108-a9ee-fa5969aca6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ad08b7aaf84dc0a462354af1263aa8, user_id=73ec1e642c714666b171421cc040bcd0, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:08.824488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad12362-2ece-4108-a9ee-fa5969aca6ea admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:08.838246 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1269/2527] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:08 2022] PUT /identity/v3/projects/e1ad08b7aaf84dc0a462354af1263aa8/users/73ec1e642c714666b171421cc040bcd0/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:08.843082 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eedb68-5f5f-41e5-87c1-1267dcd9c961 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:08.853300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eedb68-5f5f-41e5-87c1-1267dcd9c961 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:08.910690 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51a801-5cdd-4001-bcc4-ea59e845eded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:08.911298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51a801-5cdd-4001-bcc4-ea59e845eded admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:08.911599 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51a801-5cdd-4001-bcc4-ea59e845eded admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:08.911883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51a801-5cdd-4001-bcc4-ea59e845eded admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:08.912503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51a801-5cdd-4001-bcc4-ea59e845eded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:08.914196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51a801-5cdd-4001-bcc4-ea59e845eded admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:08.923878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1259/2528] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:08.928208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad12362-2ece-4108-a9ee-fa5969aca6ea admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:08.938938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad12362-2ece-4108-a9ee-fa5969aca6ea admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:08.944183 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd5ba0-766c-4bf9-a35d-d86baa3f1e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:08.944946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd5ba0-766c-4bf9-a35d-d86baa3f1e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:08.945789 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd5ba0-766c-4bf9-a35d-d86baa3f1e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:08.946123 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd5ba0-766c-4bf9-a35d-d86baa3f1e27 admin admin] PATH_INFO: `/v3/projects/e1ad08b7aaf84dc0a462354af1263aa8/users/73ec1e642c714666b171421cc040bcd0/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:08.948649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd5ba0-766c-4bf9-a35d-d86baa3f1e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ad08b7aaf84dc0a462354af1263aa8, user_id=73ec1e642c714666b171421cc040bcd0, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:08.952212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd5ba0-766c-4bf9-a35d-d86baa3f1e27 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:08.965441 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1270/2529] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:08 2022] PUT /identity/v3/projects/e1ad08b7aaf84dc0a462354af1263aa8/users/73ec1e642c714666b171421cc040bcd0/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:31:08.980397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c71681-bb94-4126-8f80-0b010244f1a1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:08.980818 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c71681-bb94-4126-8f80-0b010244f1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:08.981172 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c71681-bb94-4126-8f80-0b010244f1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:09.013436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-46c71681-bb94-4126-8f80-0b010244f1a1 None None] MFA Rules not processed for user `73ec1e642c714666b171421cc040bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:09.014687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-46c71681-bb94-4126-8f80-0b010244f1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:09.066094 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:09.086627 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1260/2530] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:09.098220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd5ba0-766c-4bf9-a35d-d86baa3f1e27 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:09.100006 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f5fd5ba0-766c-4bf9-a35d-d86baa3f1e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:09.160864 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd5ba0-766c-4bf9-a35d-d86baa3f1e27 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:09.164660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772e5df-6830-466f-bfda-67784824a9a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:09.165270 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772e5df-6830-466f-bfda-67784824a9a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:09.165545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772e5df-6830-466f-bfda-67784824a9a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:09.165814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772e5df-6830-466f-bfda-67784824a9a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:09.175364 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772e5df-6830-466f-bfda-67784824a9a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:09.177072 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772e5df-6830-466f-bfda-67784824a9a4 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:09.189493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1271/2531] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:09.268358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c71681-bb94-4126-8f80-0b010244f1a1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:09.279118 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c71681-bb94-4126-8f80-0b010244f1a1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:09.283342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e95c6e-b99e-40b7-9caf-14d53713cb1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:09.284102 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e95c6e-b99e-40b7-9caf-14d53713cb1f service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:09.284381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e95c6e-b99e-40b7-9caf-14d53713cb1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:09.284710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e95c6e-b99e-40b7-9caf-14d53713cb1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:09.350460 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e95c6e-b99e-40b7-9caf-14d53713cb1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:09.351921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e95c6e-b99e-40b7-9caf-14d53713cb1f service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:09.360759 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1261/2532] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:09.531215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261852a6-c142-43db-acb0-0e7bdae389df None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:09.531500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261852a6-c142-43db-acb0-0e7bdae389df None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:09.531774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261852a6-c142-43db-acb0-0e7bdae389df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:09.550866 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-261852a6-c142-43db-acb0-0e7bdae389df None None] MFA Rules not processed for user `73f4899822d64aa0972702d6a1a735e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:09.552083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-261852a6-c142-43db-acb0-0e7bdae389df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:09.608422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1272/2533] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:09.903243 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e95c6e-b99e-40b7-9caf-14d53713cb1f service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:09.904701 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a7e95c6e-b99e-40b7-9caf-14d53713cb1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:09.962296 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e95c6e-b99e-40b7-9caf-14d53713cb1f service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:09.967261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a385b-4201-48d9-bc88-640ac3151f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:09.967863 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a385b-4201-48d9-bc88-640ac3151f0d service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:09.968141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a385b-4201-48d9-bc88-640ac3151f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:09.968409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a385b-4201-48d9-bc88-640ac3151f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:09.970168 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5e0a385b-4201-48d9-bc88-640ac3151f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:09.980176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a385b-4201-48d9-bc88-640ac3151f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:09.981933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a385b-4201-48d9-bc88-640ac3151f0d service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:09.990178 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1262/2534] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:17.151064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261852a6-c142-43db-acb0-0e7bdae389df None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:17.153024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-261852a6-c142-43db-acb0-0e7bdae389df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:17.239157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:17.274327 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261852a6-c142-43db-acb0-0e7bdae389df None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:17.283516 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd810656-34d8-435d-94d6-390d8cbb5984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:17.284268 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd810656-34d8-435d-94d6-390d8cbb5984 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:17.284809 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd810656-34d8-435d-94d6-390d8cbb5984 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:17.285291 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd810656-34d8-435d-94d6-390d8cbb5984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:17.287818 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bd810656-34d8-435d-94d6-390d8cbb5984 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:17.302492 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd810656-34d8-435d-94d6-390d8cbb5984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:17.304180 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd810656-34d8-435d-94d6-390d8cbb5984 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:17.316520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1273/2535] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:19.986507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=59 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:20.735917 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a385b-4201-48d9-bc88-640ac3151f0d service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:20.737402 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5e0a385b-4201-48d9-bc88-640ac3151f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:20.753349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a385b-4201-48d9-bc88-640ac3151f0d service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:20.759731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706ec72-5b04-45c9-b849-2fd285e6fd98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:20.760318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706ec72-5b04-45c9-b849-2fd285e6fd98 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:20.760614 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706ec72-5b04-45c9-b849-2fd285e6fd98 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:20.760893 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706ec72-5b04-45c9-b849-2fd285e6fd98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:20.762565 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2706ec72-5b04-45c9-b849-2fd285e6fd98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:20.774983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706ec72-5b04-45c9-b849-2fd285e6fd98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:20.776576 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706ec72-5b04-45c9-b849-2fd285e6fd98 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:20.787379 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1263/2536] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:24.221695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd810656-34d8-435d-94d6-390d8cbb5984 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:24.283279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd810656-34d8-435d-94d6-390d8cbb5984 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:24.287771 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6cf19-72b0-402f-901d-ba46ec805d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:24.288381 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6cf19-72b0-402f-901d-ba46ec805d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:24.288687 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6cf19-72b0-402f-901d-ba46ec805d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:24.288957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6cf19-72b0-402f-901d-ba46ec805d5b admin admin] PATH_INFO: `/v3/users/b3f52b0eca814101a543ddf25a5d2a3d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:24.290104 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6cf19-72b0-402f-901d-ba46ec805d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f52b0eca814101a543ddf25a5d2a3d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:24.292014 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6cf19-72b0-402f-901d-ba46ec805d5b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:24.338697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-33f6cf19-72b0-402f-901d-ba46ec805d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f52b0eca814101a543ddf25a5d2a3d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:24.351201 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-33f6cf19-72b0-402f-901d-ba46ec805d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f52b0eca814101a543ddf25a5d2a3d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:24.358389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-33f6cf19-72b0-402f-901d-ba46ec805d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f52b0eca814101a543ddf25a5d2a3d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:24.365161 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-33f6cf19-72b0-402f-901d-ba46ec805d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f52b0eca814101a543ddf25a5d2a3d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:24.365807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-33f6cf19-72b0-402f-901d-ba46ec805d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f52b0eca814101a543ddf25a5d2a3d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:24.372067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1274/2537] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:24 2022] DELETE /identity/v3/users/b3f52b0eca814101a543ddf25a5d2a3d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:24.376572 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a102c-778b-49c9-8542-12dbc3f31040 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:24.377058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a102c-778b-49c9-8542-12dbc3f31040 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:24.377183 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a102c-778b-49c9-8542-12dbc3f31040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:24.395977 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-774a102c-778b-49c9-8542-12dbc3f31040 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:24.397185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-774a102c-778b-49c9-8542-12dbc3f31040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:24.454856 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1264/2538] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:24.464341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6cf19-72b0-402f-901d-ba46ec805d5b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:24.465765 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-33f6cf19-72b0-402f-901d-ba46ec805d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:24.525314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6cf19-72b0-402f-901d-ba46ec805d5b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:24.529276 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266e6fe-16f4-47b9-97b3-1497ea32c631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:24.529874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266e6fe-16f4-47b9-97b3-1497ea32c631 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:24.530157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266e6fe-16f4-47b9-97b3-1497ea32c631 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:24.530422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266e6fe-16f4-47b9-97b3-1497ea32c631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:24.539753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266e6fe-16f4-47b9-97b3-1497ea32c631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:24.541278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266e6fe-16f4-47b9-97b3-1497ea32c631 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:24.550475 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1275/2539] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:24.818848 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a102c-778b-49c9-8542-12dbc3f31040 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:24.820346 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-774a102c-778b-49c9-8542-12dbc3f31040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:24.832294 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a102c-778b-49c9-8542-12dbc3f31040 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:24.836925 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109d44b-5354-42ad-82ab-0b29b104c929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:24.837553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109d44b-5354-42ad-82ab-0b29b104c929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:24.837832 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109d44b-5354-42ad-82ab-0b29b104c929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:24.838103 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109d44b-5354-42ad-82ab-0b29b104c929 admin admin] PATH_INFO: `/v3/projects/88277cfcc4d946b1b7e585b3948348c7` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:24.839207 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109d44b-5354-42ad-82ab-0b29b104c929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88277cfcc4d946b1b7e585b3948348c7)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:24.841145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109d44b-5354-42ad-82ab-0b29b104c929 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:24.892354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f109d44b-5354-42ad-82ab-0b29b104c929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88277cfcc4d946b1b7e585b3948348c7', 'request_id': 'req-f109d44b-5354-42ad-82ab-0b29b104c929'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:24.899729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f109d44b-5354-42ad-82ab-0b29b104c929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88277cfcc4d946b1b7e585b3948348c7', 'request_id': 'req-f109d44b-5354-42ad-82ab-0b29b104c929'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:24.906655 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f109d44b-5354-42ad-82ab-0b29b104c929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88277cfcc4d946b1b7e585b3948348c7', 'request_id': 'req-f109d44b-5354-42ad-82ab-0b29b104c929'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:24.917508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f109d44b-5354-42ad-82ab-0b29b104c929 admin admin] The token cache is being invalidate because project 88277cfcc4d946b1b7e585b3948348c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:24.917797 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f109d44b-5354-42ad-82ab-0b29b104c929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:24.918423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f109d44b-5354-42ad-82ab-0b29b104c929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:24.919902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1265/2540] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:24 2022] DELETE /identity/v3/projects/88277cfcc4d946b1b7e585b3948348c7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:24.924132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266e6fe-16f4-47b9-97b3-1497ea32c631 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:24.933734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266e6fe-16f4-47b9-97b3-1497ea32c631 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:24.938218 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:24.992396 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e6119-fa92-424d-a227-6b122b75b1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:24.992943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e6119-fa92-424d-a227-6b122b75b1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:24.993215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e6119-fa92-424d-a227-6b122b75b1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:24.993481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e6119-fa92-424d-a227-6b122b75b1ac admin admin] PATH_INFO: `/v3/users/73ec1e642c714666b171421cc040bcd0` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:24.994599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e6119-fa92-424d-a227-6b122b75b1ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ec1e642c714666b171421cc040bcd0)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:24.996529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e6119-fa92-424d-a227-6b122b75b1ac admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:25.040479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-402e6119-fa92-424d-a227-6b122b75b1ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ec1e642c714666b171421cc040bcd0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:25.052185 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-402e6119-fa92-424d-a227-6b122b75b1ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ec1e642c714666b171421cc040bcd0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:25.059543 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-402e6119-fa92-424d-a227-6b122b75b1ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ec1e642c714666b171421cc040bcd0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:25.067187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-402e6119-fa92-424d-a227-6b122b75b1ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ec1e642c714666b171421cc040bcd0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:25.068249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-402e6119-fa92-424d-a227-6b122b75b1ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ec1e642c714666b171421cc040bcd0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:25.075665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1276/2541] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:24 2022] DELETE /identity/v3/users/73ec1e642c714666b171421cc040bcd0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:31:25.351536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109d44b-5354-42ad-82ab-0b29b104c929 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:25.353093 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f109d44b-5354-42ad-82ab-0b29b104c929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:25.367597 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109d44b-5354-42ad-82ab-0b29b104c929 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:25.425513 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d8f96-6164-493d-a070-9ecc78010c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:25.426209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8f96-6164-493d-a070-9ecc78010c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:25.426401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8f96-6164-493d-a070-9ecc78010c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:25.426672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8f96-6164-493d-a070-9ecc78010c04 admin admin] PATH_INFO: `/v3/projects/e1ad08b7aaf84dc0a462354af1263aa8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:25.427809 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d8f96-6164-493d-a070-9ecc78010c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ad08b7aaf84dc0a462354af1263aa8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:25.429782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d8f96-6164-493d-a070-9ecc78010c04 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:25.441774 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:25.481145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e49d8f96-6164-493d-a070-9ecc78010c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ad08b7aaf84dc0a462354af1263aa8', 'request_id': 'req-e49d8f96-6164-493d-a070-9ecc78010c04'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:25.488562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e49d8f96-6164-493d-a070-9ecc78010c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ad08b7aaf84dc0a462354af1263aa8', 'request_id': 'req-e49d8f96-6164-493d-a070-9ecc78010c04'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:25.495157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e49d8f96-6164-493d-a070-9ecc78010c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ad08b7aaf84dc0a462354af1263aa8', 'request_id': 'req-e49d8f96-6164-493d-a070-9ecc78010c04'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:25.505904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e49d8f96-6164-493d-a070-9ecc78010c04 admin admin] The token cache is being invalidate because project e1ad08b7aaf84dc0a462354af1263aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:25.506194 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e49d8f96-6164-493d-a070-9ecc78010c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:25.506823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e49d8f96-6164-493d-a070-9ecc78010c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:25.508846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1266/2542] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:25 2022] DELETE /identity/v3/projects/e1ad08b7aaf84dc0a462354af1263aa8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:25.513678 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93478280-30a4-42cb-b2c4-8d9d231f34b8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:25.514160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93478280-30a4-42cb-b2c4-8d9d231f34b8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:25.514261 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93478280-30a4-42cb-b2c4-8d9d231f34b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:25.534547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-93478280-30a4-42cb-b2c4-8d9d231f34b8 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:25.535684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-93478280-30a4-42cb-b2c4-8d9d231f34b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:25.592678 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1277/2543] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:31:25.600389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b299f-62c7-45d9-831f-8f03252913f9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:25.600693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b299f-62c7-45d9-831f-8f03252913f9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:25.600964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b299f-62c7-45d9-831f-8f03252913f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:25.621215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b36b299f-62c7-45d9-831f-8f03252913f9 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:25.622400 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b36b299f-62c7-45d9-831f-8f03252913f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:25.630136 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1267/2544] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:25.634201 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93478280-30a4-42cb-b2c4-8d9d231f34b8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:25.643757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93478280-30a4-42cb-b2c4-8d9d231f34b8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:25.648245 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff79ea-4d0d-4f0d-85c7-08f54b7d2aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:25.649369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff79ea-4d0d-4f0d-85c7-08f54b7d2aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:25.649643 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff79ea-4d0d-4f0d-85c7-08f54b7d2aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:25.649912 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff79ea-4d0d-4f0d-85c7-08f54b7d2aa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:25.650561 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff79ea-4d0d-4f0d-85c7-08f54b7d2aa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:31:25.650855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff79ea-4d0d-4f0d-85c7-08f54b7d2aa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:25.652708 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff79ea-4d0d-4f0d-85c7-08f54b7d2aa6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:25.663840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1278/2545] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:31:25.667840 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b299f-62c7-45d9-831f-8f03252913f9 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:25.677030 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b299f-62c7-45d9-831f-8f03252913f9 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:25.682362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c018cb-ee4d-423e-aff0-4415d2712226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:25.683049 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c018cb-ee4d-423e-aff0-4415d2712226 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:25.683354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c018cb-ee4d-423e-aff0-4415d2712226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:25.683642 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c018cb-ee4d-423e-aff0-4415d2712226 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:25.684272 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c018cb-ee4d-423e-aff0-4415d2712226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:25.686331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c018cb-ee4d-423e-aff0-4415d2712226 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:25.713058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1268/2546] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:25 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:31:25.717421 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff79ea-4d0d-4f0d-85c7-08f54b7d2aa6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:25.727346 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff79ea-4d0d-4f0d-85c7-08f54b7d2aa6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:25.738556 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:25.785331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03317e3-a547-4798-88c7-becb91728190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:25.785856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03317e3-a547-4798-88c7-becb91728190 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:25.786131 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03317e3-a547-4798-88c7-becb91728190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:25.786400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03317e3-a547-4798-88c7-becb91728190 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:25.787007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03317e3-a547-4798-88c7-becb91728190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:25.788934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03317e3-a547-4798-88c7-becb91728190 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:25.809646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1279/2547] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:25 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:25.814011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c018cb-ee4d-423e-aff0-4415d2712226 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:25.824857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c018cb-ee4d-423e-aff0-4415d2712226 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:25.829452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80583ddf-5bbd-4536-a205-e2c0169eeccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:25.830038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80583ddf-5bbd-4536-a205-e2c0169eeccf admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:25.830316 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80583ddf-5bbd-4536-a205-e2c0169eeccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:25.830590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80583ddf-5bbd-4536-a205-e2c0169eeccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:25.831220 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80583ddf-5bbd-4536-a205-e2c0169eeccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:25.832837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80583ddf-5bbd-4536-a205-e2c0169eeccf admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:25.842478 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1269/2548] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:25.846228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03317e3-a547-4798-88c7-becb91728190 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:25.855941 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03317e3-a547-4798-88c7-becb91728190 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:25.860443 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed0db0-b1e4-459a-8448-427ba2ffc7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:25.861063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed0db0-b1e4-459a-8448-427ba2ffc7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:25.861343 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed0db0-b1e4-459a-8448-427ba2ffc7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:25.861615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed0db0-b1e4-459a-8448-427ba2ffc7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:25.862252 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed0db0-b1e4-459a-8448-427ba2ffc7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:25.863827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed0db0-b1e4-459a-8448-427ba2ffc7c4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:25.874577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1280/2549] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:25.878403 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80583ddf-5bbd-4536-a205-e2c0169eeccf admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:25.888715 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80583ddf-5bbd-4536-a205-e2c0169eeccf admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:25.893244 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d861b9-f19a-4528-ae07-0360c4e70b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:25.893870 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d861b9-f19a-4528-ae07-0360c4e70b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:25.894146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d861b9-f19a-4528-ae07-0360c4e70b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:25.894416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d861b9-f19a-4528-ae07-0360c4e70b4f admin admin] PATH_INFO: `/v3/projects/046b73834b0c4dfd8962eb09c87da288/users/9d58fd5bc2d3437cbc348555b67a7cb0/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:25.909344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d861b9-f19a-4528-ae07-0360c4e70b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=046b73834b0c4dfd8962eb09c87da288, user_id=9d58fd5bc2d3437cbc348555b67a7cb0, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:25.912335 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d861b9-f19a-4528-ae07-0360c4e70b4f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:25.926119 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1270/2550] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:25 2022] PUT /identity/v3/projects/046b73834b0c4dfd8962eb09c87da288/users/9d58fd5bc2d3437cbc348555b67a7cb0/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:31:25.938253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf27a8-6017-4ad2-a2e4-ac1d8d97d4da None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:25.938538 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf27a8-6017-4ad2-a2e4-ac1d8d97d4da None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:25.938811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf27a8-6017-4ad2-a2e4-ac1d8d97d4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:25.967095 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-32bf27a8-6017-4ad2-a2e4-ac1d8d97d4da None None] MFA Rules not processed for user `9d58fd5bc2d3437cbc348555b67a7cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:25.968474 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-32bf27a8-6017-4ad2-a2e4-ac1d8d97d4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:26.034970 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1281/2551] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:26.039994 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d861b9-f19a-4528-ae07-0360c4e70b4f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:26.102891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d861b9-f19a-4528-ae07-0360c4e70b4f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:26.107626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d2b24-59ce-4646-a88f-65fcd5d606a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:26.108223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d2b24-59ce-4646-a88f-65fcd5d606a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:26.108507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d2b24-59ce-4646-a88f-65fcd5d606a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:26.108814 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d2b24-59ce-4646-a88f-65fcd5d606a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:26.109433 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d2b24-59ce-4646-a88f-65fcd5d606a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:26.111341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d2b24-59ce-4646-a88f-65fcd5d606a3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:26.137975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1271/2552] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:26 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:26.142116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf27a8-6017-4ad2-a2e4-ac1d8d97d4da None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:26.154059 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf27a8-6017-4ad2-a2e4-ac1d8d97d4da None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:26.216976 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94028be-7d84-45d4-8315-28f871602464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:26.217589 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94028be-7d84-45d4-8315-28f871602464 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:26.217901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94028be-7d84-45d4-8315-28f871602464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:26.218174 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94028be-7d84-45d4-8315-28f871602464 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:26.218814 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94028be-7d84-45d4-8315-28f871602464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:26.220766 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94028be-7d84-45d4-8315-28f871602464 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:26.243554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1282/2553] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:26 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:31:26.247455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d2b24-59ce-4646-a88f-65fcd5d606a3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:26.258695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d2b24-59ce-4646-a88f-65fcd5d606a3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:26.263338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c5182-dd57-46e1-9a98-6923587fbd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:26.263966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c5182-dd57-46e1-9a98-6923587fbd33 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:26.264245 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c5182-dd57-46e1-9a98-6923587fbd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:26.264546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c5182-dd57-46e1-9a98-6923587fbd33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:26.265214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c5182-dd57-46e1-9a98-6923587fbd33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:26.266818 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c5182-dd57-46e1-9a98-6923587fbd33 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:26.278685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1272/2554] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:26.282659 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94028be-7d84-45d4-8315-28f871602464 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:26.293781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94028be-7d84-45d4-8315-28f871602464 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:26.300696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1be2b4-85d5-4c07-aeae-03234287e117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:26.301365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1be2b4-85d5-4c07-aeae-03234287e117 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:26.301644 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1be2b4-85d5-4c07-aeae-03234287e117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:26.301920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1be2b4-85d5-4c07-aeae-03234287e117 admin admin] PATH_INFO: `/v3/projects/92efd5c2e61848b38bd16212d35f309b/users/5b7c11c0c7a345f88415ac6db5d549a4/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:26.314155 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:26.321298 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1be2b4-85d5-4c07-aeae-03234287e117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92efd5c2e61848b38bd16212d35f309b, user_id=5b7c11c0c7a345f88415ac6db5d549a4, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:26.323989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1be2b4-85d5-4c07-aeae-03234287e117 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:26.337487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1283/2555] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:26 2022] PUT /identity/v3/projects/92efd5c2e61848b38bd16212d35f309b/users/5b7c11c0c7a345f88415ac6db5d549a4/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:26.341541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c5182-dd57-46e1-9a98-6923587fbd33 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:26.352691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c5182-dd57-46e1-9a98-6923587fbd33 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:26.359762 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:26.412683 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d44a1-f6b1-4a40-916f-2a85c3cb4c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:26.413286 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d44a1-f6b1-4a40-916f-2a85c3cb4c5e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:26.413568 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d44a1-f6b1-4a40-916f-2a85c3cb4c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:26.413843 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d44a1-f6b1-4a40-916f-2a85c3cb4c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:26.414518 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d44a1-f6b1-4a40-916f-2a85c3cb4c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:26.416111 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d44a1-f6b1-4a40-916f-2a85c3cb4c5e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:26.425707 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1273/2556] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:31:26.430391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1be2b4-85d5-4c07-aeae-03234287e117 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:26.440400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1be2b4-85d5-4c07-aeae-03234287e117 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:26.444955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3d569-23ab-4769-87b0-6edd7713afd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:26.446151 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3d569-23ab-4769-87b0-6edd7713afd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:26.446425 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3d569-23ab-4769-87b0-6edd7713afd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:26.446696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3d569-23ab-4769-87b0-6edd7713afd0 admin admin] PATH_INFO: `/v3/projects/92efd5c2e61848b38bd16212d35f309b/users/5b7c11c0c7a345f88415ac6db5d549a4/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:26.448644 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3d569-23ab-4769-87b0-6edd7713afd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92efd5c2e61848b38bd16212d35f309b, user_id=5b7c11c0c7a345f88415ac6db5d549a4, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:26.451297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3d569-23ab-4769-87b0-6edd7713afd0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:26.461134 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1284/2557] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:26 2022] PUT /identity/v3/projects/92efd5c2e61848b38bd16212d35f309b/users/5b7c11c0c7a345f88415ac6db5d549a4/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:26.471255 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a52bad-3c1b-47c9-a0c9-fcd72911dae1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:26.471547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a52bad-3c1b-47c9-a0c9-fcd72911dae1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:26.471831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a52bad-3c1b-47c9-a0c9-fcd72911dae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:26.499560 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e9a52bad-3c1b-47c9-a0c9-fcd72911dae1 None None] MFA Rules not processed for user `5b7c11c0c7a345f88415ac6db5d549a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:26.500978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e9a52bad-3c1b-47c9-a0c9-fcd72911dae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:26.566916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1274/2558] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:26.578393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3d569-23ab-4769-87b0-6edd7713afd0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:26.580179 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f4d3d569-23ab-4769-87b0-6edd7713afd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:26.637414 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3d569-23ab-4769-87b0-6edd7713afd0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:26.640999 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd4bbf-9224-44ac-a640-ff75d7cd783b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:26.641583 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd4bbf-9224-44ac-a640-ff75d7cd783b service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:26.641859 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd4bbf-9224-44ac-a640-ff75d7cd783b service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:26.642127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd4bbf-9224-44ac-a640-ff75d7cd783b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:26.650684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd4bbf-9224-44ac-a640-ff75d7cd783b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:26.652378 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd4bbf-9224-44ac-a640-ff75d7cd783b service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:26.661475 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1285/2559] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:26.689500 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a52bad-3c1b-47c9-a0c9-fcd72911dae1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:26.751142 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a52bad-3c1b-47c9-a0c9-fcd72911dae1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:26.755998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8e7de-dd4e-42ef-8a51-3788a20f8e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:26.756639 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8e7de-dd4e-42ef-8a51-3788a20f8e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:26.756916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8e7de-dd4e-42ef-8a51-3788a20f8e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:26.757184 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8e7de-dd4e-42ef-8a51-3788a20f8e16 admin admin] PATH_INFO: `/v3/users/9d58fd5bc2d3437cbc348555b67a7cb0` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:26.758917 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8e7de-dd4e-42ef-8a51-3788a20f8e16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d58fd5bc2d3437cbc348555b67a7cb0)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:26.760849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8e7de-dd4e-42ef-8a51-3788a20f8e16 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:26.797252 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:26.807467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e5d8e7de-dd4e-42ef-8a51-3788a20f8e16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d58fd5bc2d3437cbc348555b67a7cb0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:26.814289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e5d8e7de-dd4e-42ef-8a51-3788a20f8e16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d58fd5bc2d3437cbc348555b67a7cb0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:26.826206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e5d8e7de-dd4e-42ef-8a51-3788a20f8e16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d58fd5bc2d3437cbc348555b67a7cb0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:26.833679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e5d8e7de-dd4e-42ef-8a51-3788a20f8e16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d58fd5bc2d3437cbc348555b67a7cb0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:26.834367 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e5d8e7de-dd4e-42ef-8a51-3788a20f8e16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d58fd5bc2d3437cbc348555b67a7cb0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:26.840234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1275/2560] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:26 2022] DELETE /identity/v3/users/9d58fd5bc2d3437cbc348555b67a7cb0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:26.844674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585fe81-5f67-484c-9d5e-0b17deb80237 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:26.844960 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585fe81-5f67-484c-9d5e-0b17deb80237 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:26.845239 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585fe81-5f67-484c-9d5e-0b17deb80237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:26.864980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7585fe81-5f67-484c-9d5e-0b17deb80237 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:26.866173 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7585fe81-5f67-484c-9d5e-0b17deb80237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:26.922902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1286/2561] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:26.933480 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8e7de-dd4e-42ef-8a51-3788a20f8e16 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:26.934876 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e5d8e7de-dd4e-42ef-8a51-3788a20f8e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:26.991551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8e7de-dd4e-42ef-8a51-3788a20f8e16 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:26.995750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b22a2-3d11-4a14-b84c-eb0fcf61e0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:26.996337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b22a2-3d11-4a14-b84c-eb0fcf61e0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:26.996632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b22a2-3d11-4a14-b84c-eb0fcf61e0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:26.996904 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b22a2-3d11-4a14-b84c-eb0fcf61e0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:27.005805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b22a2-3d11-4a14-b84c-eb0fcf61e0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:27.007209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b22a2-3d11-4a14-b84c-eb0fcf61e0c4 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:27.016421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1276/2562] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:27.280913 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585fe81-5f67-484c-9d5e-0b17deb80237 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:27.282325 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7585fe81-5f67-484c-9d5e-0b17deb80237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:27.297033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585fe81-5f67-484c-9d5e-0b17deb80237 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:27.301993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318252ca-3175-4acd-9c0f-ab5fc07ab71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:27.302704 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318252ca-3175-4acd-9c0f-ab5fc07ab71b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:27.303072 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318252ca-3175-4acd-9c0f-ab5fc07ab71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:27.303409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318252ca-3175-4acd-9c0f-ab5fc07ab71b admin admin] PATH_INFO: `/v3/projects/046b73834b0c4dfd8962eb09c87da288` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:27.305264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318252ca-3175-4acd-9c0f-ab5fc07ab71b admin admin] RBAC: Authorizing `identity:delete_project(project_id=046b73834b0c4dfd8962eb09c87da288)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:27.307121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318252ca-3175-4acd-9c0f-ab5fc07ab71b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:27.352473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-318252ca-3175-4acd-9c0f-ab5fc07ab71b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046b73834b0c4dfd8962eb09c87da288', 'request_id': 'req-318252ca-3175-4acd-9c0f-ab5fc07ab71b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:27.357915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-318252ca-3175-4acd-9c0f-ab5fc07ab71b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046b73834b0c4dfd8962eb09c87da288', 'request_id': 'req-318252ca-3175-4acd-9c0f-ab5fc07ab71b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:27.365066 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-318252ca-3175-4acd-9c0f-ab5fc07ab71b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046b73834b0c4dfd8962eb09c87da288', 'request_id': 'req-318252ca-3175-4acd-9c0f-ab5fc07ab71b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:27.376535 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-318252ca-3175-4acd-9c0f-ab5fc07ab71b admin admin] The token cache is being invalidate because project 046b73834b0c4dfd8962eb09c87da288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:27.376897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-318252ca-3175-4acd-9c0f-ab5fc07ab71b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:27.377472 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-318252ca-3175-4acd-9c0f-ab5fc07ab71b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:27.378938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1287/2563] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:27 2022] DELETE /identity/v3/projects/046b73834b0c4dfd8962eb09c87da288 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:27.383547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b22a2-3d11-4a14-b84c-eb0fcf61e0c4 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:27.394137 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b22a2-3d11-4a14-b84c-eb0fcf61e0c4 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:27.455882 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929a622-e1fc-4c12-afa2-f5646a12a7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:27.457259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a622-e1fc-4c12-afa2-f5646a12a7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:27.457542 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a622-e1fc-4c12-afa2-f5646a12a7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:27.457815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a622-e1fc-4c12-afa2-f5646a12a7ad admin admin] PATH_INFO: `/v3/users/5b7c11c0c7a345f88415ac6db5d549a4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:27.459097 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929a622-e1fc-4c12-afa2-f5646a12a7ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7c11c0c7a345f88415ac6db5d549a4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:27.461101 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929a622-e1fc-4c12-afa2-f5646a12a7ad admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:27.510163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0929a622-e1fc-4c12-afa2-f5646a12a7ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7c11c0c7a345f88415ac6db5d549a4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:27.517724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0929a622-e1fc-4c12-afa2-f5646a12a7ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7c11c0c7a345f88415ac6db5d549a4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:27.520510 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:27.533972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0929a622-e1fc-4c12-afa2-f5646a12a7ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7c11c0c7a345f88415ac6db5d549a4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:27.542578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0929a622-e1fc-4c12-afa2-f5646a12a7ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7c11c0c7a345f88415ac6db5d549a4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:27.543292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0929a622-e1fc-4c12-afa2-f5646a12a7ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7c11c0c7a345f88415ac6db5d549a4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:27.549305 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1277/2564] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:27 2022] DELETE /identity/v3/users/5b7c11c0c7a345f88415ac6db5d549a4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:27.864405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318252ca-3175-4acd-9c0f-ab5fc07ab71b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:27.865879 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-318252ca-3175-4acd-9c0f-ab5fc07ab71b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:27.874792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:27.880539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318252ca-3175-4acd-9c0f-ab5fc07ab71b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:27.944899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb00d5-2963-45c7-988d-64620a58a861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:27.945583 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb00d5-2963-45c7-988d-64620a58a861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:27.945862 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb00d5-2963-45c7-988d-64620a58a861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:27.946142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb00d5-2963-45c7-988d-64620a58a861 admin admin] PATH_INFO: `/v3/projects/92efd5c2e61848b38bd16212d35f309b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:27.947313 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb00d5-2963-45c7-988d-64620a58a861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92efd5c2e61848b38bd16212d35f309b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:27.949289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb00d5-2963-45c7-988d-64620a58a861 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:28.000536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-15bb00d5-2963-45c7-988d-64620a58a861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92efd5c2e61848b38bd16212d35f309b', 'request_id': 'req-15bb00d5-2963-45c7-988d-64620a58a861'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:28.006653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-15bb00d5-2963-45c7-988d-64620a58a861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92efd5c2e61848b38bd16212d35f309b', 'request_id': 'req-15bb00d5-2963-45c7-988d-64620a58a861'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:28.014605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-15bb00d5-2963-45c7-988d-64620a58a861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92efd5c2e61848b38bd16212d35f309b', 'request_id': 'req-15bb00d5-2963-45c7-988d-64620a58a861'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:28.027656 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-15bb00d5-2963-45c7-988d-64620a58a861 admin admin] The token cache is being invalidate because project 92efd5c2e61848b38bd16212d35f309b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:28.028405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-15bb00d5-2963-45c7-988d-64620a58a861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:28.029235 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-15bb00d5-2963-45c7-988d-64620a58a861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:28.030864 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1288/2565] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:27 2022] DELETE /identity/v3/projects/92efd5c2e61848b38bd16212d35f309b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:28.035728 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e45c16-4fc1-4ff2-bb87-24ceda23eefb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:28.036015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e45c16-4fc1-4ff2-bb87-24ceda23eefb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:28.036315 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e45c16-4fc1-4ff2-bb87-24ceda23eefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:28.056689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-67e45c16-4fc1-4ff2-bb87-24ceda23eefb None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:28.057918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-67e45c16-4fc1-4ff2-bb87-24ceda23eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:28.120538 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1278/2566] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:31:28.128508 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ec3ef-cd50-4cf0-aafa-e9e0de0bdba4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:28.128885 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ec3ef-cd50-4cf0-aafa-e9e0de0bdba4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:28.129220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ec3ef-cd50-4cf0-aafa-e9e0de0bdba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:28.148933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-066ec3ef-cd50-4cf0-aafa-e9e0de0bdba4 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:28.150189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-066ec3ef-cd50-4cf0-aafa-e9e0de0bdba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:28.158698 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1289/2567] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:28.162575 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e45c16-4fc1-4ff2-bb87-24ceda23eefb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:28.172474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e45c16-4fc1-4ff2-bb87-24ceda23eefb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:28.177123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9bf19-83e2-4a9d-86a7-1f73c0032050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:28.177718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9bf19-83e2-4a9d-86a7-1f73c0032050 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:28.177997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9bf19-83e2-4a9d-86a7-1f73c0032050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:28.178269 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9bf19-83e2-4a9d-86a7-1f73c0032050 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:28.178938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9bf19-83e2-4a9d-86a7-1f73c0032050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:31:28.179240 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9bf19-83e2-4a9d-86a7-1f73c0032050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:28.181407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9bf19-83e2-4a9d-86a7-1f73c0032050 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:28.193087 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1279/2568] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:31:28.198012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ec3ef-cd50-4cf0-aafa-e9e0de0bdba4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:28.207539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ec3ef-cd50-4cf0-aafa-e9e0de0bdba4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:28.212150 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5c842-bc35-4d75-9b6c-cfd4303595a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:28.212768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5c842-bc35-4d75-9b6c-cfd4303595a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:28.213043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5c842-bc35-4d75-9b6c-cfd4303595a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:28.213309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5c842-bc35-4d75-9b6c-cfd4303595a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:28.213929 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5c842-bc35-4d75-9b6c-cfd4303595a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:28.215819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5c842-bc35-4d75-9b6c-cfd4303595a2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:28.244489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1290/2569] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:28 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:28.248566 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9bf19-83e2-4a9d-86a7-1f73c0032050 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:28.259694 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9bf19-83e2-4a9d-86a7-1f73c0032050 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:28.316691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c11976-8200-477a-80bc-05ebaf619fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:28.317388 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c11976-8200-477a-80bc-05ebaf619fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:28.317663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c11976-8200-477a-80bc-05ebaf619fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:28.317931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c11976-8200-477a-80bc-05ebaf619fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:28.318554 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c11976-8200-477a-80bc-05ebaf619fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:28.320476 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c11976-8200-477a-80bc-05ebaf619fe1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:28.343391 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1280/2570] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:28 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:28.347557 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5c842-bc35-4d75-9b6c-cfd4303595a2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:28.359024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5c842-bc35-4d75-9b6c-cfd4303595a2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:28.363582 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d0055-769c-481d-afbd-6b07efce8a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:28.364195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d0055-769c-481d-afbd-6b07efce8a7d admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:28.364453 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d0055-769c-481d-afbd-6b07efce8a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:28.364759 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d0055-769c-481d-afbd-6b07efce8a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:28.365399 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d0055-769c-481d-afbd-6b07efce8a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:28.367007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d0055-769c-481d-afbd-6b07efce8a7d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:28.377801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1291/2571] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:31:28.381620 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c11976-8200-477a-80bc-05ebaf619fe1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:28.391733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c11976-8200-477a-80bc-05ebaf619fe1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:28.396822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb9ce2-5d59-4302-9ccd-11b3dc2bef24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:28.397417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb9ce2-5d59-4302-9ccd-11b3dc2bef24 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:28.397697 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb9ce2-5d59-4302-9ccd-11b3dc2bef24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:28.397967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb9ce2-5d59-4302-9ccd-11b3dc2bef24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:28.398748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb9ce2-5d59-4302-9ccd-11b3dc2bef24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:28.400464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb9ce2-5d59-4302-9ccd-11b3dc2bef24 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:28.412657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1281/2572] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:28.417680 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d0055-769c-481d-afbd-6b07efce8a7d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:28.428731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d0055-769c-481d-afbd-6b07efce8a7d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:28.438047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ffc00-e5d5-464d-ba50-c783e772b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:28.438704 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ffc00-e5d5-464d-ba50-c783e772b331 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:28.438978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ffc00-e5d5-464d-ba50-c783e772b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:28.439246 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ffc00-e5d5-464d-ba50-c783e772b331 admin admin] PATH_INFO: `/v3/projects/19a3b05b1c2b4b88a4b89ef1e0c3f4df/users/7b97cda482e34fa992d1255a7ed44a3e/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:28.456067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ffc00-e5d5-464d-ba50-c783e772b331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a3b05b1c2b4b88a4b89ef1e0c3f4df, user_id=7b97cda482e34fa992d1255a7ed44a3e, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:28.458828 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ffc00-e5d5-464d-ba50-c783e772b331 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:28.483837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1292/2573] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:28 2022] PUT /identity/v3/projects/19a3b05b1c2b4b88a4b89ef1e0c3f4df/users/7b97cda482e34fa992d1255a7ed44a3e/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:31:28.495073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0a0f5-d6c7-4a1a-a93b-efa13f3c5749 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:28.495623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0a0f5-d6c7-4a1a-a93b-efa13f3c5749 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:28.495623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0a0f5-d6c7-4a1a-a93b-efa13f3c5749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:28.536082 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4cb0a0f5-d6c7-4a1a-a93b-efa13f3c5749 None None] MFA Rules not processed for user `7b97cda482e34fa992d1255a7ed44a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:28.537371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4cb0a0f5-d6c7-4a1a-a93b-efa13f3c5749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:28.569067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:28.626167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1282/2574] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:28.630569 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ffc00-e5d5-464d-ba50-c783e772b331 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:28.674101 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:28.707956 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ffc00-e5d5-464d-ba50-c783e772b331 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:28.713053 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8344a73-f432-4873-9b09-d37283f44fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:28.713649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8344a73-f432-4873-9b09-d37283f44fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:28.713929 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8344a73-f432-4873-9b09-d37283f44fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:28.714196 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8344a73-f432-4873-9b09-d37283f44fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:28.714824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8344a73-f432-4873-9b09-d37283f44fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:28.716749 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8344a73-f432-4873-9b09-d37283f44fa5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:28.743983 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1293/2575] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:28 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:31:28.748096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0a0f5-d6c7-4a1a-a93b-efa13f3c5749 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:28.759859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0a0f5-d6c7-4a1a-a93b-efa13f3c5749 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:28.824748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c98b4-ab8c-4d12-958d-258c8e0cd50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:28.825543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c98b4-ab8c-4d12-958d-258c8e0cd50a admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:28.825981 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c98b4-ab8c-4d12-958d-258c8e0cd50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:28.826780 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c98b4-ab8c-4d12-958d-258c8e0cd50a admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:28.827106 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c98b4-ab8c-4d12-958d-258c8e0cd50a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:28.829689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c98b4-ab8c-4d12-958d-258c8e0cd50a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:28.874824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1283/2576] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:28 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:28.876157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8344a73-f432-4873-9b09-d37283f44fa5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:28.891827 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8344a73-f432-4873-9b09-d37283f44fa5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:28.897705 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ac469-04f9-4ea1-98aa-d9ee7023173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:28.898266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ac469-04f9-4ea1-98aa-d9ee7023173b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:28.899422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ac469-04f9-4ea1-98aa-d9ee7023173b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:28.899709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ac469-04f9-4ea1-98aa-d9ee7023173b admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:28.901856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ac469-04f9-4ea1-98aa-d9ee7023173b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:28.903955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ac469-04f9-4ea1-98aa-d9ee7023173b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:28.921512 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1294/2577] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:28.925921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c98b4-ab8c-4d12-958d-258c8e0cd50a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:28.939189 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c98b4-ab8c-4d12-958d-258c8e0cd50a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:28.951827 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7363c1-f16c-4313-93ba-abaab8a72bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:28.953157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7363c1-f16c-4313-93ba-abaab8a72bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:28.953436 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7363c1-f16c-4313-93ba-abaab8a72bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:28.953714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7363c1-f16c-4313-93ba-abaab8a72bd3 admin admin] PATH_INFO: `/v3/projects/cf2a66fa1dbb48b7bd18a3bd5e7ebaa4/users/1edb5e1005c4461bb41cee5d585c8924/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:28.972488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7363c1-f16c-4313-93ba-abaab8a72bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2a66fa1dbb48b7bd18a3bd5e7ebaa4, user_id=1edb5e1005c4461bb41cee5d585c8924, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:28.975223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7363c1-f16c-4313-93ba-abaab8a72bd3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:28.991643 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1284/2578] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:28 2022] PUT /identity/v3/projects/cf2a66fa1dbb48b7bd18a3bd5e7ebaa4/users/1edb5e1005c4461bb41cee5d585c8924/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:31:28.995934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ac469-04f9-4ea1-98aa-d9ee7023173b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:29.007495 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ac469-04f9-4ea1-98aa-d9ee7023173b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:29.070022 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eff6ac-b9fd-4284-955b-1991869be39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:29.070637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eff6ac-b9fd-4284-955b-1991869be39d admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:29.070916 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eff6ac-b9fd-4284-955b-1991869be39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:29.071187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eff6ac-b9fd-4284-955b-1991869be39d admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:29.071872 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eff6ac-b9fd-4284-955b-1991869be39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:29.073477 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eff6ac-b9fd-4284-955b-1991869be39d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:29.084767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1295/2579] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:31:29.087579 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7363c1-f16c-4313-93ba-abaab8a72bd3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:29.097883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7363c1-f16c-4313-93ba-abaab8a72bd3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:29.103200 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd2c95-0db7-48e8-8a3f-1541b1854b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:29.103873 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd2c95-0db7-48e8-8a3f-1541b1854b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:29.104152 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd2c95-0db7-48e8-8a3f-1541b1854b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:29.104431 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd2c95-0db7-48e8-8a3f-1541b1854b9e admin admin] PATH_INFO: `/v3/projects/cf2a66fa1dbb48b7bd18a3bd5e7ebaa4/users/1edb5e1005c4461bb41cee5d585c8924/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:29.106411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd2c95-0db7-48e8-8a3f-1541b1854b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2a66fa1dbb48b7bd18a3bd5e7ebaa4, user_id=1edb5e1005c4461bb41cee5d585c8924, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:29.109051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd2c95-0db7-48e8-8a3f-1541b1854b9e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:29.120377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1285/2580] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:29 2022] PUT /identity/v3/projects/cf2a66fa1dbb48b7bd18a3bd5e7ebaa4/users/1edb5e1005c4461bb41cee5d585c8924/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:29.130612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ccfdd-5846-46d6-9446-ef007717a876 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:29.130896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ccfdd-5846-46d6-9446-ef007717a876 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:29.131170 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ccfdd-5846-46d6-9446-ef007717a876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:29.159311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4f1ccfdd-5846-46d6-9446-ef007717a876 None None] MFA Rules not processed for user `1edb5e1005c4461bb41cee5d585c8924`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:29.160466 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4f1ccfdd-5846-46d6-9446-ef007717a876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:29.251244 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1296/2581] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:31:29.263197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd2c95-0db7-48e8-8a3f-1541b1854b9e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:29.265041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cedd2c95-0db7-48e8-8a3f-1541b1854b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:29.337582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd2c95-0db7-48e8-8a3f-1541b1854b9e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:29.341810 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aa8e8-fa34-4b95-b4d3-ce9e29881c56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:29.342420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aa8e8-fa34-4b95-b4d3-ce9e29881c56 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:29.342699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aa8e8-fa34-4b95-b4d3-ce9e29881c56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:29.342972 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aa8e8-fa34-4b95-b4d3-ce9e29881c56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:29.356181 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aa8e8-fa34-4b95-b4d3-ce9e29881c56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:29.357911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aa8e8-fa34-4b95-b4d3-ce9e29881c56 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:29.368713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1286/2582] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:29.453624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ccfdd-5846-46d6-9446-ef007717a876 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:29.463435 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ccfdd-5846-46d6-9446-ef007717a876 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:29.467178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95578989-7fa3-471e-aa25-90e1e6fe965f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:29.467701 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95578989-7fa3-471e-aa25-90e1e6fe965f service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:29.467979 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95578989-7fa3-471e-aa25-90e1e6fe965f service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:29.468250 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95578989-7fa3-471e-aa25-90e1e6fe965f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:29.496716 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:29.535568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95578989-7fa3-471e-aa25-90e1e6fe965f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:29.537525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95578989-7fa3-471e-aa25-90e1e6fe965f service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:29.546472 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1297/2583] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:32.851235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aa8e8-fa34-4b95-b4d3-ce9e29881c56 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:32.853513 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-241aa8e8-fa34-4b95-b4d3-ce9e29881c56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:32.885286 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:32.916423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aa8e8-fa34-4b95-b4d3-ce9e29881c56 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:32.920264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5e36f-356a-478e-ad17-84a2e36c664c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:32.923276 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e36f-356a-478e-ad17-84a2e36c664c service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:32.923556 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e36f-356a-478e-ad17-84a2e36c664c service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:32.923829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e36f-356a-478e-ad17-84a2e36c664c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:32.925575 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b8f5e36f-356a-478e-ad17-84a2e36c664c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:33.000447 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5e36f-356a-478e-ad17-84a2e36c664c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:33.001999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5e36f-356a-478e-ad17-84a2e36c664c service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:33.013270 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1287/2584] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:34.277765 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95578989-7fa3-471e-aa25-90e1e6fe965f service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:34.288564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95578989-7fa3-471e-aa25-90e1e6fe965f service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:34.293690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbbac5-f810-4f39-9ba5-30325ea27692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:34.294304 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbbac5-f810-4f39-9ba5-30325ea27692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:34.294585 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbbac5-f810-4f39-9ba5-30325ea27692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:34.294863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbbac5-f810-4f39-9ba5-30325ea27692 admin admin] PATH_INFO: `/v3/users/7b97cda482e34fa992d1255a7ed44a3e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:34.295976 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbbac5-f810-4f39-9ba5-30325ea27692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b97cda482e34fa992d1255a7ed44a3e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:34.297920 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbbac5-f810-4f39-9ba5-30325ea27692 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:34.358410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b6dbbac5-f810-4f39-9ba5-30325ea27692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b97cda482e34fa992d1255a7ed44a3e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:34.372248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b6dbbac5-f810-4f39-9ba5-30325ea27692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b97cda482e34fa992d1255a7ed44a3e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:34.383192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b6dbbac5-f810-4f39-9ba5-30325ea27692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b97cda482e34fa992d1255a7ed44a3e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:34.391049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b6dbbac5-f810-4f39-9ba5-30325ea27692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b97cda482e34fa992d1255a7ed44a3e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:34.391805 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b6dbbac5-f810-4f39-9ba5-30325ea27692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b97cda482e34fa992d1255a7ed44a3e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:34.399521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1298/2585] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:34 2022] DELETE /identity/v3/users/7b97cda482e34fa992d1255a7ed44a3e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:34.403723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b833bd-643c-437b-a895-ad6e0866bad8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:34.404205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b833bd-643c-437b-a895-ad6e0866bad8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:34.404287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b833bd-643c-437b-a895-ad6e0866bad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:34.424314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d8b833bd-643c-437b-a895-ad6e0866bad8 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:34.425556 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d8b833bd-643c-437b-a895-ad6e0866bad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:34.497722 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1288/2586] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:34.508376 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbbac5-f810-4f39-9ba5-30325ea27692 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:34.509896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b6dbbac5-f810-4f39-9ba5-30325ea27692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:34.583392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbbac5-f810-4f39-9ba5-30325ea27692 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:34.587451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d0292-ab11-49c1-b6e0-0b14a35974e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:34.588100 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d0292-ab11-49c1-b6e0-0b14a35974e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:34.588461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d0292-ab11-49c1-b6e0-0b14a35974e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:34.588689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d0292-ab11-49c1-b6e0-0b14a35974e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:34.600191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d0292-ab11-49c1-b6e0-0b14a35974e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:34.602411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d0292-ab11-49c1-b6e0-0b14a35974e7 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:34.630052 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1299/2587] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:31:35.066867 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b833bd-643c-437b-a895-ad6e0866bad8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:35.068517 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d8b833bd-643c-437b-a895-ad6e0866bad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:35.082037 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b833bd-643c-437b-a895-ad6e0866bad8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:35.092186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425bf24-9adf-4969-a078-9dd1ec7e35b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:35.092878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425bf24-9adf-4969-a078-9dd1ec7e35b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:35.093150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425bf24-9adf-4969-a078-9dd1ec7e35b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:35.093418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425bf24-9adf-4969-a078-9dd1ec7e35b9 admin admin] PATH_INFO: `/v3/projects/19a3b05b1c2b4b88a4b89ef1e0c3f4df` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:35.094535 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425bf24-9adf-4969-a078-9dd1ec7e35b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a3b05b1c2b4b88a4b89ef1e0c3f4df)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:35.096503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425bf24-9adf-4969-a078-9dd1ec7e35b9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:35.146935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c425bf24-9adf-4969-a078-9dd1ec7e35b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a3b05b1c2b4b88a4b89ef1e0c3f4df', 'request_id': 'req-c425bf24-9adf-4969-a078-9dd1ec7e35b9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:35.162604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c425bf24-9adf-4969-a078-9dd1ec7e35b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a3b05b1c2b4b88a4b89ef1e0c3f4df', 'request_id': 'req-c425bf24-9adf-4969-a078-9dd1ec7e35b9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:35.170085 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c425bf24-9adf-4969-a078-9dd1ec7e35b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a3b05b1c2b4b88a4b89ef1e0c3f4df', 'request_id': 'req-c425bf24-9adf-4969-a078-9dd1ec7e35b9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:35.176952 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:35.181705 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c425bf24-9adf-4969-a078-9dd1ec7e35b9 admin admin] The token cache is being invalidate because project 19a3b05b1c2b4b88a4b89ef1e0c3f4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:35.182091 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c425bf24-9adf-4969-a078-9dd1ec7e35b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:35.182740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c425bf24-9adf-4969-a078-9dd1ec7e35b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:35.184941 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1289/2588] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:35 2022] DELETE /identity/v3/projects/19a3b05b1c2b4b88a4b89ef1e0c3f4df => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:35.188968 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d0292-ab11-49c1-b6e0-0b14a35974e7 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:35.198859 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d0292-ab11-49c1-b6e0-0b14a35974e7 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:35.242571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:35.270418 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19128a82-e37e-40c8-826e-5ac0ef745c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:35.271065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19128a82-e37e-40c8-826e-5ac0ef745c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:35.271341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19128a82-e37e-40c8-826e-5ac0ef745c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:35.271613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19128a82-e37e-40c8-826e-5ac0ef745c0f admin admin] PATH_INFO: `/v3/users/1edb5e1005c4461bb41cee5d585c8924` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:35.272811 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19128a82-e37e-40c8-826e-5ac0ef745c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edb5e1005c4461bb41cee5d585c8924)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:35.275346 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19128a82-e37e-40c8-826e-5ac0ef745c0f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:35.325608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19128a82-e37e-40c8-826e-5ac0ef745c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edb5e1005c4461bb41cee5d585c8924'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:35.340272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19128a82-e37e-40c8-826e-5ac0ef745c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edb5e1005c4461bb41cee5d585c8924'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:35.354002 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19128a82-e37e-40c8-826e-5ac0ef745c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edb5e1005c4461bb41cee5d585c8924'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:35.362209 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19128a82-e37e-40c8-826e-5ac0ef745c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edb5e1005c4461bb41cee5d585c8924'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:35.363068 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-19128a82-e37e-40c8-826e-5ac0ef745c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edb5e1005c4461bb41cee5d585c8924'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:35.369482 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1300/2589] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:35 2022] DELETE /identity/v3/users/1edb5e1005c4461bb41cee5d585c8924 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:35.675617 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425bf24-9adf-4969-a078-9dd1ec7e35b9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:35.681507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c425bf24-9adf-4969-a078-9dd1ec7e35b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:35.707831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425bf24-9adf-4969-a078-9dd1ec7e35b9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:35.784580 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a54dd7-2f8d-40d5-a2e7-ed13afe89782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:35.785775 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a54dd7-2f8d-40d5-a2e7-ed13afe89782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:35.786562 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a54dd7-2f8d-40d5-a2e7-ed13afe89782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:35.787053 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a54dd7-2f8d-40d5-a2e7-ed13afe89782 admin admin] PATH_INFO: `/v3/projects/cf2a66fa1dbb48b7bd18a3bd5e7ebaa4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:35.788422 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a54dd7-2f8d-40d5-a2e7-ed13afe89782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2a66fa1dbb48b7bd18a3bd5e7ebaa4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:35.790957 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a54dd7-2f8d-40d5-a2e7-ed13afe89782 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:35.863764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-66a54dd7-2f8d-40d5-a2e7-ed13afe89782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2a66fa1dbb48b7bd18a3bd5e7ebaa4', 'request_id': 'req-66a54dd7-2f8d-40d5-a2e7-ed13afe89782'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:35.877182 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-66a54dd7-2f8d-40d5-a2e7-ed13afe89782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2a66fa1dbb48b7bd18a3bd5e7ebaa4', 'request_id': 'req-66a54dd7-2f8d-40d5-a2e7-ed13afe89782'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:35.886554 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-66a54dd7-2f8d-40d5-a2e7-ed13afe89782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2a66fa1dbb48b7bd18a3bd5e7ebaa4', 'request_id': 'req-66a54dd7-2f8d-40d5-a2e7-ed13afe89782'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:35.898812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-66a54dd7-2f8d-40d5-a2e7-ed13afe89782 admin admin] The token cache is being invalidate because project cf2a66fa1dbb48b7bd18a3bd5e7ebaa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:35.899104 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-66a54dd7-2f8d-40d5-a2e7-ed13afe89782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:35.900027 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-66a54dd7-2f8d-40d5-a2e7-ed13afe89782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:35.904624 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1290/2590] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:35 2022] DELETE /identity/v3/projects/cf2a66fa1dbb48b7bd18a3bd5e7ebaa4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:35.906705 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd1f79-0b37-4d42-9ad7-f9e8ac3d8d13 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:35.906994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd1f79-0b37-4d42-9ad7-f9e8ac3d8d13 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:35.907272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd1f79-0b37-4d42-9ad7-f9e8ac3d8d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:35.928146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c3dd1f79-0b37-4d42-9ad7-f9e8ac3d8d13 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:35.928934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c3dd1f79-0b37-4d42-9ad7-f9e8ac3d8d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:36.027489 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1301/2591] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:36.035190 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e6c88-cfa7-4440-9807-735e6f7e0eac None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.035484 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e6c88-cfa7-4440-9807-735e6f7e0eac None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.035763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e6c88-cfa7-4440-9807-735e6f7e0eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.058738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-676e6c88-cfa7-4440-9807-735e6f7e0eac None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:36.060174 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-676e6c88-cfa7-4440-9807-735e6f7e0eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:36.074729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd1f79-0b37-4d42-9ad7-f9e8ac3d8d13 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:36.075217 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1291/2592] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:36.085123 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd1f79-0b37-4d42-9ad7-f9e8ac3d8d13 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:36.097312 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2263f88-365f-48d4-8837-9945ed05d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:36.098107 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2263f88-365f-48d4-8837-9945ed05d3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.098373 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2263f88-365f-48d4-8837-9945ed05d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.098654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2263f88-365f-48d4-8837-9945ed05d3d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.099323 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2263f88-365f-48d4-8837-9945ed05d3d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:31:36.099639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2263f88-365f-48d4-8837-9945ed05d3d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:36.101347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2263f88-365f-48d4-8837-9945ed05d3d8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:36.106190 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e6c88-cfa7-4440-9807-735e6f7e0eac None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:36.109328 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-676e6c88-cfa7-4440-9807-735e6f7e0eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:36.123578 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e6c88-cfa7-4440-9807-735e6f7e0eac None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:36.124934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1302/2593] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:31:36.128481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f280b1a-1df8-4e09-b599-cd3a9ba5aead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:36.129214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f280b1a-1df8-4e09-b599-cd3a9ba5aead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.129587 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f280b1a-1df8-4e09-b599-cd3a9ba5aead admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.129868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f280b1a-1df8-4e09-b599-cd3a9ba5aead admin admin] PATH_INFO: `/v3/users/a9f0bcfc9c4b48d98cd3385309adaafb` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.130745 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2263f88-365f-48d4-8837-9945ed05d3d8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:36.130997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f280b1a-1df8-4e09-b599-cd3a9ba5aead admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f0bcfc9c4b48d98cd3385309adaafb)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:36.133512 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f280b1a-1df8-4e09-b599-cd3a9ba5aead admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:36.142078 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2263f88-365f-48d4-8837-9945ed05d3d8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:36.147144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c72fa1-973a-492b-8696-59e294b30c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:36.147735 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c72fa1-973a-492b-8696-59e294b30c00 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.148013 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c72fa1-973a-492b-8696-59e294b30c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.148879 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c72fa1-973a-492b-8696-59e294b30c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.149504 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c72fa1-973a-492b-8696-59e294b30c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:36.151405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c72fa1-973a-492b-8696-59e294b30c00 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:36.181899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1303/2594] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:36 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:36.185880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c72fa1-973a-492b-8696-59e294b30c00 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:36.187019 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2f280b1a-1df8-4e09-b599-cd3a9ba5aead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f0bcfc9c4b48d98cd3385309adaafb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:36.194734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2f280b1a-1df8-4e09-b599-cd3a9ba5aead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f0bcfc9c4b48d98cd3385309adaafb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:36.208452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2f280b1a-1df8-4e09-b599-cd3a9ba5aead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f0bcfc9c4b48d98cd3385309adaafb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:36.211823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:36.213522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:36.216854 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2f280b1a-1df8-4e09-b599-cd3a9ba5aead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f0bcfc9c4b48d98cd3385309adaafb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:36.217921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2f280b1a-1df8-4e09-b599-cd3a9ba5aead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f0bcfc9c4b48d98cd3385309adaafb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:36.226813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1292/2595] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:36 2022] DELETE /identity/v3/users/a9f0bcfc9c4b48d98cd3385309adaafb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:31:36.256356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c72fa1-973a-492b-8696-59e294b30c00 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:36.312393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542c981-d274-4050-9e3a-9463e51183fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:36.313029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542c981-d274-4050-9e3a-9463e51183fc admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.313307 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542c981-d274-4050-9e3a-9463e51183fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.313577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542c981-d274-4050-9e3a-9463e51183fc admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.314188 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542c981-d274-4050-9e3a-9463e51183fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:36.316101 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542c981-d274-4050-9e3a-9463e51183fc admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:36.338150 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1304/2596] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:36 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:31:36.342849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f280b1a-1df8-4e09-b599-cd3a9ba5aead admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:36.344341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2f280b1a-1df8-4e09-b599-cd3a9ba5aead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:36.357675 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f280b1a-1df8-4e09-b599-cd3a9ba5aead admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:36.362327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31434c66-27a9-4d21-a47d-d672570a29ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:36.362921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31434c66-27a9-4d21-a47d-d672570a29ec admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.363203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31434c66-27a9-4d21-a47d-d672570a29ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.363471 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31434c66-27a9-4d21-a47d-d672570a29ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.364132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31434c66-27a9-4d21-a47d-d672570a29ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:36.365760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31434c66-27a9-4d21-a47d-d672570a29ec admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:36.376244 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1293/2597] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:36.380292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542c981-d274-4050-9e3a-9463e51183fc admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:36.393494 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542c981-d274-4050-9e3a-9463e51183fc admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:36.398836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6358513-7ca9-4707-afd1-b1576a307cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:36.399435 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6358513-7ca9-4707-afd1-b1576a307cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.399716 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6358513-7ca9-4707-afd1-b1576a307cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.400021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6358513-7ca9-4707-afd1-b1576a307cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.400664 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6358513-7ca9-4707-afd1-b1576a307cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:36.402578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6358513-7ca9-4707-afd1-b1576a307cf5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:36.412470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31434c66-27a9-4d21-a47d-d672570a29ec admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:36.414288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-31434c66-27a9-4d21-a47d-d672570a29ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:36.419822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1305/2598] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:31:36.420718 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6358513-7ca9-4707-afd1-b1576a307cf5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:36.430869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31434c66-27a9-4d21-a47d-d672570a29ec admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:36.431743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6358513-7ca9-4707-afd1-b1576a307cf5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:36.436187 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfbd62-11b5-4fb3-8b32-f156d4c5bb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:36.436763 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfbd62-11b5-4fb3-8b32-f156d4c5bb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.437080 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfbd62-11b5-4fb3-8b32-f156d4c5bb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.437322 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfbd62-11b5-4fb3-8b32-f156d4c5bb09 admin admin] PATH_INFO: `/v3/projects/806bc735e276493a92c94d6ae077536a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.437620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbbdb7-9c62-4afc-8b47-effffdc5189e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:36.438331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbbdb7-9c62-4afc-8b47-effffdc5189e admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.438542 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbbdb7-9c62-4afc-8b47-effffdc5189e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.438645 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfbd62-11b5-4fb3-8b32-f156d4c5bb09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=806bc735e276493a92c94d6ae077536a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:36.438812 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbbdb7-9c62-4afc-8b47-effffdc5189e admin admin] PATH_INFO: `/v3/projects/316d0f23ba504eccb0fbce93cd63d278/users/53b95f4f7ac94fe48b984f19ae2ad00f/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.440529 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfbd62-11b5-4fb3-8b32-f156d4c5bb09 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:36.454701 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbbdb7-9c62-4afc-8b47-effffdc5189e admin admin] RBAC: Authorizing `identity:create_grant(project_id=316d0f23ba504eccb0fbce93cd63d278, user_id=53b95f4f7ac94fe48b984f19ae2ad00f, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:36.457513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbbdb7-9c62-4afc-8b47-effffdc5189e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:36.472272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1306/2599] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:36 2022] PUT /identity/v3/projects/316d0f23ba504eccb0fbce93cd63d278/users/53b95f4f7ac94fe48b984f19ae2ad00f/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:36.477260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6d310-9da5-4744-84b7-c41c21a1e80e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.477600 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6d310-9da5-4744-84b7-c41c21a1e80e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.477880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6d310-9da5-4744-84b7-c41c21a1e80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.499065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c7c6d310-9da5-4744-84b7-c41c21a1e80e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:36.500298 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c7c6d310-9da5-4744-84b7-c41c21a1e80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:36.502252 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-62dfbd62-11b5-4fb3-8b32-f156d4c5bb09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '806bc735e276493a92c94d6ae077536a', 'request_id': 'req-62dfbd62-11b5-4fb3-8b32-f156d4c5bb09'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:36.510541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-62dfbd62-11b5-4fb3-8b32-f156d4c5bb09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '806bc735e276493a92c94d6ae077536a', 'request_id': 'req-62dfbd62-11b5-4fb3-8b32-f156d4c5bb09'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:36.517695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-62dfbd62-11b5-4fb3-8b32-f156d4c5bb09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '806bc735e276493a92c94d6ae077536a', 'request_id': 'req-62dfbd62-11b5-4fb3-8b32-f156d4c5bb09'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:36.529042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-62dfbd62-11b5-4fb3-8b32-f156d4c5bb09 admin admin] The token cache is being invalidate because project 806bc735e276493a92c94d6ae077536a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:36.529390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-62dfbd62-11b5-4fb3-8b32-f156d4c5bb09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:36.530051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-62dfbd62-11b5-4fb3-8b32-f156d4c5bb09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:36.531553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1294/2600] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:36 2022] DELETE /identity/v3/projects/806bc735e276493a92c94d6ae077536a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:31:36.537186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a327ab1-fff5-4776-bd90-e45b287388c7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.537470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a327ab1-fff5-4776-bd90-e45b287388c7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.537749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a327ab1-fff5-4776-bd90-e45b287388c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.559001 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2a327ab1-fff5-4776-bd90-e45b287388c7 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:36.560203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2a327ab1-fff5-4776-bd90-e45b287388c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:36.562379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1307/2601] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:31:36.568628 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1295/2602] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:36.572077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6d310-9da5-4744-84b7-c41c21a1e80e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:36.573442 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c7c6d310-9da5-4744-84b7-c41c21a1e80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:36.576224 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4bdee-e52b-43ab-9b86-a2a7a3159c7a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.576505 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4bdee-e52b-43ab-9b86-a2a7a3159c7a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.576940 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4bdee-e52b-43ab-9b86-a2a7a3159c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.595919 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-88b4bdee-e52b-43ab-9b86-a2a7a3159c7a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:36.597139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-88b4bdee-e52b-43ab-9b86-a2a7a3159c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:36.601858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:36.607689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1296/2603] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:31:36.610381 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4bdee-e52b-43ab-9b86-a2a7a3159c7a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:36.622799 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4bdee-e52b-43ab-9b86-a2a7a3159c7a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:36.627673 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41146f-1dd0-4edd-a3ff-88b195d8cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:36.628289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41146f-1dd0-4edd-a3ff-88b195d8cb88 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.628568 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41146f-1dd0-4edd-a3ff-88b195d8cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.628875 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41146f-1dd0-4edd-a3ff-88b195d8cb88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.629519 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41146f-1dd0-4edd-a3ff-88b195d8cb88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:31:36.629818 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41146f-1dd0-4edd-a3ff-88b195d8cb88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:36.631405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41146f-1dd0-4edd-a3ff-88b195d8cb88 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:36.636933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6d310-9da5-4744-84b7-c41c21a1e80e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:36.641707 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa520b5-8a85-4d71-99f5-999f1c11a13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:36.642409 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa520b5-8a85-4d71-99f5-999f1c11a13f service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.642691 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa520b5-8a85-4d71-99f5-999f1c11a13f service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.642966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa520b5-8a85-4d71-99f5-999f1c11a13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.644705 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1297/2604] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:31:36.648896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41146f-1dd0-4edd-a3ff-88b195d8cb88 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:36.652921 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa520b5-8a85-4d71-99f5-999f1c11a13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:36.654360 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa520b5-8a85-4d71-99f5-999f1c11a13f service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:36.659988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41146f-1dd0-4edd-a3ff-88b195d8cb88 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:36.664954 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1308/2605] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:31:36.668709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f885c-ade4-4274-be7a-0a9a892bc46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:36.669355 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f885c-ade4-4274-be7a-0a9a892bc46d admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.669667 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f885c-ade4-4274-be7a-0a9a892bc46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.669942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f885c-ade4-4274-be7a-0a9a892bc46d admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.670638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f885c-ade4-4274-be7a-0a9a892bc46d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:36.672432 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f885c-ade4-4274-be7a-0a9a892bc46d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:36.707825 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1298/2606] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:36 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:31:36.708980 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa520b5-8a85-4d71-99f5-999f1c11a13f service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:36.719217 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa520b5-8a85-4d71-99f5-999f1c11a13f service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:36.786695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063157b7-10fe-408f-8cc6-0f83dde8149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:36.787305 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063157b7-10fe-408f-8cc6-0f83dde8149c admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.787586 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063157b7-10fe-408f-8cc6-0f83dde8149c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.787857 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063157b7-10fe-408f-8cc6-0f83dde8149c admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.788498 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063157b7-10fe-408f-8cc6-0f83dde8149c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:36.791067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063157b7-10fe-408f-8cc6-0f83dde8149c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:36.814470 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1309/2607] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:36 2022] POST /identity/v3/users => generated 282 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:36.818334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f885c-ade4-4274-be7a-0a9a892bc46d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:36.830331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f885c-ade4-4274-be7a-0a9a892bc46d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:36.835764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66800e-132e-4741-b61c-24965fdba7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:36.836344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66800e-132e-4741-b61c-24965fdba7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.836535 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66800e-132e-4741-b61c-24965fdba7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.836842 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66800e-132e-4741-b61c-24965fdba7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.837600 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66800e-132e-4741-b61c-24965fdba7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:36.839633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66800e-132e-4741-b61c-24965fdba7e1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:36.851872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1299/2608] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:36.856012 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063157b7-10fe-408f-8cc6-0f83dde8149c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:36.866426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063157b7-10fe-408f-8cc6-0f83dde8149c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:36.871653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514c166-f97e-4838-8532-70a5ebc5536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:36.872250 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514c166-f97e-4838-8532-70a5ebc5536b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.872558 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514c166-f97e-4838-8532-70a5ebc5536b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.872829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514c166-f97e-4838-8532-70a5ebc5536b admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.873480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514c166-f97e-4838-8532-70a5ebc5536b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:36.875076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514c166-f97e-4838-8532-70a5ebc5536b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:36.889022 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1310/2609] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:36.893287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66800e-132e-4741-b61c-24965fdba7e1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:36.904912 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66800e-132e-4741-b61c-24965fdba7e1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:36.910235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cd914-20c7-48a1-9eb0-2e00d81d259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:36.910884 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cd914-20c7-48a1-9eb0-2e00d81d259d admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.911163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cd914-20c7-48a1-9eb0-2e00d81d259d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.911438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cd914-20c7-48a1-9eb0-2e00d81d259d admin admin] PATH_INFO: `/v3/projects/e8c2f1618ce341ea9957c9736e55715e/users/b0724756a661443b916a2b5b82baf0bc/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.928426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765cd914-20c7-48a1-9eb0-2e00d81d259d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c2f1618ce341ea9957c9736e55715e, user_id=b0724756a661443b916a2b5b82baf0bc, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:36.931163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765cd914-20c7-48a1-9eb0-2e00d81d259d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:36.944170 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1300/2610] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:36 2022] PUT /identity/v3/projects/e8c2f1618ce341ea9957c9736e55715e/users/b0724756a661443b916a2b5b82baf0bc/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:31:36.955699 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffded2-e789-47ed-bf43-9b15b9b160ed None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:36.955983 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffded2-e789-47ed-bf43-9b15b9b160ed None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:36.956257 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffded2-e789-47ed-bf43-9b15b9b160ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:36.986508 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c6ffded2-e789-47ed-bf43-9b15b9b160ed None None] MFA Rules not processed for user `b0724756a661443b916a2b5b82baf0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:36.987725 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c6ffded2-e789-47ed-bf43-9b15b9b160ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:37.061272 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1311/2611] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:37.065583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cd914-20c7-48a1-9eb0-2e00d81d259d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:37.119978 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:37.139426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cd914-20c7-48a1-9eb0-2e00d81d259d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:37.144082 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e024544-650b-425c-92f3-83543ff69bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:37.144728 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e024544-650b-425c-92f3-83543ff69bbe admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.145007 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e024544-650b-425c-92f3-83543ff69bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.145273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e024544-650b-425c-92f3-83543ff69bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:37.145887 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e024544-650b-425c-92f3-83543ff69bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:37.147881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e024544-650b-425c-92f3-83543ff69bbe admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:37.179297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1301/2612] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:37 2022] POST /identity/v3/projects => generated 361 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:37.183541 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffded2-e789-47ed-bf43-9b15b9b160ed None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:37.194461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffded2-e789-47ed-bf43-9b15b9b160ed None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:37.229198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:37.254065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6bedc-6a01-4111-899b-74681c58f8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:37.254667 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6bedc-6a01-4111-899b-74681c58f8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.255242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6bedc-6a01-4111-899b-74681c58f8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.255242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6bedc-6a01-4111-899b-74681c58f8a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:37.255877 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6bedc-6a01-4111-899b-74681c58f8a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:37.258343 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6bedc-6a01-4111-899b-74681c58f8a7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:37.284226 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1312/2613] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:37 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:31:37.285733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e024544-650b-425c-92f3-83543ff69bbe admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:37.297808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e024544-650b-425c-92f3-83543ff69bbe admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:37.302792 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd03ff-afc8-4998-91f5-b940de38090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:37.303394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd03ff-afc8-4998-91f5-b940de38090c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.303716 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd03ff-afc8-4998-91f5-b940de38090c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.303941 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd03ff-afc8-4998-91f5-b940de38090c admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:37.304611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd03ff-afc8-4998-91f5-b940de38090c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:37.306983 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd03ff-afc8-4998-91f5-b940de38090c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:37.320547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1302/2614] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:37.325079 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6bedc-6a01-4111-899b-74681c58f8a7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:37.336749 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6bedc-6a01-4111-899b-74681c58f8a7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:37.340215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3ab2e-87c3-4d9b-9bad-b230544e3008 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.341511 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3ab2e-87c3-4d9b-9bad-b230544e3008 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.341869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3ab2e-87c3-4d9b-9bad-b230544e3008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:37.341991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97b1ea-1bb2-4693-ae5b-4be026d10987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:37.342669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97b1ea-1bb2-4693-ae5b-4be026d10987 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.343016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97b1ea-1bb2-4693-ae5b-4be026d10987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.343361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97b1ea-1bb2-4693-ae5b-4be026d10987 admin admin] PATH_INFO: `/v3/projects/96a85a824bbf4292872624f786f3a071/users/ca650b79ef7d436fa839697caeef609a/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:37.361379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97b1ea-1bb2-4693-ae5b-4be026d10987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a85a824bbf4292872624f786f3a071, user_id=ca650b79ef7d436fa839697caeef609a, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:37.364186 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97b1ea-1bb2-4693-ae5b-4be026d10987 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:37.371453 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-33f3ab2e-87c3-4d9b-9bad-b230544e3008 None None] MFA Rules not processed for user `53b95f4f7ac94fe48b984f19ae2ad00f`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:37.372866 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-33f3ab2e-87c3-4d9b-9bad-b230544e3008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:37.381622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1313/2615] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:37 2022] PUT /identity/v3/projects/96a85a824bbf4292872624f786f3a071/users/ca650b79ef7d436fa839697caeef609a/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:37.386568 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97b1ea-1bb2-4693-ae5b-4be026d10987 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:37.448679 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1303/2616] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:37.452967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3ab2e-87c3-4d9b-9bad-b230544e3008 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:37.454271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97b1ea-1bb2-4693-ae5b-4be026d10987 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:37.454400 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-33f3ab2e-87c3-4d9b-9bad-b230544e3008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:37.459037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f090adf-e7c8-4469-b891-9a698f3ebf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:37.459622 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f090adf-e7c8-4469-b891-9a698f3ebf02 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.460030 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f090adf-e7c8-4469-b891-9a698f3ebf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.460309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f090adf-e7c8-4469-b891-9a698f3ebf02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:37.461726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f090adf-e7c8-4469-b891-9a698f3ebf02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:37.463321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f090adf-e7c8-4469-b891-9a698f3ebf02 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:37.470029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3ab2e-87c3-4d9b-9bad-b230544e3008 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:37.474924 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fae81-c82d-4c67-a4c1-3870d5c79167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:37.475609 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fae81-c82d-4c67-a4c1-3870d5c79167 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.477079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fae81-c82d-4c67-a4c1-3870d5c79167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.477210 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1314/2617] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:37.477331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fae81-c82d-4c67-a4c1-3870d5c79167 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:37.480314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fae81-c82d-4c67-a4c1-3870d5c79167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:37.481472 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f090adf-e7c8-4469-b891-9a698f3ebf02 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:37.482421 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fae81-c82d-4c67-a4c1-3870d5c79167 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:37.499395 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f090adf-e7c8-4469-b891-9a698f3ebf02 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:37.505923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38265a11-85d1-451d-96ae-3334affd410b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:37.506881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38265a11-85d1-451d-96ae-3334affd410b admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.507233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38265a11-85d1-451d-96ae-3334affd410b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.508121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38265a11-85d1-451d-96ae-3334affd410b admin admin] PATH_INFO: `/v3/projects/96a85a824bbf4292872624f786f3a071/users/ca650b79ef7d436fa839697caeef609a/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:37.510195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38265a11-85d1-451d-96ae-3334affd410b admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a85a824bbf4292872624f786f3a071, user_id=ca650b79ef7d436fa839697caeef609a, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:37.513464 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38265a11-85d1-451d-96ae-3334affd410b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:37.516782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1304/2618] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:37 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:31:37.521032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fae81-c82d-4c67-a4c1-3870d5c79167 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:37.526139 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1315/2619] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:37 2022] PUT /identity/v3/projects/96a85a824bbf4292872624f786f3a071/users/ca650b79ef7d436fa839697caeef609a/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:37.541125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d387972-5d81-4c3f-a89d-370c929685fb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.541413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d387972-5d81-4c3f-a89d-370c929685fb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.541694 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d387972-5d81-4c3f-a89d-370c929685fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:37.569845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5d387972-5d81-4c3f-a89d-370c929685fb None None] MFA Rules not processed for user `ca650b79ef7d436fa839697caeef609a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:37.571681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5d387972-5d81-4c3f-a89d-370c929685fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:37.584896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fae81-c82d-4c67-a4c1-3870d5c79167 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:37.614412 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:37.645696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed915ae5-df37-407e-8f8f-89b7b74b00b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:37.646445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed915ae5-df37-407e-8f8f-89b7b74b00b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.646854 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed915ae5-df37-407e-8f8f-89b7b74b00b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.647135 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed915ae5-df37-407e-8f8f-89b7b74b00b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:37.647773 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed915ae5-df37-407e-8f8f-89b7b74b00b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:37.649951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1316/2620] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:31:37.650279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed915ae5-df37-407e-8f8f-89b7b74b00b6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:37.662070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d387972-5d81-4c3f-a89d-370c929685fb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:37.663748 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5d387972-5d81-4c3f-a89d-370c929685fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:37.675727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1305/2621] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:37 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:37.676724 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed915ae5-df37-407e-8f8f-89b7b74b00b6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:37.677321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:37.686813 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed915ae5-df37-407e-8f8f-89b7b74b00b6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:37.691543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271785b3-b2f5-4bfb-a2b6-e603326499f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:37.692154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271785b3-b2f5-4bfb-a2b6-e603326499f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.692433 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271785b3-b2f5-4bfb-a2b6-e603326499f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.692743 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271785b3-b2f5-4bfb-a2b6-e603326499f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:37.693373 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271785b3-b2f5-4bfb-a2b6-e603326499f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:37.695527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271785b3-b2f5-4bfb-a2b6-e603326499f3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:37.708834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1306/2622] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:37.709712 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271785b3-b2f5-4bfb-a2b6-e603326499f3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:37.719386 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271785b3-b2f5-4bfb-a2b6-e603326499f3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:37.724283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24558f-a14a-4e1f-b93d-8888ad12c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:37.725151 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24558f-a14a-4e1f-b93d-8888ad12c838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.725524 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24558f-a14a-4e1f-b93d-8888ad12c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.725638 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d387972-5d81-4c3f-a89d-370c929685fb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:37.725988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24558f-a14a-4e1f-b93d-8888ad12c838 admin admin] PATH_INFO: `/v3/projects/122348d3f18a4ae8911a3152b4d9d961/users/5f9851cce829497b8ee1aac2cc51c9f0/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:37.729172 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b9e7f-33ed-4503-8990-ddf47fede3ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:37.729766 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b9e7f-33ed-4503-8990-ddf47fede3ba service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.730048 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b9e7f-33ed-4503-8990-ddf47fede3ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.730317 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b9e7f-33ed-4503-8990-ddf47fede3ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:37.739195 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b9e7f-33ed-4503-8990-ddf47fede3ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:37.740660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b9e7f-33ed-4503-8990-ddf47fede3ba service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:37.742484 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24558f-a14a-4e1f-b93d-8888ad12c838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=122348d3f18a4ae8911a3152b4d9d961, user_id=5f9851cce829497b8ee1aac2cc51c9f0, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:37.745143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24558f-a14a-4e1f-b93d-8888ad12c838 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:37.750829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1317/2623] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:37 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:31:37.758605 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1307/2624] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:37 2022] PUT /identity/v3/projects/122348d3f18a4ae8911a3152b4d9d961/users/5f9851cce829497b8ee1aac2cc51c9f0/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:31:37.762771 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b9e7f-33ed-4503-8990-ddf47fede3ba service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:37.773822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b9e7f-33ed-4503-8990-ddf47fede3ba service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:37.830425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24558f-a14a-4e1f-b93d-8888ad12c838 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:37.832834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02515b74-f2fc-4ef0-a6fc-447bfbb63de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:37.833519 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02515b74-f2fc-4ef0-a6fc-447bfbb63de3 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.833891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02515b74-f2fc-4ef0-a6fc-447bfbb63de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.834235 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02515b74-f2fc-4ef0-a6fc-447bfbb63de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:37.834959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02515b74-f2fc-4ef0-a6fc-447bfbb63de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:37.836677 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02515b74-f2fc-4ef0-a6fc-447bfbb63de3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:37.849513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1318/2625] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:31:37.850519 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02515b74-f2fc-4ef0-a6fc-447bfbb63de3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:37.860224 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02515b74-f2fc-4ef0-a6fc-447bfbb63de3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:37.864900 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d008e15-f121-4a5f-bb33-2b94b2cfc31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:37.865528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d008e15-f121-4a5f-bb33-2b94b2cfc31b admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.865802 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d008e15-f121-4a5f-bb33-2b94b2cfc31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.866072 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d008e15-f121-4a5f-bb33-2b94b2cfc31b admin admin] PATH_INFO: `/v3/projects/122348d3f18a4ae8911a3152b4d9d961/users/5f9851cce829497b8ee1aac2cc51c9f0/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:37.868493 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d008e15-f121-4a5f-bb33-2b94b2cfc31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=122348d3f18a4ae8911a3152b4d9d961, user_id=5f9851cce829497b8ee1aac2cc51c9f0, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:37.871159 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d008e15-f121-4a5f-bb33-2b94b2cfc31b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:37.881362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1319/2626] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:37 2022] PUT /identity/v3/projects/122348d3f18a4ae8911a3152b4d9d961/users/5f9851cce829497b8ee1aac2cc51c9f0/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:37.892256 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24558f-a14a-4e1f-b93d-8888ad12c838 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:37.942876 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4af648-1a9d-4527-8aaf-78b7fdfbe068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:37.943492 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4af648-1a9d-4527-8aaf-78b7fdfbe068 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:37.943764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4af648-1a9d-4527-8aaf-78b7fdfbe068 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:37.944037 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4af648-1a9d-4527-8aaf-78b7fdfbe068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:38.013393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:38.015973 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4af648-1a9d-4527-8aaf-78b7fdfbe068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:38.017603 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4af648-1a9d-4527-8aaf-78b7fdfbe068 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:38.029331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1308/2627] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:31:38.750668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5363c0-2f1e-49a3-b151-d18a487dcf5c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:38.751194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5363c0-2f1e-49a3-b151-d18a487dcf5c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:38.751194 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5363c0-2f1e-49a3-b151-d18a487dcf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:38.780688 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cd5363c0-2f1e-49a3-b151-d18a487dcf5c None None] MFA Rules not processed for user `5f9851cce829497b8ee1aac2cc51c9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:38.781966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cd5363c0-2f1e-49a3-b151-d18a487dcf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:38.854148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1320/2628] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:38.865722 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9c8c-acb5-4111-bb11-4915e65566da None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:38.866291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9c8c-acb5-4111-bb11-4915e65566da None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:38.866291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9c8c-acb5-4111-bb11-4915e65566da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:38.886958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-351f9c8c-acb5-4111-bb11-4915e65566da None None] MFA Rules not processed for user `53b95f4f7ac94fe48b984f19ae2ad00f`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:38.888286 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-351f9c8c-acb5-4111-bb11-4915e65566da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:38.965051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1309/2629] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:38.972387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5363c0-2f1e-49a3-b151-d18a487dcf5c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:38.974271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cd5363c0-2f1e-49a3-b151-d18a487dcf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:39.000407 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:39.060778 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5363c0-2f1e-49a3-b151-d18a487dcf5c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:39.066563 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27db219-c154-4fdd-ac62-2efec1bc0d88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:39.067177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27db219-c154-4fdd-ac62-2efec1bc0d88 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:39.067454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27db219-c154-4fdd-ac62-2efec1bc0d88 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:39.067725 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27db219-c154-4fdd-ac62-2efec1bc0d88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:39.075610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27db219-c154-4fdd-ac62-2efec1bc0d88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:39.077403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27db219-c154-4fdd-ac62-2efec1bc0d88 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:39.086156 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1321/2630] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:31:45.321921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f9c8c-acb5-4111-bb11-4915e65566da None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:45.394693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f9c8c-acb5-4111-bb11-4915e65566da None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:45.411993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7153c3-7b37-4a87-a8cd-487c3d4d7316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:45.412572 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7153c3-7b37-4a87-a8cd-487c3d4d7316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:45.412898 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7153c3-7b37-4a87-a8cd-487c3d4d7316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:45.413227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7153c3-7b37-4a87-a8cd-487c3d4d7316 admin admin] PATH_INFO: `/v3/users/b0724756a661443b916a2b5b82baf0bc` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:45.415550 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7153c3-7b37-4a87-a8cd-487c3d4d7316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0724756a661443b916a2b5b82baf0bc)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:45.418093 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7153c3-7b37-4a87-a8cd-487c3d4d7316 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:45.470565 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5e7153c3-7b37-4a87-a8cd-487c3d4d7316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0724756a661443b916a2b5b82baf0bc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:45.482511 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5e7153c3-7b37-4a87-a8cd-487c3d4d7316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0724756a661443b916a2b5b82baf0bc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:45.496737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5e7153c3-7b37-4a87-a8cd-487c3d4d7316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0724756a661443b916a2b5b82baf0bc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:45.504831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5e7153c3-7b37-4a87-a8cd-487c3d4d7316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0724756a661443b916a2b5b82baf0bc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:45.506737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5e7153c3-7b37-4a87-a8cd-487c3d4d7316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0724756a661443b916a2b5b82baf0bc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:45.512075 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1310/2631] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:45 2022] DELETE /identity/v3/users/b0724756a661443b916a2b5b82baf0bc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:45.516511 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003281e5-31e5-409e-b8ce-50118c9e7704 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:45.517008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003281e5-31e5-409e-b8ce-50118c9e7704 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:45.517169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003281e5-31e5-409e-b8ce-50118c9e7704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:45.536114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-003281e5-31e5-409e-b8ce-50118c9e7704 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:45.537339 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-003281e5-31e5-409e-b8ce-50118c9e7704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:45.596553 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1322/2632] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:31:45.606647 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7153c3-7b37-4a87-a8cd-487c3d4d7316 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:45.608497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5e7153c3-7b37-4a87-a8cd-487c3d4d7316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:45.632186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:45.682859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7153c3-7b37-4a87-a8cd-487c3d4d7316 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:45.686590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc419c7f-69a6-4a68-bbc5-4a4caf24b1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:45.687847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc419c7f-69a6-4a68-bbc5-4a4caf24b1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:45.688130 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc419c7f-69a6-4a68-bbc5-4a4caf24b1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:45.688407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc419c7f-69a6-4a68-bbc5-4a4caf24b1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:45.701511 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc419c7f-69a6-4a68-bbc5-4a4caf24b1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:45.704920 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc419c7f-69a6-4a68-bbc5-4a4caf24b1a4 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:45.715859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1311/2633] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:46.103031 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003281e5-31e5-409e-b8ce-50118c9e7704 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:46.104851 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-003281e5-31e5-409e-b8ce-50118c9e7704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:46.129286 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003281e5-31e5-409e-b8ce-50118c9e7704 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:46.135485 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:46.136228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:46.137199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:46.137199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49 admin admin] PATH_INFO: `/v3/projects/e8c2f1618ce341ea9957c9736e55715e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:46.138304 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c2f1618ce341ea9957c9736e55715e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:46.140330 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:46.204405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c2f1618ce341ea9957c9736e55715e', 'request_id': 'req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:46.212220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c2f1618ce341ea9957c9736e55715e', 'request_id': 'req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:46.221972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c2f1618ce341ea9957c9736e55715e', 'request_id': 'req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:46.236401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49 admin admin] The token cache is being invalidate because project e8c2f1618ce341ea9957c9736e55715e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:46.236745 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:46.237634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:46.239596 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1323/2634] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:46 2022] DELETE /identity/v3/projects/e8c2f1618ce341ea9957c9736e55715e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:46.243750 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc419c7f-69a6-4a68-bbc5-4a4caf24b1a4 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:46.254709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc419c7f-69a6-4a68-bbc5-4a4caf24b1a4 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:46.319348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d99d2f-2263-442b-abea-73c7a207b08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:46.320534 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d99d2f-2263-442b-abea-73c7a207b08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:46.320823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d99d2f-2263-442b-abea-73c7a207b08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:46.321095 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d99d2f-2263-442b-abea-73c7a207b08d admin admin] PATH_INFO: `/v3/users/ca650b79ef7d436fa839697caeef609a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:46.322338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d99d2f-2263-442b-abea-73c7a207b08d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca650b79ef7d436fa839697caeef609a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:46.324203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d99d2f-2263-442b-abea-73c7a207b08d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:46.379661 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-23d99d2f-2263-442b-abea-73c7a207b08d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca650b79ef7d436fa839697caeef609a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:46.390145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-23d99d2f-2263-442b-abea-73c7a207b08d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca650b79ef7d436fa839697caeef609a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:46.406174 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-23d99d2f-2263-442b-abea-73c7a207b08d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca650b79ef7d436fa839697caeef609a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:46.415210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-23d99d2f-2263-442b-abea-73c7a207b08d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca650b79ef7d436fa839697caeef609a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:46.416148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-23d99d2f-2263-442b-abea-73c7a207b08d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca650b79ef7d436fa839697caeef609a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:46.426044 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1312/2635] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:46 2022] DELETE /identity/v3/users/ca650b79ef7d436fa839697caeef609a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:46.715018 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:46.719293 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:46.749455 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f8bf4-6a78-4d63-a680-9b8be1fe8d49 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:46.782391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:46.818816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21603292-bef0-470e-9eb8-4e0451c5dba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:46.819530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21603292-bef0-470e-9eb8-4e0451c5dba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:46.819858 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21603292-bef0-470e-9eb8-4e0451c5dba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:46.820141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21603292-bef0-470e-9eb8-4e0451c5dba1 admin admin] PATH_INFO: `/v3/projects/96a85a824bbf4292872624f786f3a071` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:46.821370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21603292-bef0-470e-9eb8-4e0451c5dba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a85a824bbf4292872624f786f3a071)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:46.823413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21603292-bef0-470e-9eb8-4e0451c5dba1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:46.872089 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-21603292-bef0-470e-9eb8-4e0451c5dba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a85a824bbf4292872624f786f3a071', 'request_id': 'req-21603292-bef0-470e-9eb8-4e0451c5dba1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:46.877381 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-21603292-bef0-470e-9eb8-4e0451c5dba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a85a824bbf4292872624f786f3a071', 'request_id': 'req-21603292-bef0-470e-9eb8-4e0451c5dba1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:46.885863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-21603292-bef0-470e-9eb8-4e0451c5dba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a85a824bbf4292872624f786f3a071', 'request_id': 'req-21603292-bef0-470e-9eb8-4e0451c5dba1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:46.899035 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-21603292-bef0-470e-9eb8-4e0451c5dba1 admin admin] The token cache is being invalidate because project 96a85a824bbf4292872624f786f3a071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:46.899400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-21603292-bef0-470e-9eb8-4e0451c5dba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:46.899989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-21603292-bef0-470e-9eb8-4e0451c5dba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:46.902341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1324/2636] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:46 2022] DELETE /identity/v3/projects/96a85a824bbf4292872624f786f3a071 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:46.907113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69c84d-c95f-4df8-92ba-548057f87991 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:46.907674 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69c84d-c95f-4df8-92ba-548057f87991 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:46.908197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69c84d-c95f-4df8-92ba-548057f87991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:46.962257 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8c69c84d-c95f-4df8-92ba-548057f87991 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:46.963874 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8c69c84d-c95f-4df8-92ba-548057f87991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:47.051017 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:47.109199 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1313/2637] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:31:47.114660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9df72-884e-4e55-9c7f-4836801a8af9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:47.115234 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9df72-884e-4e55-9c7f-4836801a8af9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:47.115713 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9df72-884e-4e55-9c7f-4836801a8af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:47.141815 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3eb9df72-884e-4e55-9c7f-4836801a8af9 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:47.143910 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3eb9df72-884e-4e55-9c7f-4836801a8af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:47.163504 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1325/2638] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:47.164233 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69c84d-c95f-4df8-92ba-548057f87991 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:47.180819 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69c84d-c95f-4df8-92ba-548057f87991 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:47.188297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d961619-0e36-4861-9813-3894a6e5145c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:47.188959 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d961619-0e36-4861-9813-3894a6e5145c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:47.189234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d961619-0e36-4861-9813-3894a6e5145c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:47.189500 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d961619-0e36-4861-9813-3894a6e5145c admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:47.190197 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d961619-0e36-4861-9813-3894a6e5145c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:31:47.190498 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d961619-0e36-4861-9813-3894a6e5145c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:47.192092 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d961619-0e36-4861-9813-3894a6e5145c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:47.211450 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1314/2639] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:31:47.215637 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9df72-884e-4e55-9c7f-4836801a8af9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:47.229338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9df72-884e-4e55-9c7f-4836801a8af9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:47.235709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe95ec-d754-4fc5-8958-84acc324fce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:47.236434 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe95ec-d754-4fc5-8958-84acc324fce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:47.236918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe95ec-d754-4fc5-8958-84acc324fce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:47.237267 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe95ec-d754-4fc5-8958-84acc324fce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:47.238648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe95ec-d754-4fc5-8958-84acc324fce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:47.240446 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe95ec-d754-4fc5-8958-84acc324fce1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:47.289327 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1326/2640] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:47 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:47.289653 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d961619-0e36-4861-9813-3894a6e5145c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:47.304444 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d961619-0e36-4861-9813-3894a6e5145c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:47.381318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc89b8b-5667-4d8b-8c7b-539b31a82b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:47.383299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc89b8b-5667-4d8b-8c7b-539b31a82b7b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:47.383584 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc89b8b-5667-4d8b-8c7b-539b31a82b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:47.383858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc89b8b-5667-4d8b-8c7b-539b31a82b7b admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:47.384713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc89b8b-5667-4d8b-8c7b-539b31a82b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:47.386666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc89b8b-5667-4d8b-8c7b-539b31a82b7b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:47.417370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1315/2641] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:47 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:31:47.420264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe95ec-d754-4fc5-8958-84acc324fce1 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:47.435000 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe95ec-d754-4fc5-8958-84acc324fce1 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:47.443010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148924b-78ed-48c9-927b-0b588f47b8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:47.443678 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148924b-78ed-48c9-927b-0b588f47b8ba admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:47.443965 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148924b-78ed-48c9-927b-0b588f47b8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:47.444291 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148924b-78ed-48c9-927b-0b588f47b8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:47.445718 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148924b-78ed-48c9-927b-0b588f47b8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:47.452863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148924b-78ed-48c9-927b-0b588f47b8ba admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:47.458132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1327/2642] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:31:47.462016 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc89b8b-5667-4d8b-8c7b-539b31a82b7b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:47.473783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc89b8b-5667-4d8b-8c7b-539b31a82b7b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:47.479182 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76b5a2-4201-485a-b8a2-41b79eb6a1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:47.479455 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76b5a2-4201-485a-b8a2-41b79eb6a1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:47.479854 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76b5a2-4201-485a-b8a2-41b79eb6a1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:47.480029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76b5a2-4201-485a-b8a2-41b79eb6a1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:47.480884 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76b5a2-4201-485a-b8a2-41b79eb6a1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:47.482782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76b5a2-4201-485a-b8a2-41b79eb6a1c1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:47.633993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1316/2643] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:47.635522 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148924b-78ed-48c9-927b-0b588f47b8ba admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:47.646483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148924b-78ed-48c9-927b-0b588f47b8ba admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:47.651636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d377d4f-f26a-429d-a1bc-60020bd549ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:47.652705 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377d4f-f26a-429d-a1bc-60020bd549ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:47.653055 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377d4f-f26a-429d-a1bc-60020bd549ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:47.653390 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377d4f-f26a-429d-a1bc-60020bd549ae admin admin] PATH_INFO: `/v3/projects/73e62131bd514f1f9fd30222dcac32e5/users/d999ded131fb44f6887e399f64c98b5a/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:47.670812 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d377d4f-f26a-429d-a1bc-60020bd549ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e62131bd514f1f9fd30222dcac32e5, user_id=d999ded131fb44f6887e399f64c98b5a, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:47.673533 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d377d4f-f26a-429d-a1bc-60020bd549ae admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:47.689113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1328/2644] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:47 2022] PUT /identity/v3/projects/73e62131bd514f1f9fd30222dcac32e5/users/d999ded131fb44f6887e399f64c98b5a/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:31:47.702261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacdd52-1c23-4658-8a2f-4cebe382395a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:47.702661 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacdd52-1c23-4658-8a2f-4cebe382395a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:47.702947 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacdd52-1c23-4658-8a2f-4cebe382395a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:47.733053 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-dcacdd52-1c23-4658-8a2f-4cebe382395a None None] MFA Rules not processed for user `d999ded131fb44f6887e399f64c98b5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:47.734279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dcacdd52-1c23-4658-8a2f-4cebe382395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:47.833741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1317/2645] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:47.838258 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d377d4f-f26a-429d-a1bc-60020bd549ae admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:47.922726 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:47.932181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d377d4f-f26a-429d-a1bc-60020bd549ae admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:47.938946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f14ca-9fd0-4907-aeb4-5c4fa2a2ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:47.939799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f14ca-9fd0-4907-aeb4-5c4fa2a2ea34 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:47.940081 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f14ca-9fd0-4907-aeb4-5c4fa2a2ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:47.940353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f14ca-9fd0-4907-aeb4-5c4fa2a2ea34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:47.941090 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f14ca-9fd0-4907-aeb4-5c4fa2a2ea34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:47.943391 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f14ca-9fd0-4907-aeb4-5c4fa2a2ea34 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:47.970627 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1329/2646] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:47 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:47.974944 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacdd52-1c23-4658-8a2f-4cebe382395a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:47.987894 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacdd52-1c23-4658-8a2f-4cebe382395a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:48.022505 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:48.048950 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9afb6-4449-4b14-a5ae-3b8138fc9191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:48.049908 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9afb6-4449-4b14-a5ae-3b8138fc9191 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:48.050191 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9afb6-4449-4b14-a5ae-3b8138fc9191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:48.050470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9afb6-4449-4b14-a5ae-3b8138fc9191 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:48.051236 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9afb6-4449-4b14-a5ae-3b8138fc9191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:48.053397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9afb6-4449-4b14-a5ae-3b8138fc9191 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:48.075525 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1318/2647] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:47 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:48.079598 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f14ca-9fd0-4907-aeb4-5c4fa2a2ea34 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:48.089883 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f14ca-9fd0-4907-aeb4-5c4fa2a2ea34 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:48.095700 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886b50b-681b-4b4e-ba23-9afeef080034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:48.096328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886b50b-681b-4b4e-ba23-9afeef080034 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:48.096641 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886b50b-681b-4b4e-ba23-9afeef080034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:48.096919 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886b50b-681b-4b4e-ba23-9afeef080034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:48.097625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886b50b-681b-4b4e-ba23-9afeef080034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:48.099253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886b50b-681b-4b4e-ba23-9afeef080034 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:48.248103 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1330/2648] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:48.249394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9afb6-4449-4b14-a5ae-3b8138fc9191 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:48.260098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9afb6-4449-4b14-a5ae-3b8138fc9191 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:48.265355 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd9ef1-c3a5-439f-a29f-c3880257c2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:48.265630 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd9ef1-c3a5-439f-a29f-c3880257c2d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:48.265740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd9ef1-c3a5-439f-a29f-c3880257c2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:48.265974 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd9ef1-c3a5-439f-a29f-c3880257c2d9 admin admin] PATH_INFO: `/v3/projects/53585fa5611a4d2dac9af74848d7c548/users/29956e4a472641cabd8e0b3f71827f28/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:48.282377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd9ef1-c3a5-439f-a29f-c3880257c2d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53585fa5611a4d2dac9af74848d7c548, user_id=29956e4a472641cabd8e0b3f71827f28, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:48.285016 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd9ef1-c3a5-439f-a29f-c3880257c2d9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:48.302837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1319/2649] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:48 2022] PUT /identity/v3/projects/53585fa5611a4d2dac9af74848d7c548/users/29956e4a472641cabd8e0b3f71827f28/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:48.307153 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886b50b-681b-4b4e-ba23-9afeef080034 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:48.317068 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886b50b-681b-4b4e-ba23-9afeef080034 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:48.386332 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48eba97-385b-4e97-a31f-ed7303635e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:48.387243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eba97-385b-4e97-a31f-ed7303635e47 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:48.387710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eba97-385b-4e97-a31f-ed7303635e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:48.387996 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eba97-385b-4e97-a31f-ed7303635e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:48.388648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48eba97-385b-4e97-a31f-ed7303635e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:48.390230 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48eba97-385b-4e97-a31f-ed7303635e47 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:48.400441 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1331/2650] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:48.404992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd9ef1-c3a5-439f-a29f-c3880257c2d9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:48.416366 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd9ef1-c3a5-439f-a29f-c3880257c2d9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:48.421232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781db54-7bce-497c-9f63-e4caf4c9bb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:48.421883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781db54-7bce-497c-9f63-e4caf4c9bb76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:48.422161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781db54-7bce-497c-9f63-e4caf4c9bb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:48.422432 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781db54-7bce-497c-9f63-e4caf4c9bb76 admin admin] PATH_INFO: `/v3/projects/53585fa5611a4d2dac9af74848d7c548/users/29956e4a472641cabd8e0b3f71827f28/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:48.424415 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781db54-7bce-497c-9f63-e4caf4c9bb76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53585fa5611a4d2dac9af74848d7c548, user_id=29956e4a472641cabd8e0b3f71827f28, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:48.427110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781db54-7bce-497c-9f63-e4caf4c9bb76 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:48.441221 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1320/2651] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:48 2022] PUT /identity/v3/projects/53585fa5611a4d2dac9af74848d7c548/users/29956e4a472641cabd8e0b3f71827f28/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:48.453492 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af53e3-e3b0-4e34-941e-243459fb0cc0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:48.453773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af53e3-e3b0-4e34-941e-243459fb0cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:48.454041 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af53e3-e3b0-4e34-941e-243459fb0cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:48.488184 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-16af53e3-e3b0-4e34-941e-243459fb0cc0 None None] MFA Rules not processed for user `29956e4a472641cabd8e0b3f71827f28`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:48.489442 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-16af53e3-e3b0-4e34-941e-243459fb0cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:48.558975 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1332/2652] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:31:48.570610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781db54-7bce-497c-9f63-e4caf4c9bb76 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:48.572747 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f781db54-7bce-497c-9f63-e4caf4c9bb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:48.632749 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781db54-7bce-497c-9f63-e4caf4c9bb76 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:48.636642 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed21bb1-51a1-48a6-8766-675b97da184b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:48.637314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21bb1-51a1-48a6-8766-675b97da184b service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:48.637686 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21bb1-51a1-48a6-8766-675b97da184b service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:48.638022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21bb1-51a1-48a6-8766-675b97da184b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:48.648185 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed21bb1-51a1-48a6-8766-675b97da184b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:48.649788 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed21bb1-51a1-48a6-8766-675b97da184b service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:48.661648 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1321/2653] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:49.338060 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af53e3-e3b0-4e34-941e-243459fb0cc0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:49.419333 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:49.444888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af53e3-e3b0-4e34-941e-243459fb0cc0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:49.454895 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fc06d-42ca-4fad-a256-c4ce04dd9a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:49.456867 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fc06d-42ca-4fad-a256-c4ce04dd9a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:49.459063 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fc06d-42ca-4fad-a256-c4ce04dd9a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:49.459405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fc06d-42ca-4fad-a256-c4ce04dd9a78 admin admin] PATH_INFO: `/v3/users/d999ded131fb44f6887e399f64c98b5a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:49.462467 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fc06d-42ca-4fad-a256-c4ce04dd9a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d999ded131fb44f6887e399f64c98b5a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:49.464467 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fc06d-42ca-4fad-a256-c4ce04dd9a78 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:49.538497 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-bf3fc06d-42ca-4fad-a256-c4ce04dd9a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd999ded131fb44f6887e399f64c98b5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:49.552390 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-bf3fc06d-42ca-4fad-a256-c4ce04dd9a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd999ded131fb44f6887e399f64c98b5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:49.563239 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-bf3fc06d-42ca-4fad-a256-c4ce04dd9a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd999ded131fb44f6887e399f64c98b5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:49.573038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-bf3fc06d-42ca-4fad-a256-c4ce04dd9a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd999ded131fb44f6887e399f64c98b5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:49.573752 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-bf3fc06d-42ca-4fad-a256-c4ce04dd9a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd999ded131fb44f6887e399f64c98b5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:49.581606 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1333/2654] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:49 2022] DELETE /identity/v3/users/d999ded131fb44f6887e399f64c98b5a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:49.590155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446175b2-e795-40f6-ae9e-4415a3aeaa24 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:49.590644 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446175b2-e795-40f6-ae9e-4415a3aeaa24 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:49.590958 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446175b2-e795-40f6-ae9e-4415a3aeaa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:49.610146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-446175b2-e795-40f6-ae9e-4415a3aeaa24 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:49.611334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-446175b2-e795-40f6-ae9e-4415a3aeaa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:49.670441 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1322/2655] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:49.680727 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fc06d-42ca-4fad-a256-c4ce04dd9a78 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:49.682321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bf3fc06d-42ca-4fad-a256-c4ce04dd9a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:49.751639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fc06d-42ca-4fad-a256-c4ce04dd9a78 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:49.755346 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e0b82-dd3e-4906-a499-e2d40368cce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:49.755959 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e0b82-dd3e-4906-a499-e2d40368cce5 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:49.756238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e0b82-dd3e-4906-a499-e2d40368cce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:49.756542 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e0b82-dd3e-4906-a499-e2d40368cce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:49.766922 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e0b82-dd3e-4906-a499-e2d40368cce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:49.768519 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e0b82-dd3e-4906-a499-e2d40368cce5 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:49.779347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1334/2656] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:50.352133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446175b2-e795-40f6-ae9e-4415a3aeaa24 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:50.353560 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-446175b2-e795-40f6-ae9e-4415a3aeaa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:50.365011 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446175b2-e795-40f6-ae9e-4415a3aeaa24 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:50.370063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12dfa5-133e-427e-b5cb-cd08c7746263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:50.370673 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12dfa5-133e-427e-b5cb-cd08c7746263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:50.370945 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12dfa5-133e-427e-b5cb-cd08c7746263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:50.371211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12dfa5-133e-427e-b5cb-cd08c7746263 admin admin] PATH_INFO: `/v3/projects/73e62131bd514f1f9fd30222dcac32e5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:50.372292 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12dfa5-133e-427e-b5cb-cd08c7746263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73e62131bd514f1f9fd30222dcac32e5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:50.374209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12dfa5-133e-427e-b5cb-cd08c7746263 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:50.411405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:50.432173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-eb12dfa5-133e-427e-b5cb-cd08c7746263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e62131bd514f1f9fd30222dcac32e5', 'request_id': 'req-eb12dfa5-133e-427e-b5cb-cd08c7746263'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:50.439858 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-eb12dfa5-133e-427e-b5cb-cd08c7746263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e62131bd514f1f9fd30222dcac32e5', 'request_id': 'req-eb12dfa5-133e-427e-b5cb-cd08c7746263'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:50.447256 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-eb12dfa5-133e-427e-b5cb-cd08c7746263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e62131bd514f1f9fd30222dcac32e5', 'request_id': 'req-eb12dfa5-133e-427e-b5cb-cd08c7746263'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:50.459096 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-eb12dfa5-133e-427e-b5cb-cd08c7746263 admin admin] The token cache is being invalidate because project 73e62131bd514f1f9fd30222dcac32e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:50.459461 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-eb12dfa5-133e-427e-b5cb-cd08c7746263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:50.460232 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-eb12dfa5-133e-427e-b5cb-cd08c7746263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:50.463474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1323/2657] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:50 2022] DELETE /identity/v3/projects/73e62131bd514f1f9fd30222dcac32e5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:50.469069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e0b82-dd3e-4906-a499-e2d40368cce5 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:50.483491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e0b82-dd3e-4906-a499-e2d40368cce5 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:50.542371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000cbf7-ea08-4909-867b-354b9c4f1270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:50.543005 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000cbf7-ea08-4909-867b-354b9c4f1270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:50.543292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000cbf7-ea08-4909-867b-354b9c4f1270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:50.543554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000cbf7-ea08-4909-867b-354b9c4f1270 admin admin] PATH_INFO: `/v3/users/29956e4a472641cabd8e0b3f71827f28` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:50.545212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000cbf7-ea08-4909-867b-354b9c4f1270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29956e4a472641cabd8e0b3f71827f28)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:50.547122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000cbf7-ea08-4909-867b-354b9c4f1270 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:50.561114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:50.595562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3000cbf7-ea08-4909-867b-354b9c4f1270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29956e4a472641cabd8e0b3f71827f28'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:50.621210 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3000cbf7-ea08-4909-867b-354b9c4f1270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29956e4a472641cabd8e0b3f71827f28'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:50.631101 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3000cbf7-ea08-4909-867b-354b9c4f1270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29956e4a472641cabd8e0b3f71827f28'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:50.641392 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3000cbf7-ea08-4909-867b-354b9c4f1270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29956e4a472641cabd8e0b3f71827f28'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:50.642358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3000cbf7-ea08-4909-867b-354b9c4f1270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29956e4a472641cabd8e0b3f71827f28'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:50.650070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1335/2658] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:50 2022] DELETE /identity/v3/users/29956e4a472641cabd8e0b3f71827f28 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:51.072566 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12dfa5-133e-427e-b5cb-cd08c7746263 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:51.074737 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-eb12dfa5-133e-427e-b5cb-cd08c7746263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:51.092067 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12dfa5-133e-427e-b5cb-cd08c7746263 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:51.187990 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d096e6-88ce-46aa-87ed-eab389663000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:51.188812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d096e6-88ce-46aa-87ed-eab389663000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:51.189149 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d096e6-88ce-46aa-87ed-eab389663000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:51.189497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d096e6-88ce-46aa-87ed-eab389663000 admin admin] PATH_INFO: `/v3/projects/53585fa5611a4d2dac9af74848d7c548` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:51.190851 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d096e6-88ce-46aa-87ed-eab389663000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53585fa5611a4d2dac9af74848d7c548)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:51.193033 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d096e6-88ce-46aa-87ed-eab389663000 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:51.295808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c5d096e6-88ce-46aa-87ed-eab389663000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53585fa5611a4d2dac9af74848d7c548', 'request_id': 'req-c5d096e6-88ce-46aa-87ed-eab389663000'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:51.308118 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c5d096e6-88ce-46aa-87ed-eab389663000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53585fa5611a4d2dac9af74848d7c548', 'request_id': 'req-c5d096e6-88ce-46aa-87ed-eab389663000'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:51.323298 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c5d096e6-88ce-46aa-87ed-eab389663000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53585fa5611a4d2dac9af74848d7c548', 'request_id': 'req-c5d096e6-88ce-46aa-87ed-eab389663000'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:51.340066 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c5d096e6-88ce-46aa-87ed-eab389663000 admin admin] The token cache is being invalidate because project 53585fa5611a4d2dac9af74848d7c548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:51.340430 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c5d096e6-88ce-46aa-87ed-eab389663000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:51.341730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c5d096e6-88ce-46aa-87ed-eab389663000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:51.343702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1324/2659] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:51 2022] DELETE /identity/v3/projects/53585fa5611a4d2dac9af74848d7c548 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:51.348664 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6f9d9-2df4-48c4-84a7-a2ef59736c82 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:51.349176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6f9d9-2df4-48c4-84a7-a2ef59736c82 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:51.349439 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6f9d9-2df4-48c4-84a7-a2ef59736c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:51.379034 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f7a6f9d9-2df4-48c4-84a7-a2ef59736c82 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:51.380313 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f7a6f9d9-2df4-48c4-84a7-a2ef59736c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:51.458091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1336/2660] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:51.465489 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81efe9-785f-42e3-96e1-06e201c051e7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:51.465847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81efe9-785f-42e3-96e1-06e201c051e7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:51.466194 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81efe9-785f-42e3-96e1-06e201c051e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:51.509024 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8e81efe9-785f-42e3-96e1-06e201c051e7 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:51.510329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8e81efe9-785f-42e3-96e1-06e201c051e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:51.520126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1325/2661] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:51.524240 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6f9d9-2df4-48c4-84a7-a2ef59736c82 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:51.538534 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6f9d9-2df4-48c4-84a7-a2ef59736c82 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:51.544651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5b002-1382-4ae1-b2c0-7d0b5f8cd56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:51.545279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5b002-1382-4ae1-b2c0-7d0b5f8cd56c admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:51.545554 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5b002-1382-4ae1-b2c0-7d0b5f8cd56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:51.545940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5b002-1382-4ae1-b2c0-7d0b5f8cd56c admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:51.546571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5b002-1382-4ae1-b2c0-7d0b5f8cd56c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:31:51.546871 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5b002-1382-4ae1-b2c0-7d0b5f8cd56c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:51.549707 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5b002-1382-4ae1-b2c0-7d0b5f8cd56c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:51.569397 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1337/2662] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:31:51.573488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81efe9-785f-42e3-96e1-06e201c051e7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:51.584470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81efe9-785f-42e3-96e1-06e201c051e7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:51.590526 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e835d3f-fdb3-419f-9717-98154492c7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:51.591075 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e835d3f-fdb3-419f-9717-98154492c7ec admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:51.591347 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e835d3f-fdb3-419f-9717-98154492c7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:51.591610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e835d3f-fdb3-419f-9717-98154492c7ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:51.592404 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e835d3f-fdb3-419f-9717-98154492c7ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:51.594440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e835d3f-fdb3-419f-9717-98154492c7ec admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:51.635280 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1326/2663] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:51 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:31:51.636201 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5b002-1382-4ae1-b2c0-7d0b5f8cd56c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:51.648524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5b002-1382-4ae1-b2c0-7d0b5f8cd56c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:51.708665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe8130-e3cb-465c-ab9b-ebd76d56e8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:51.709356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe8130-e3cb-465c-ab9b-ebd76d56e8dc admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:51.709700 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe8130-e3cb-465c-ab9b-ebd76d56e8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:51.710632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe8130-e3cb-465c-ab9b-ebd76d56e8dc admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:51.711321 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe8130-e3cb-465c-ab9b-ebd76d56e8dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:51.713607 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe8130-e3cb-465c-ab9b-ebd76d56e8dc admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:51.736461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1338/2664] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:51 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:51.740575 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e835d3f-fdb3-419f-9717-98154492c7ec admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:51.750829 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e835d3f-fdb3-419f-9717-98154492c7ec admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:51.755463 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab5d44-5d95-4e0c-a46f-b050f6693b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:51.756048 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab5d44-5d95-4e0c-a46f-b050f6693b77 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:51.756324 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab5d44-5d95-4e0c-a46f-b050f6693b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:51.756625 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab5d44-5d95-4e0c-a46f-b050f6693b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:51.757795 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab5d44-5d95-4e0c-a46f-b050f6693b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:51.759417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab5d44-5d95-4e0c-a46f-b050f6693b77 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:51.770120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1327/2665] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:31:51.774923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe8130-e3cb-465c-ab9b-ebd76d56e8dc admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:51.785385 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe8130-e3cb-465c-ab9b-ebd76d56e8dc admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:51.792310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36451564-146e-46e2-bd8c-4a387aedc668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:51.792961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36451564-146e-46e2-bd8c-4a387aedc668 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:51.793235 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36451564-146e-46e2-bd8c-4a387aedc668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:51.793495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab5d44-5d95-4e0c-a46f-b050f6693b77 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:51.793612 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36451564-146e-46e2-bd8c-4a387aedc668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:51.794140 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36451564-146e-46e2-bd8c-4a387aedc668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:51.795498 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-beab5d44-5d95-4e0c-a46f-b050f6693b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:51.795718 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36451564-146e-46e2-bd8c-4a387aedc668 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:51.798168 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:51.811863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1339/2666] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:51.812709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36451564-146e-46e2-bd8c-4a387aedc668 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:51.812878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab5d44-5d95-4e0c-a46f-b050f6693b77 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:51.817531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a57621-1a14-4f62-a140-b8b7ae27fc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:51.818145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a57621-1a14-4f62-a140-b8b7ae27fc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:51.818416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a57621-1a14-4f62-a140-b8b7ae27fc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:51.818682 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a57621-1a14-4f62-a140-b8b7ae27fc50 admin admin] PATH_INFO: `/v3/users/67b708d5cc294d99a1183717487966a0` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:51.820335 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a57621-1a14-4f62-a140-b8b7ae27fc50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67b708d5cc294d99a1183717487966a0)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:51.822269 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a57621-1a14-4f62-a140-b8b7ae27fc50 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:51.822755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36451564-146e-46e2-bd8c-4a387aedc668 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:51.823988 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:51.828243 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d77d32-392a-43fc-a165-b1537a23216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:51.829001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d77d32-392a-43fc-a165-b1537a23216a admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:51.829341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d77d32-392a-43fc-a165-b1537a23216a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:51.829681 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d77d32-392a-43fc-a165-b1537a23216a admin admin] PATH_INFO: `/v3/projects/34b36b546da044f0a3dfc6c5069e104b/users/81d013c13b4f4ac7bbc470c26ff72153/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:51.845561 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d77d32-392a-43fc-a165-b1537a23216a admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b36b546da044f0a3dfc6c5069e104b, user_id=81d013c13b4f4ac7bbc470c26ff72153, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:51.848278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d77d32-392a-43fc-a165-b1537a23216a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:51.862085 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1340/2667] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:51 2022] PUT /identity/v3/projects/34b36b546da044f0a3dfc6c5069e104b/users/81d013c13b4f4ac7bbc470c26ff72153/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:51.872628 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea74a9-6e24-4f0c-9825-ef1554fedb33 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:51.872914 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea74a9-6e24-4f0c-9825-ef1554fedb33 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:51.873182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea74a9-6e24-4f0c-9825-ef1554fedb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:51.874926 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-52a57621-1a14-4f62-a140-b8b7ae27fc50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b708d5cc294d99a1183717487966a0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:51.883786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-52a57621-1a14-4f62-a140-b8b7ae27fc50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b708d5cc294d99a1183717487966a0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:51.898081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-52a57621-1a14-4f62-a140-b8b7ae27fc50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b708d5cc294d99a1183717487966a0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:51.906707 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c3ea74a9-6e24-4f0c-9825-ef1554fedb33 None None] MFA Rules not processed for user `81d013c13b4f4ac7bbc470c26ff72153`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:51.907893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c3ea74a9-6e24-4f0c-9825-ef1554fedb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:51.909547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-52a57621-1a14-4f62-a140-b8b7ae27fc50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b708d5cc294d99a1183717487966a0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:51.911026 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-52a57621-1a14-4f62-a140-b8b7ae27fc50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b708d5cc294d99a1183717487966a0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:51.918317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1328/2668] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:51 2022] DELETE /identity/v3/users/67b708d5cc294d99a1183717487966a0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:31:51.980551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1341/2669] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:51.985050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a57621-1a14-4f62-a140-b8b7ae27fc50 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:51.986964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-52a57621-1a14-4f62-a140-b8b7ae27fc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:52.080023 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a57621-1a14-4f62-a140-b8b7ae27fc50 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:52.086414 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114713ed-cce6-4cbb-bb8b-0150460c9e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:52.087032 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114713ed-cce6-4cbb-bb8b-0150460c9e0d admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:52.087317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114713ed-cce6-4cbb-bb8b-0150460c9e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:52.087584 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114713ed-cce6-4cbb-bb8b-0150460c9e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:52.088210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114713ed-cce6-4cbb-bb8b-0150460c9e0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:52.090420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114713ed-cce6-4cbb-bb8b-0150460c9e0d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:52.119789 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1329/2670] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:51 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:52.123926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea74a9-6e24-4f0c-9825-ef1554fedb33 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:52.155900 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114713ed-cce6-4cbb-bb8b-0150460c9e0d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:52.158007 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-114713ed-cce6-4cbb-bb8b-0150460c9e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:52.207374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea74a9-6e24-4f0c-9825-ef1554fedb33 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:52.239431 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114713ed-cce6-4cbb-bb8b-0150460c9e0d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:52.247132 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb742b-5550-440b-8ab7-7e5126113c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:52.247764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb742b-5550-440b-8ab7-7e5126113c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:52.248046 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb742b-5550-440b-8ab7-7e5126113c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:52.248322 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb742b-5550-440b-8ab7-7e5126113c73 admin admin] PATH_INFO: `/v3/projects/b85a720598944fbfbafa18e35d7b0545` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:52.249506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb742b-5550-440b-8ab7-7e5126113c73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85a720598944fbfbafa18e35d7b0545)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:52.251401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb742b-5550-440b-8ab7-7e5126113c73 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:52.259154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:52.285325 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d9070-8e1d-487c-b87f-01585b0cd31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:52.285325 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d9070-8e1d-487c-b87f-01585b0cd31e admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:52.285763 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d9070-8e1d-487c-b87f-01585b0cd31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:52.286142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d9070-8e1d-487c-b87f-01585b0cd31e admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:52.286871 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d9070-8e1d-487c-b87f-01585b0cd31e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:52.289668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d9070-8e1d-487c-b87f-01585b0cd31e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:52.308382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:52.309265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fddb742b-5550-440b-8ab7-7e5126113c73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85a720598944fbfbafa18e35d7b0545', 'request_id': 'req-fddb742b-5550-440b-8ab7-7e5126113c73'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:52.314731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1342/2671] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:52 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:31:52.319497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fddb742b-5550-440b-8ab7-7e5126113c73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85a720598944fbfbafa18e35d7b0545', 'request_id': 'req-fddb742b-5550-440b-8ab7-7e5126113c73'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:52.320281 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d9070-8e1d-487c-b87f-01585b0cd31e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:52.333148 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fddb742b-5550-440b-8ab7-7e5126113c73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85a720598944fbfbafa18e35d7b0545', 'request_id': 'req-fddb742b-5550-440b-8ab7-7e5126113c73'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:52.334649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d9070-8e1d-487c-b87f-01585b0cd31e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:52.345569 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fddb742b-5550-440b-8ab7-7e5126113c73 admin admin] The token cache is being invalidate because project b85a720598944fbfbafa18e35d7b0545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:52.345908 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fddb742b-5550-440b-8ab7-7e5126113c73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:52.346551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fddb742b-5550-440b-8ab7-7e5126113c73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:52.348081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1330/2672] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:52 2022] DELETE /identity/v3/projects/b85a720598944fbfbafa18e35d7b0545 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:52.352740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb742b-5550-440b-8ab7-7e5126113c73 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:52.354085 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fddb742b-5550-440b-8ab7-7e5126113c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:52.429010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b297a7-f66a-441d-b07f-230bcb5fba34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:52.429565 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b297a7-f66a-441d-b07f-230bcb5fba34 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:52.429845 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b297a7-f66a-441d-b07f-230bcb5fba34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:52.430253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b297a7-f66a-441d-b07f-230bcb5fba34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:52.431106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b297a7-f66a-441d-b07f-230bcb5fba34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:52.432875 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b297a7-f66a-441d-b07f-230bcb5fba34 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:52.439230 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb742b-5550-440b-8ab7-7e5126113c73 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:52.443478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1343/2673] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:52.444913 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce3e3e-ed99-4e1f-bbfe-d03ba4a620aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:52.445729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce3e3e-ed99-4e1f-bbfe-d03ba4a620aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:52.445949 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce3e3e-ed99-4e1f-bbfe-d03ba4a620aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:52.446505 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce3e3e-ed99-4e1f-bbfe-d03ba4a620aa admin admin] PATH_INFO: `/v3/users/68e3ade64abc425f8cbdac88f5177e0d` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:52.447719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce3e3e-ed99-4e1f-bbfe-d03ba4a620aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=68e3ade64abc425f8cbdac88f5177e0d)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:52.448003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b297a7-f66a-441d-b07f-230bcb5fba34 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:52.450050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-08b297a7-f66a-441d-b07f-230bcb5fba34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:52.450177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce3e3e-ed99-4e1f-bbfe-d03ba4a620aa admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:52.462728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b297a7-f66a-441d-b07f-230bcb5fba34 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:52.469829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024459b-0466-434d-bc87-c193c684c886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:52.470552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024459b-0466-434d-bc87-c193c684c886 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:52.470967 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024459b-0466-434d-bc87-c193c684c886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:52.471295 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024459b-0466-434d-bc87-c193c684c886 admin admin] PATH_INFO: `/v3/projects/db3e02b56df946d89e0dd77ad1b320db/users/49df30491a0f421aadf8e0ef9b22c211/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:52.495781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024459b-0466-434d-bc87-c193c684c886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3e02b56df946d89e0dd77ad1b320db, user_id=49df30491a0f421aadf8e0ef9b22c211, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:52.498451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024459b-0466-434d-bc87-c193c684c886 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:52.511186 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1344/2674] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:52 2022] PUT /identity/v3/projects/db3e02b56df946d89e0dd77ad1b320db/users/49df30491a0f421aadf8e0ef9b22c211/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:31:52.512372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-66ce3e3e-ed99-4e1f-bbfe-d03ba4a620aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68e3ade64abc425f8cbdac88f5177e0d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:52.515156 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024459b-0466-434d-bc87-c193c684c886 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:52.520303 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-66ce3e3e-ed99-4e1f-bbfe-d03ba4a620aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68e3ade64abc425f8cbdac88f5177e0d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:52.533208 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-66ce3e3e-ed99-4e1f-bbfe-d03ba4a620aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68e3ade64abc425f8cbdac88f5177e0d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:52.542795 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-66ce3e3e-ed99-4e1f-bbfe-d03ba4a620aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68e3ade64abc425f8cbdac88f5177e0d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:52.543504 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-66ce3e3e-ed99-4e1f-bbfe-d03ba4a620aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68e3ade64abc425f8cbdac88f5177e0d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:52.549537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1331/2675] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:52 2022] DELETE /identity/v3/users/68e3ade64abc425f8cbdac88f5177e0d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:31:52.578502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024459b-0466-434d-bc87-c193c684c886 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:52.644188 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7748383-d341-4581-9efe-0af838b02ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:52.645111 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7748383-d341-4581-9efe-0af838b02ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:52.645543 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7748383-d341-4581-9efe-0af838b02ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:52.646033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7748383-d341-4581-9efe-0af838b02ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:52.646480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7748383-d341-4581-9efe-0af838b02ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:52.648897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7748383-d341-4581-9efe-0af838b02ea2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:52.664650 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1345/2676] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:31:52.667505 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce3e3e-ed99-4e1f-bbfe-d03ba4a620aa admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:52.669020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-66ce3e3e-ed99-4e1f-bbfe-d03ba4a620aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:52.706452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce3e3e-ed99-4e1f-bbfe-d03ba4a620aa admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:52.714561 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59eea5-4b5b-4515-afcb-2976f1158984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:52.715545 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59eea5-4b5b-4515-afcb-2976f1158984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:52.716105 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59eea5-4b5b-4515-afcb-2976f1158984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:52.716547 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59eea5-4b5b-4515-afcb-2976f1158984 admin admin] PATH_INFO: `/v3/projects/db3e02b56df946d89e0dd77ad1b320db/users/49df30491a0f421aadf8e0ef9b22c211/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:52.719003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59eea5-4b5b-4515-afcb-2976f1158984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3e02b56df946d89e0dd77ad1b320db, user_id=49df30491a0f421aadf8e0ef9b22c211, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:52.723733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59eea5-4b5b-4515-afcb-2976f1158984 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:52.730472 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:52.737793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1332/2677] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:52 2022] PUT /identity/v3/projects/db3e02b56df946d89e0dd77ad1b320db/users/49df30491a0f421aadf8e0ef9b22c211/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:52.748956 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7748383-d341-4581-9efe-0af838b02ea2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:52.750815 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dc760-94b4-4aac-9961-07e97300fed3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:52.751545 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dc760-94b4-4aac-9961-07e97300fed3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:52.751833 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dc760-94b4-4aac-9961-07e97300fed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:52.752361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e7748383-d341-4581-9efe-0af838b02ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:52.769525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7748383-d341-4581-9efe-0af838b02ea2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:52.783029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2e8dc760-94b4-4aac-9961-07e97300fed3 None None] MFA Rules not processed for user `49df30491a0f421aadf8e0ef9b22c211`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:52.784368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2e8dc760-94b4-4aac-9961-07e97300fed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:52.786789 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:52.835445 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:52.835985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:52.836264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:52.836548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e admin admin] PATH_INFO: `/v3/projects/c70d4e282e2a46cdb0adf1c5afa44877` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:52.837926 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70d4e282e2a46cdb0adf1c5afa44877)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:52.839636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:52.855508 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1333/2678] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:52.866691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dc760-94b4-4aac-9961-07e97300fed3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:52.868481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2e8dc760-94b4-4aac-9961-07e97300fed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:52.887984 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70d4e282e2a46cdb0adf1c5afa44877', 'request_id': 'req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:52.893579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70d4e282e2a46cdb0adf1c5afa44877', 'request_id': 'req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:52.903190 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70d4e282e2a46cdb0adf1c5afa44877', 'request_id': 'req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:52.914579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e admin admin] The token cache is being invalidate because project c70d4e282e2a46cdb0adf1c5afa44877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:52.914870 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:52.915513 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:52.917118 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1346/2679] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:52 2022] DELETE /identity/v3/projects/c70d4e282e2a46cdb0adf1c5afa44877 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:52.927922 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dc760-94b4-4aac-9961-07e97300fed3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:52.983478 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc568e0c-69c7-4da9-a74b-2c08ed350d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:52.984107 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc568e0c-69c7-4da9-a74b-2c08ed350d5e service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:52.984384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc568e0c-69c7-4da9-a74b-2c08ed350d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:52.984682 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc568e0c-69c7-4da9-a74b-2c08ed350d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:52.995910 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cc568e0c-69c7-4da9-a74b-2c08ed350d5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:53.053186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:53.066786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc568e0c-69c7-4da9-a74b-2c08ed350d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:53.068491 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc568e0c-69c7-4da9-a74b-2c08ed350d5e service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:53.079520 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1334/2680] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:31:53.447329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:53.448830 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:53.514752 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea50b6-d89c-4c82-9c16-eb2b9c3c7a9e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:53.519653 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63b200-fad1-4e17-84bc-63f4cab13522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:53.520278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63b200-fad1-4e17-84bc-63f4cab13522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:53.520551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63b200-fad1-4e17-84bc-63f4cab13522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:53.520851 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63b200-fad1-4e17-84bc-63f4cab13522 admin admin] PATH_INFO: `/v3/users/81d013c13b4f4ac7bbc470c26ff72153` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:53.521969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63b200-fad1-4e17-84bc-63f4cab13522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d013c13b4f4ac7bbc470c26ff72153)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:53.524731 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63b200-fad1-4e17-84bc-63f4cab13522 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:53.570866 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2b63b200-fad1-4e17-84bc-63f4cab13522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d013c13b4f4ac7bbc470c26ff72153'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:53.572043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:53.585286 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2b63b200-fad1-4e17-84bc-63f4cab13522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d013c13b4f4ac7bbc470c26ff72153'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:53.592609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2b63b200-fad1-4e17-84bc-63f4cab13522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d013c13b4f4ac7bbc470c26ff72153'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:53.599906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2b63b200-fad1-4e17-84bc-63f4cab13522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d013c13b4f4ac7bbc470c26ff72153'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:53.601232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2b63b200-fad1-4e17-84bc-63f4cab13522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d013c13b4f4ac7bbc470c26ff72153'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:53.607056 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1347/2681] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:53 2022] DELETE /identity/v3/users/81d013c13b4f4ac7bbc470c26ff72153 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:53.611589 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acf60a-a690-4e96-bdb0-3b5d1a39c1f3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:53.612164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acf60a-a690-4e96-bdb0-3b5d1a39c1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:53.612164 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acf60a-a690-4e96-bdb0-3b5d1a39c1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:53.630932 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-38acf60a-a690-4e96-bdb0-3b5d1a39c1f3 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:53.632216 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-38acf60a-a690-4e96-bdb0-3b5d1a39c1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:53.697671 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1335/2682] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:53.707605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63b200-fad1-4e17-84bc-63f4cab13522 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:53.708994 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2b63b200-fad1-4e17-84bc-63f4cab13522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:53.766126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acf60a-a690-4e96-bdb0-3b5d1a39c1f3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:53.767410 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63b200-fad1-4e17-84bc-63f4cab13522 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:53.767536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-38acf60a-a690-4e96-bdb0-3b5d1a39c1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:53.771055 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483994e-82bc-48d3-a98b-bb7252938cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:53.771686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483994e-82bc-48d3-a98b-bb7252938cfc service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:53.772000 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483994e-82bc-48d3-a98b-bb7252938cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:53.773117 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483994e-82bc-48d3-a98b-bb7252938cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:53.783037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483994e-82bc-48d3-a98b-bb7252938cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:53.784461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483994e-82bc-48d3-a98b-bb7252938cfc service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:53.794068 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1348/2683] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:53.828795 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acf60a-a690-4e96-bdb0-3b5d1a39c1f3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:53.832389 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c90b4d-94e3-4b45-aaba-7d3318ddd399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:53.833035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c90b4d-94e3-4b45-aaba-7d3318ddd399 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:53.833312 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c90b4d-94e3-4b45-aaba-7d3318ddd399 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:53.833583 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c90b4d-94e3-4b45-aaba-7d3318ddd399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:53.835905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-39c90b4d-94e3-4b45-aaba-7d3318ddd399 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:53.901134 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c90b4d-94e3-4b45-aaba-7d3318ddd399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:53.902831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c90b4d-94e3-4b45-aaba-7d3318ddd399 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:53.913676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1336/2684] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:54.066683 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483994e-82bc-48d3-a98b-bb7252938cfc service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:54.070477 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b483994e-82bc-48d3-a98b-bb7252938cfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:54.084199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483994e-82bc-48d3-a98b-bb7252938cfc service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:54.089904 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c5af9-566e-4dd1-99c2-fe892d81cc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:54.090538 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c5af9-566e-4dd1-99c2-fe892d81cc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:54.090914 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c5af9-566e-4dd1-99c2-fe892d81cc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:54.091252 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c5af9-566e-4dd1-99c2-fe892d81cc55 admin admin] PATH_INFO: `/v3/projects/34b36b546da044f0a3dfc6c5069e104b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:54.092300 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c5af9-566e-4dd1-99c2-fe892d81cc55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b36b546da044f0a3dfc6c5069e104b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:54.094939 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c5af9-566e-4dd1-99c2-fe892d81cc55 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:54.144075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-be5c5af9-566e-4dd1-99c2-fe892d81cc55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b36b546da044f0a3dfc6c5069e104b', 'request_id': 'req-be5c5af9-566e-4dd1-99c2-fe892d81cc55'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:54.150242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-be5c5af9-566e-4dd1-99c2-fe892d81cc55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b36b546da044f0a3dfc6c5069e104b', 'request_id': 'req-be5c5af9-566e-4dd1-99c2-fe892d81cc55'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:54.158155 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-be5c5af9-566e-4dd1-99c2-fe892d81cc55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b36b546da044f0a3dfc6c5069e104b', 'request_id': 'req-be5c5af9-566e-4dd1-99c2-fe892d81cc55'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:54.169592 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-be5c5af9-566e-4dd1-99c2-fe892d81cc55 admin admin] The token cache is being invalidate because project 34b36b546da044f0a3dfc6c5069e104b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:54.169880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-be5c5af9-566e-4dd1-99c2-fe892d81cc55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:54.170506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-be5c5af9-566e-4dd1-99c2-fe892d81cc55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:54.171972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1349/2685] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:54 2022] DELETE /identity/v3/projects/34b36b546da044f0a3dfc6c5069e104b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:54.176026 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c90b4d-94e3-4b45-aaba-7d3318ddd399 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:54.186729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c90b4d-94e3-4b45-aaba-7d3318ddd399 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:54.230285 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:54.250622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3382ed-8457-4a91-b32d-a2dadb2bb205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:54.251255 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3382ed-8457-4a91-b32d-a2dadb2bb205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:54.251532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3382ed-8457-4a91-b32d-a2dadb2bb205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:54.251834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3382ed-8457-4a91-b32d-a2dadb2bb205 admin admin] PATH_INFO: `/v3/users/49df30491a0f421aadf8e0ef9b22c211` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:54.253050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3382ed-8457-4a91-b32d-a2dadb2bb205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49df30491a0f421aadf8e0ef9b22c211)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:54.255013 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3382ed-8457-4a91-b32d-a2dadb2bb205 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:54.302572 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0e3382ed-8457-4a91-b32d-a2dadb2bb205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49df30491a0f421aadf8e0ef9b22c211'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:54.310662 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0e3382ed-8457-4a91-b32d-a2dadb2bb205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49df30491a0f421aadf8e0ef9b22c211'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:54.323860 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0e3382ed-8457-4a91-b32d-a2dadb2bb205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49df30491a0f421aadf8e0ef9b22c211'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:54.331009 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0e3382ed-8457-4a91-b32d-a2dadb2bb205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49df30491a0f421aadf8e0ef9b22c211'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:54.331746 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0e3382ed-8457-4a91-b32d-a2dadb2bb205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49df30491a0f421aadf8e0ef9b22c211'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:54.340397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1337/2686] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:54 2022] DELETE /identity/v3/users/49df30491a0f421aadf8e0ef9b22c211 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:31:54.624741 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c5af9-566e-4dd1-99c2-fe892d81cc55 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:54.626132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-be5c5af9-566e-4dd1-99c2-fe892d81cc55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:54.642443 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c5af9-566e-4dd1-99c2-fe892d81cc55 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:54.693105 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:54.705714 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e101b45-8ab5-4797-882a-fd6ab8d9da97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:54.706340 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e101b45-8ab5-4797-882a-fd6ab8d9da97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:54.706615 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e101b45-8ab5-4797-882a-fd6ab8d9da97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:54.706882 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e101b45-8ab5-4797-882a-fd6ab8d9da97 admin admin] PATH_INFO: `/v3/projects/db3e02b56df946d89e0dd77ad1b320db` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:54.708114 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e101b45-8ab5-4797-882a-fd6ab8d9da97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db3e02b56df946d89e0dd77ad1b320db)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:54.710946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e101b45-8ab5-4797-882a-fd6ab8d9da97 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:54.757699 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3e101b45-8ab5-4797-882a-fd6ab8d9da97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db3e02b56df946d89e0dd77ad1b320db', 'request_id': 'req-3e101b45-8ab5-4797-882a-fd6ab8d9da97'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:54.763025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3e101b45-8ab5-4797-882a-fd6ab8d9da97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db3e02b56df946d89e0dd77ad1b320db', 'request_id': 'req-3e101b45-8ab5-4797-882a-fd6ab8d9da97'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:54.770067 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3e101b45-8ab5-4797-882a-fd6ab8d9da97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db3e02b56df946d89e0dd77ad1b320db', 'request_id': 'req-3e101b45-8ab5-4797-882a-fd6ab8d9da97'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:54.781915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3e101b45-8ab5-4797-882a-fd6ab8d9da97 admin admin] The token cache is being invalidate because project db3e02b56df946d89e0dd77ad1b320db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:54.782204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3e101b45-8ab5-4797-882a-fd6ab8d9da97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:54.782824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3e101b45-8ab5-4797-882a-fd6ab8d9da97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:54.784283 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1350/2687] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:54 2022] DELETE /identity/v3/projects/db3e02b56df946d89e0dd77ad1b320db => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:54.789610 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d148d4-d1ac-4444-942e-5f10e254c43a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:54.790072 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d148d4-d1ac-4444-942e-5f10e254c43a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:54.790268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d148d4-d1ac-4444-942e-5f10e254c43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:54.809265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b9d148d4-d1ac-4444-942e-5f10e254c43a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:54.810467 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b9d148d4-d1ac-4444-942e-5f10e254c43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:54.874139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1338/2688] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:54.882076 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78c040-8e4f-41fe-8e49-738428588afe None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:54.882365 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78c040-8e4f-41fe-8e49-738428588afe None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:54.882628 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78c040-8e4f-41fe-8e49-738428588afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:54.902377 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5d78c040-8e4f-41fe-8e49-738428588afe None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:54.903500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5d78c040-8e4f-41fe-8e49-738428588afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:54.911275 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1351/2689] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:54.915424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d148d4-d1ac-4444-942e-5f10e254c43a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:54.924913 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d148d4-d1ac-4444-942e-5f10e254c43a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:54.929864 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c918ed-9880-449e-8d3b-b8bfa9f7e6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:54.930445 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c918ed-9880-449e-8d3b-b8bfa9f7e6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:54.930719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c918ed-9880-449e-8d3b-b8bfa9f7e6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:54.930985 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c918ed-9880-449e-8d3b-b8bfa9f7e6a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:54.931613 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c918ed-9880-449e-8d3b-b8bfa9f7e6a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:31:54.931911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c918ed-9880-449e-8d3b-b8bfa9f7e6a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:54.933506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c918ed-9880-449e-8d3b-b8bfa9f7e6a9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:54.945533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1339/2690] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:31:54.949880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78c040-8e4f-41fe-8e49-738428588afe None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:54.958869 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78c040-8e4f-41fe-8e49-738428588afe None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:54.963411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46133fdb-8a61-4e2a-b030-376325709cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:54.963983 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46133fdb-8a61-4e2a-b030-376325709cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:54.964256 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46133fdb-8a61-4e2a-b030-376325709cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:54.964522 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46133fdb-8a61-4e2a-b030-376325709cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:54.965162 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46133fdb-8a61-4e2a-b030-376325709cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:54.967054 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46133fdb-8a61-4e2a-b030-376325709cf0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:54.993705 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1352/2691] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:54 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:54.997830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c918ed-9880-449e-8d3b-b8bfa9f7e6a9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:55.008012 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c918ed-9880-449e-8d3b-b8bfa9f7e6a9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:55.051568 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:55.065177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a3ff1-af04-417b-be88-812f72d84a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:55.065768 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a3ff1-af04-417b-be88-812f72d84a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:55.066041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a3ff1-af04-417b-be88-812f72d84a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:55.066311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a3ff1-af04-417b-be88-812f72d84a54 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:55.066910 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a3ff1-af04-417b-be88-812f72d84a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:55.068823 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a3ff1-af04-417b-be88-812f72d84a54 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:55.089120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1340/2692] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:54 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:55.093229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46133fdb-8a61-4e2a-b030-376325709cf0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:55.103507 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46133fdb-8a61-4e2a-b030-376325709cf0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:55.108106 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb73ce-571a-4cce-ab74-de5f73539138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:55.108732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb73ce-571a-4cce-ab74-de5f73539138 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:55.109013 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb73ce-571a-4cce-ab74-de5f73539138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:55.109285 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb73ce-571a-4cce-ab74-de5f73539138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:55.109925 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb73ce-571a-4cce-ab74-de5f73539138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:55.111509 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb73ce-571a-4cce-ab74-de5f73539138 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:55.121636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1353/2693] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:55.125180 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a3ff1-af04-417b-be88-812f72d84a54 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:55.135466 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a3ff1-af04-417b-be88-812f72d84a54 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:55.140081 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d782936-26a1-42a3-8f18-72209e6d816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:55.140718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d782936-26a1-42a3-8f18-72209e6d816d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:55.140993 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d782936-26a1-42a3-8f18-72209e6d816d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:55.141261 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d782936-26a1-42a3-8f18-72209e6d816d admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:55.141917 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d782936-26a1-42a3-8f18-72209e6d816d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:55.143470 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d782936-26a1-42a3-8f18-72209e6d816d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:55.154982 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1341/2694] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:55.158942 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb73ce-571a-4cce-ab74-de5f73539138 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:55.168796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb73ce-571a-4cce-ab74-de5f73539138 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:55.173388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e4e39-4b71-4dfd-82ce-bfab39647db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:55.174028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e4e39-4b71-4dfd-82ce-bfab39647db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:55.174309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e4e39-4b71-4dfd-82ce-bfab39647db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:55.174587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e4e39-4b71-4dfd-82ce-bfab39647db3 admin admin] PATH_INFO: `/v3/projects/53bef5b043e54f4080627ed331d47e35/users/3cbb553b487e491b85918a76c1dbf38a/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:55.189132 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e4e39-4b71-4dfd-82ce-bfab39647db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53bef5b043e54f4080627ed331d47e35, user_id=3cbb553b487e491b85918a76c1dbf38a, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:55.191775 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e4e39-4b71-4dfd-82ce-bfab39647db3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:55.204207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1354/2695] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:55 2022] PUT /identity/v3/projects/53bef5b043e54f4080627ed331d47e35/users/3cbb553b487e491b85918a76c1dbf38a/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:55.214835 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764edd3-c7e0-4471-90a4-1ccd1787ab3b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:55.215116 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764edd3-c7e0-4471-90a4-1ccd1787ab3b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:55.215407 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764edd3-c7e0-4471-90a4-1ccd1787ab3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:55.243463 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6764edd3-c7e0-4471-90a4-1ccd1787ab3b None None] MFA Rules not processed for user `3cbb553b487e491b85918a76c1dbf38a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:55.244708 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6764edd3-c7e0-4471-90a4-1ccd1787ab3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:55.306811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1342/2696] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:55.317789 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e4e39-4b71-4dfd-82ce-bfab39647db3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:55.319962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-869e4e39-4b71-4dfd-82ce-bfab39647db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:55.374789 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e4e39-4b71-4dfd-82ce-bfab39647db3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:55.378433 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0022b80-4439-4f09-8474-fb07aeb82856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:55.379028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0022b80-4439-4f09-8474-fb07aeb82856 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:55.379309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0022b80-4439-4f09-8474-fb07aeb82856 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:55.379583 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0022b80-4439-4f09-8474-fb07aeb82856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:55.388204 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0022b80-4439-4f09-8474-fb07aeb82856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:55.389665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0022b80-4439-4f09-8474-fb07aeb82856 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:55.398969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1355/2697] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:55.422552 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764edd3-c7e0-4471-90a4-1ccd1787ab3b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:55.491713 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764edd3-c7e0-4471-90a4-1ccd1787ab3b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:55.496165 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674409d9-c525-48b7-99f9-268e0cca8899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:55.496806 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674409d9-c525-48b7-99f9-268e0cca8899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:55.497100 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674409d9-c525-48b7-99f9-268e0cca8899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:55.497350 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674409d9-c525-48b7-99f9-268e0cca8899 admin admin] PATH_INFO: `/v3/users/3cbb553b487e491b85918a76c1dbf38a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:55.498452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674409d9-c525-48b7-99f9-268e0cca8899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cbb553b487e491b85918a76c1dbf38a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:55.500328 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674409d9-c525-48b7-99f9-268e0cca8899 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:55.545951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-674409d9-c525-48b7-99f9-268e0cca8899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cbb553b487e491b85918a76c1dbf38a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:55.552766 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-674409d9-c525-48b7-99f9-268e0cca8899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cbb553b487e491b85918a76c1dbf38a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:55.557145 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:55.566846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-674409d9-c525-48b7-99f9-268e0cca8899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cbb553b487e491b85918a76c1dbf38a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:55.574019 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-674409d9-c525-48b7-99f9-268e0cca8899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cbb553b487e491b85918a76c1dbf38a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:55.574651 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-674409d9-c525-48b7-99f9-268e0cca8899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cbb553b487e491b85918a76c1dbf38a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:55.580318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1343/2698] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:55 2022] DELETE /identity/v3/users/3cbb553b487e491b85918a76c1dbf38a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:55.585488 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e73ab-133b-4ae6-97ab-638a8ad28d58 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:55.585773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e73ab-133b-4ae6-97ab-638a8ad28d58 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:55.586043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e73ab-133b-4ae6-97ab-638a8ad28d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:55.604141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c99e73ab-133b-4ae6-97ab-638a8ad28d58 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:55.605378 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c99e73ab-133b-4ae6-97ab-638a8ad28d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:55.617254 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:55.665116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1356/2699] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:55.674678 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674409d9-c525-48b7-99f9-268e0cca8899 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:55.676050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-674409d9-c525-48b7-99f9-268e0cca8899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:55.734551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674409d9-c525-48b7-99f9-268e0cca8899 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:55.738203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169b371-6555-4a1e-9a79-ad4dae23f458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:55.738797 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169b371-6555-4a1e-9a79-ad4dae23f458 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:55.739090 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169b371-6555-4a1e-9a79-ad4dae23f458 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:55.739345 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169b371-6555-4a1e-9a79-ad4dae23f458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:55.749153 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169b371-6555-4a1e-9a79-ad4dae23f458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:55.750556 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169b371-6555-4a1e-9a79-ad4dae23f458 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:55.760632 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1344/2700] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:56.041420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e73ab-133b-4ae6-97ab-638a8ad28d58 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:56.042853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c99e73ab-133b-4ae6-97ab-638a8ad28d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:56.059690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e73ab-133b-4ae6-97ab-638a8ad28d58 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:56.065480 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b2950-21d6-4c24-9476-4ee06c9bf787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:56.066116 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b2950-21d6-4c24-9476-4ee06c9bf787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:56.066393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b2950-21d6-4c24-9476-4ee06c9bf787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:56.066666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b2950-21d6-4c24-9476-4ee06c9bf787 admin admin] PATH_INFO: `/v3/projects/53bef5b043e54f4080627ed331d47e35` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:56.067881 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b2950-21d6-4c24-9476-4ee06c9bf787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53bef5b043e54f4080627ed331d47e35)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:56.069785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b2950-21d6-4c24-9476-4ee06c9bf787 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:56.125896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-778b2950-21d6-4c24-9476-4ee06c9bf787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53bef5b043e54f4080627ed331d47e35', 'request_id': 'req-778b2950-21d6-4c24-9476-4ee06c9bf787'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:56.133753 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-778b2950-21d6-4c24-9476-4ee06c9bf787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53bef5b043e54f4080627ed331d47e35', 'request_id': 'req-778b2950-21d6-4c24-9476-4ee06c9bf787'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:56.141587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-778b2950-21d6-4c24-9476-4ee06c9bf787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53bef5b043e54f4080627ed331d47e35', 'request_id': 'req-778b2950-21d6-4c24-9476-4ee06c9bf787'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:56.153050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-778b2950-21d6-4c24-9476-4ee06c9bf787 admin admin] The token cache is being invalidate because project 53bef5b043e54f4080627ed331d47e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:31:56.153338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-778b2950-21d6-4c24-9476-4ee06c9bf787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:56.153989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-778b2950-21d6-4c24-9476-4ee06c9bf787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:31:56.155459 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1357/2701] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:31:56 2022] DELETE /identity/v3/projects/53bef5b043e54f4080627ed331d47e35 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:31:56.160391 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8049d07-c212-453a-b4e6-feba012db0df None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:56.160930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8049d07-c212-453a-b4e6-feba012db0df None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:56.161129 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8049d07-c212-453a-b4e6-feba012db0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:56.181291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f8049d07-c212-453a-b4e6-feba012db0df None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:56.182447 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f8049d07-c212-453a-b4e6-feba012db0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:56.245670 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1345/2702] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:56.254090 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e9622-6e40-46a7-9f7b-896d30594aa1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:56.254407 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e9622-6e40-46a7-9f7b-896d30594aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:56.254867 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e9622-6e40-46a7-9f7b-896d30594aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:56.275097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e40e9622-6e40-46a7-9f7b-896d30594aa1 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:56.276310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e40e9622-6e40-46a7-9f7b-896d30594aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:56.284470 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1358/2703] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:31:56.289196 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8049d07-c212-453a-b4e6-feba012db0df None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:56.298731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8049d07-c212-453a-b4e6-feba012db0df None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:56.304327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900de134-3aea-4308-aca9-a21063a4f652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:56.304970 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900de134-3aea-4308-aca9-a21063a4f652 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:56.305240 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900de134-3aea-4308-aca9-a21063a4f652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:56.305516 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900de134-3aea-4308-aca9-a21063a4f652 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:56.306174 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900de134-3aea-4308-aca9-a21063a4f652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:31:56.306457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900de134-3aea-4308-aca9-a21063a4f652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:56.308044 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900de134-3aea-4308-aca9-a21063a4f652 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:56.319837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1346/2704] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:31:56.324203 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e9622-6e40-46a7-9f7b-896d30594aa1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:56.334223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e9622-6e40-46a7-9f7b-896d30594aa1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:56.339739 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0015fda-339b-49de-8df3-64851cdf964e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:56.340357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0015fda-339b-49de-8df3-64851cdf964e admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:56.340664 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0015fda-339b-49de-8df3-64851cdf964e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:56.340946 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0015fda-339b-49de-8df3-64851cdf964e admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:56.341595 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0015fda-339b-49de-8df3-64851cdf964e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:56.343502 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0015fda-339b-49de-8df3-64851cdf964e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:56.374889 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1359/2705] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:31:56 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:31:56.376008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900de134-3aea-4308-aca9-a21063a4f652 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:56.386756 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900de134-3aea-4308-aca9-a21063a4f652 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:56.462881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea4626-9e04-4fe8-a5ef-d75d5167e7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:56.463406 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea4626-9e04-4fe8-a5ef-d75d5167e7bb admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:56.463680 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea4626-9e04-4fe8-a5ef-d75d5167e7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:56.464001 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea4626-9e04-4fe8-a5ef-d75d5167e7bb admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:56.464688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea4626-9e04-4fe8-a5ef-d75d5167e7bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:56.467702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea4626-9e04-4fe8-a5ef-d75d5167e7bb admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:56.480420 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:56.506034 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1347/2706] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:31:56 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:31:56.510530 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0015fda-339b-49de-8df3-64851cdf964e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:56.529245 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0015fda-339b-49de-8df3-64851cdf964e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:56.543053 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d24d4-f13b-45ed-ba38-e62773d65d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:56.543806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d24d4-f13b-45ed-ba38-e62773d65d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:56.544141 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d24d4-f13b-45ed-ba38-e62773d65d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:56.544499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d24d4-f13b-45ed-ba38-e62773d65d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:56.545313 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d24d4-f13b-45ed-ba38-e62773d65d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:56.547011 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d24d4-f13b-45ed-ba38-e62773d65d2a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:56.557639 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1360/2707] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:56.561683 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea4626-9e04-4fe8-a5ef-d75d5167e7bb admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:56.571934 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea4626-9e04-4fe8-a5ef-d75d5167e7bb admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:56.576530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912779f-cbb7-4be1-8891-61c451a2f6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:56.577259 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912779f-cbb7-4be1-8891-61c451a2f6ce admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:56.577537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912779f-cbb7-4be1-8891-61c451a2f6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:56.577808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912779f-cbb7-4be1-8891-61c451a2f6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:56.578448 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912779f-cbb7-4be1-8891-61c451a2f6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:56.580015 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912779f-cbb7-4be1-8891-61c451a2f6ce admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:56.590953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1348/2708] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:31:56.595191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d24d4-f13b-45ed-ba38-e62773d65d2a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:56.605886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d24d4-f13b-45ed-ba38-e62773d65d2a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:56.611016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d0ea4-93a4-4dce-a399-70569e7ba545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:56.611782 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d0ea4-93a4-4dce-a399-70569e7ba545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:56.612055 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d0ea4-93a4-4dce-a399-70569e7ba545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:56.612329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d0ea4-93a4-4dce-a399-70569e7ba545 admin admin] PATH_INFO: `/v3/projects/ca621883b59f4c18b4fcc00daca3af54/users/562c56910a7d4cafbbd3482f0bb97b21/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:56.627539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d0ea4-93a4-4dce-a399-70569e7ba545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca621883b59f4c18b4fcc00daca3af54, user_id=562c56910a7d4cafbbd3482f0bb97b21, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:56.630309 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d0ea4-93a4-4dce-a399-70569e7ba545 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:56.642546 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1361/2709] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:31:56 2022] PUT /identity/v3/projects/ca621883b59f4c18b4fcc00daca3af54/users/562c56910a7d4cafbbd3482f0bb97b21/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:31:56.653548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98020537-4905-46b3-bffd-7b8279a7a32e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:56.653828 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98020537-4905-46b3-bffd-7b8279a7a32e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:56.654098 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98020537-4905-46b3-bffd-7b8279a7a32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:56.681085 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-98020537-4905-46b3-bffd-7b8279a7a32e None None] MFA Rules not processed for user `562c56910a7d4cafbbd3482f0bb97b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:31:56.682280 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-98020537-4905-46b3-bffd-7b8279a7a32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:56.744473 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1349/2710] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:31:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:31:56.755255 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d0ea4-93a4-4dce-a399-70569e7ba545 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:31:56.757077 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cf6d0ea4-93a4-4dce-a399-70569e7ba545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:31:56.802155 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:56.817465 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d0ea4-93a4-4dce-a399-70569e7ba545 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:31:56.821157 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d47036-b62c-4ca2-bde2-2c6bc4221671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:31:56.821751 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d47036-b62c-4ca2-bde2-2c6bc4221671 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:31:56.822029 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d47036-b62c-4ca2-bde2-2c6bc4221671 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:31:56.822296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d47036-b62c-4ca2-bde2-2c6bc4221671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:31:56.830479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d47036-b62c-4ca2-bde2-2c6bc4221671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:31:56.831896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d47036-b62c-4ca2-bde2-2c6bc4221671 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:31:56.841350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1362/2711] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:31:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:31:59.913301 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98020537-4905-46b3-bffd-7b8279a7a32e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:00.001980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98020537-4905-46b3-bffd-7b8279a7a32e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:00.008083 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548d842-74e7-475b-9e61-f5a476129b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:00.008920 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548d842-74e7-475b-9e61-f5a476129b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:00.009580 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548d842-74e7-475b-9e61-f5a476129b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:00.010052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548d842-74e7-475b-9e61-f5a476129b94 admin admin] PATH_INFO: `/v3/users/562c56910a7d4cafbbd3482f0bb97b21` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:00.011450 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548d842-74e7-475b-9e61-f5a476129b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562c56910a7d4cafbbd3482f0bb97b21)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:00.013852 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548d842-74e7-475b-9e61-f5a476129b94 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:00.077847 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c548d842-74e7-475b-9e61-f5a476129b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562c56910a7d4cafbbd3482f0bb97b21'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:00.087546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c548d842-74e7-475b-9e61-f5a476129b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562c56910a7d4cafbbd3482f0bb97b21'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:00.100964 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c548d842-74e7-475b-9e61-f5a476129b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562c56910a7d4cafbbd3482f0bb97b21'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:00.105528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:00.108616 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c548d842-74e7-475b-9e61-f5a476129b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562c56910a7d4cafbbd3482f0bb97b21'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:00.109666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c548d842-74e7-475b-9e61-f5a476129b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562c56910a7d4cafbbd3482f0bb97b21'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:00.117558 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1350/2712] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:31:59 2022] DELETE /identity/v3/users/562c56910a7d4cafbbd3482f0bb97b21 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:32:00.122027 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a8df9-23b1-41a7-8786-13d5da74e9ae None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:00.122487 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a8df9-23b1-41a7-8786-13d5da74e9ae None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:00.122634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a8df9-23b1-41a7-8786-13d5da74e9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:00.141963 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5a8a8df9-23b1-41a7-8786-13d5da74e9ae None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:00.143162 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5a8a8df9-23b1-41a7-8786-13d5da74e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:00.204981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1363/2713] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:00.215065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548d842-74e7-475b-9e61-f5a476129b94 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:00.216503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c548d842-74e7-475b-9e61-f5a476129b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:00.277856 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548d842-74e7-475b-9e61-f5a476129b94 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:00.281540 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b90bd-7304-4693-934e-11b09523ef4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:00.282139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b90bd-7304-4693-934e-11b09523ef4a service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:00.282418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b90bd-7304-4693-934e-11b09523ef4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:00.282743 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b90bd-7304-4693-934e-11b09523ef4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:00.293217 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b90bd-7304-4693-934e-11b09523ef4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:00.294641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b90bd-7304-4693-934e-11b09523ef4a service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:00.304833 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1351/2714] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:32:00.599785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a8df9-23b1-41a7-8786-13d5da74e9ae None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:00.602432 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5a8a8df9-23b1-41a7-8786-13d5da74e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:00.615666 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a8df9-23b1-41a7-8786-13d5da74e9ae None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:00.620944 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052e9b6-5a98-4e02-93cc-3ab9be46156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:00.621663 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052e9b6-5a98-4e02-93cc-3ab9be46156c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:00.622144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052e9b6-5a98-4e02-93cc-3ab9be46156c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:00.622419 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052e9b6-5a98-4e02-93cc-3ab9be46156c admin admin] PATH_INFO: `/v3/projects/ca621883b59f4c18b4fcc00daca3af54` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:00.623599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052e9b6-5a98-4e02-93cc-3ab9be46156c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca621883b59f4c18b4fcc00daca3af54)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:00.625670 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052e9b6-5a98-4e02-93cc-3ab9be46156c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:00.678128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5052e9b6-5a98-4e02-93cc-3ab9be46156c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca621883b59f4c18b4fcc00daca3af54', 'request_id': 'req-5052e9b6-5a98-4e02-93cc-3ab9be46156c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:00.687547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5052e9b6-5a98-4e02-93cc-3ab9be46156c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca621883b59f4c18b4fcc00daca3af54', 'request_id': 'req-5052e9b6-5a98-4e02-93cc-3ab9be46156c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:00.697215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5052e9b6-5a98-4e02-93cc-3ab9be46156c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca621883b59f4c18b4fcc00daca3af54', 'request_id': 'req-5052e9b6-5a98-4e02-93cc-3ab9be46156c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:00.714583 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5052e9b6-5a98-4e02-93cc-3ab9be46156c admin admin] The token cache is being invalidate because project ca621883b59f4c18b4fcc00daca3af54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:32:00.714997 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5052e9b6-5a98-4e02-93cc-3ab9be46156c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:00.715723 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5052e9b6-5a98-4e02-93cc-3ab9be46156c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:00.717595 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1364/2715] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:32:00 2022] DELETE /identity/v3/projects/ca621883b59f4c18b4fcc00daca3af54 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:32:00.726311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3b685-2d54-4089-8049-a5df6f169f67 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:00.726311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3b685-2d54-4089-8049-a5df6f169f67 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:00.726311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3b685-2d54-4089-8049-a5df6f169f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:00.747735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-12b3b685-2d54-4089-8049-a5df6f169f67 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:00.749213 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-12b3b685-2d54-4089-8049-a5df6f169f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:00.830579 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1352/2716] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:32:00.839145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242e2fb-712a-48e2-a59f-7b52fc24adc3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:00.839427 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242e2fb-712a-48e2-a59f-7b52fc24adc3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:00.839705 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242e2fb-712a-48e2-a59f-7b52fc24adc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:00.863040 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1242e2fb-712a-48e2-a59f-7b52fc24adc3 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:00.864256 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1242e2fb-712a-48e2-a59f-7b52fc24adc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:00.873982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1365/2717] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:32:00.878341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3b685-2d54-4089-8049-a5df6f169f67 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:00.895796 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3b685-2d54-4089-8049-a5df6f169f67 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:00.906093 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d53ccf-4ef4-42e6-86a5-0360eb58edab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:00.906943 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d53ccf-4ef4-42e6-86a5-0360eb58edab admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:00.907295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d53ccf-4ef4-42e6-86a5-0360eb58edab admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:00.907639 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d53ccf-4ef4-42e6-86a5-0360eb58edab admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:00.909051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d53ccf-4ef4-42e6-86a5-0360eb58edab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:32:00.909323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d53ccf-4ef4-42e6-86a5-0360eb58edab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:00.910956 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d53ccf-4ef4-42e6-86a5-0360eb58edab admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:00.931063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1353/2718] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:32:00.933093 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242e2fb-712a-48e2-a59f-7b52fc24adc3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:00.943820 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242e2fb-712a-48e2-a59f-7b52fc24adc3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:00.950901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929397d-dbea-4955-9a51-02b0d0ea590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:00.951573 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929397d-dbea-4955-9a51-02b0d0ea590e admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:00.951921 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929397d-dbea-4955-9a51-02b0d0ea590e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:00.952264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929397d-dbea-4955-9a51-02b0d0ea590e admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:00.953066 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929397d-dbea-4955-9a51-02b0d0ea590e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:00.960907 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929397d-dbea-4955-9a51-02b0d0ea590e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:01.019997 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1366/2719] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:32:00 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:32:01.022725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d53ccf-4ef4-42e6-86a5-0360eb58edab admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:01.039244 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d53ccf-4ef4-42e6-86a5-0360eb58edab admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:01.129507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b0c7d-348f-4373-8347-e92b25ab8081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:01.130125 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b0c7d-348f-4373-8347-e92b25ab8081 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:01.130572 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b0c7d-348f-4373-8347-e92b25ab8081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:01.130889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b0c7d-348f-4373-8347-e92b25ab8081 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:01.131693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b0c7d-348f-4373-8347-e92b25ab8081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:01.134122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b0c7d-348f-4373-8347-e92b25ab8081 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:01.168930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1354/2720] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:32:01 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:32:01.170158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929397d-dbea-4955-9a51-02b0d0ea590e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:01.186420 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929397d-dbea-4955-9a51-02b0d0ea590e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:01.191196 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6f423-c938-4648-8251-0d3db16d3320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:01.191888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f423-c938-4648-8251-0d3db16d3320 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:01.192231 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f423-c938-4648-8251-0d3db16d3320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:01.192562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f423-c938-4648-8251-0d3db16d3320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:01.193350 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6f423-c938-4648-8251-0d3db16d3320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:01.195617 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6f423-c938-4648-8251-0d3db16d3320 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:01.206050 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1367/2721] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:32:01.210594 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b0c7d-348f-4373-8347-e92b25ab8081 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:01.221541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b0c7d-348f-4373-8347-e92b25ab8081 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:01.226335 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b0531-16c7-4e8a-aaa3-c18475ec939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:01.226931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b0531-16c7-4e8a-aaa3-c18475ec939b admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:01.227211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b0531-16c7-4e8a-aaa3-c18475ec939b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:01.227487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b0531-16c7-4e8a-aaa3-c18475ec939b admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:01.228124 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b0531-16c7-4e8a-aaa3-c18475ec939b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:01.229741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b0531-16c7-4e8a-aaa3-c18475ec939b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:01.243341 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1355/2722] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:32:01.246526 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6f423-c938-4648-8251-0d3db16d3320 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:01.257296 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6f423-c938-4648-8251-0d3db16d3320 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:01.262258 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3780676-9de7-4a97-9a14-bd3afa9c9732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:01.263006 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3780676-9de7-4a97-9a14-bd3afa9c9732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:01.263328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3780676-9de7-4a97-9a14-bd3afa9c9732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:01.263605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3780676-9de7-4a97-9a14-bd3afa9c9732 admin admin] PATH_INFO: `/v3/projects/bc32fa91e63540a99db1f2164315496d/users/b72bf39aca224ce7bf50bbb19279959f/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:01.278931 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3780676-9de7-4a97-9a14-bd3afa9c9732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc32fa91e63540a99db1f2164315496d, user_id=b72bf39aca224ce7bf50bbb19279959f, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:01.281630 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3780676-9de7-4a97-9a14-bd3afa9c9732 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:01.294978 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1368/2723] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:32:01 2022] PUT /identity/v3/projects/bc32fa91e63540a99db1f2164315496d/users/b72bf39aca224ce7bf50bbb19279959f/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:32:01.300200 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe9eda-23dc-4f6b-87fc-059065936922 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:01.300657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe9eda-23dc-4f6b-87fc-059065936922 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:01.301002 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe9eda-23dc-4f6b-87fc-059065936922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:01.308948 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:01.322283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-59fe9eda-23dc-4f6b-87fc-059065936922 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:01.323486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-59fe9eda-23dc-4f6b-87fc-059065936922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:01.386063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1356/2724] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:01.397222 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3780676-9de7-4a97-9a14-bd3afa9c9732 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:01.398927 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e3780676-9de7-4a97-9a14-bd3afa9c9732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:01.404973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:01.467589 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3780676-9de7-4a97-9a14-bd3afa9c9732 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:01.472329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82690e72-bf94-4335-8a68-615e50e183a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:01.473304 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82690e72-bf94-4335-8a68-615e50e183a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:01.473580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82690e72-bf94-4335-8a68-615e50e183a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:01.473850 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82690e72-bf94-4335-8a68-615e50e183a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:01.486990 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82690e72-bf94-4335-8a68-615e50e183a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:01.488407 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82690e72-bf94-4335-8a68-615e50e183a5 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:01.499254 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1369/2725] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:32:02.238554 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e25d9f-eba6-4714-a013-f9ac0a9de1b0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:02.240156 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e25d9f-eba6-4714-a013-f9ac0a9de1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:02.240446 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e25d9f-eba6-4714-a013-f9ac0a9de1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:02.279817 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e2e25d9f-eba6-4714-a013-f9ac0a9de1b0 None None] MFA Rules not processed for user `b72bf39aca224ce7bf50bbb19279959f`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:02.281065 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e2e25d9f-eba6-4714-a013-f9ac0a9de1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:02.379307 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1357/2726] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:32:02.411642 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82690e72-bf94-4335-8a68-615e50e183a5 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:02.413199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-82690e72-bf94-4335-8a68-615e50e183a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:02.492379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82690e72-bf94-4335-8a68-615e50e183a5 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:02.498764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed8a71-c2fb-4a5f-a25c-0d03d441f495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:02.499690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed8a71-c2fb-4a5f-a25c-0d03d441f495 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:02.500033 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed8a71-c2fb-4a5f-a25c-0d03d441f495 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:02.500374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed8a71-c2fb-4a5f-a25c-0d03d441f495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:02.520964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed8a71-c2fb-4a5f-a25c-0d03d441f495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:02.526748 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed8a71-c2fb-4a5f-a25c-0d03d441f495 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:02.554717 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1370/2727] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:32:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:32:03.914166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6885f51-56ec-44db-a3de-d38fcb7df637 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:03.914663 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6885f51-56ec-44db-a3de-d38fcb7df637 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:03.914786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6885f51-56ec-44db-a3de-d38fcb7df637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:03.933017 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b6885f51-56ec-44db-a3de-d38fcb7df637 None None] MFA Rules not processed for user `b72bf39aca224ce7bf50bbb19279959f`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:03.934208 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b6885f51-56ec-44db-a3de-d38fcb7df637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:03.941035 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1358/2728] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:04.173752 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed8a71-c2fb-4a5f-a25c-0d03d441f495 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:04.175279 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ebed8a71-c2fb-4a5f-a25c-0d03d441f495 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:04.187098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed8a71-c2fb-4a5f-a25c-0d03d441f495 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:04.190564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84862b-4e1f-41de-bfb7-4eb0b594181e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:04.191146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84862b-4e1f-41de-bfb7-4eb0b594181e service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:04.191423 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84862b-4e1f-41de-bfb7-4eb0b594181e service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:04.191693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84862b-4e1f-41de-bfb7-4eb0b594181e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:04.193370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0c84862b-4e1f-41de-bfb7-4eb0b594181e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:04.202366 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84862b-4e1f-41de-bfb7-4eb0b594181e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:04.203887 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84862b-4e1f-41de-bfb7-4eb0b594181e service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:04.212347 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1371/2729] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:32:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:32:09.696380 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d8961-d320-4e5c-b939-e023540a9384 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:09.696930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d8961-d320-4e5c-b939-e023540a9384 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:09.696930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d8961-d320-4e5c-b939-e023540a9384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:09.716966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a56d8961-d320-4e5c-b939-e023540a9384 None None] MFA Rules not processed for user `73f4899822d64aa0972702d6a1a735e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:09.718150 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a56d8961-d320-4e5c-b939-e023540a9384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:09.770566 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1359/2730] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:14.209918 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=57 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:14.229108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84862b-4e1f-41de-bfb7-4eb0b594181e service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:14.230762 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0c84862b-4e1f-41de-bfb7-4eb0b594181e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:14.246198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84862b-4e1f-41de-bfb7-4eb0b594181e service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:14.263552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea4b54-362e-43cf-89e6-53f795c46144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:14.264355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea4b54-362e-43cf-89e6-53f795c46144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:14.265215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea4b54-362e-43cf-89e6-53f795c46144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:14.265495 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea4b54-362e-43cf-89e6-53f795c46144 admin admin] PATH_INFO: `/v3/users/53b95f4f7ac94fe48b984f19ae2ad00f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:14.266658 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea4b54-362e-43cf-89e6-53f795c46144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b95f4f7ac94fe48b984f19ae2ad00f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:14.269398 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea4b54-362e-43cf-89e6-53f795c46144 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:14.315182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-14ea4b54-362e-43cf-89e6-53f795c46144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b95f4f7ac94fe48b984f19ae2ad00f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:14.327126 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-14ea4b54-362e-43cf-89e6-53f795c46144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b95f4f7ac94fe48b984f19ae2ad00f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:14.334571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-14ea4b54-362e-43cf-89e6-53f795c46144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b95f4f7ac94fe48b984f19ae2ad00f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:14.341671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-14ea4b54-362e-43cf-89e6-53f795c46144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b95f4f7ac94fe48b984f19ae2ad00f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:14.342310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-14ea4b54-362e-43cf-89e6-53f795c46144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b95f4f7ac94fe48b984f19ae2ad00f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:14.348289 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1372/2731] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:32:14 2022] DELETE /identity/v3/users/53b95f4f7ac94fe48b984f19ae2ad00f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:32:14.516894 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d8961-d320-4e5c-b939-e023540a9384 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:14.529190 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d8961-d320-4e5c-b939-e023540a9384 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:14.558637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:14.585731 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941453e-cdd0-4781-aad1-4803c37c60a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:14.586351 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941453e-cdd0-4781-aad1-4803c37c60a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:14.586627 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941453e-cdd0-4781-aad1-4803c37c60a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:14.586892 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941453e-cdd0-4781-aad1-4803c37c60a1 admin admin] PATH_INFO: `/v3/projects/316d0f23ba504eccb0fbce93cd63d278` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:14.587982 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941453e-cdd0-4781-aad1-4803c37c60a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=316d0f23ba504eccb0fbce93cd63d278)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:14.589880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941453e-cdd0-4781-aad1-4803c37c60a1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:14.640559 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8941453e-cdd0-4781-aad1-4803c37c60a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '316d0f23ba504eccb0fbce93cd63d278', 'request_id': 'req-8941453e-cdd0-4781-aad1-4803c37c60a1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:14.648657 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8941453e-cdd0-4781-aad1-4803c37c60a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '316d0f23ba504eccb0fbce93cd63d278', 'request_id': 'req-8941453e-cdd0-4781-aad1-4803c37c60a1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:14.655128 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8941453e-cdd0-4781-aad1-4803c37c60a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '316d0f23ba504eccb0fbce93cd63d278', 'request_id': 'req-8941453e-cdd0-4781-aad1-4803c37c60a1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:14.666458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8941453e-cdd0-4781-aad1-4803c37c60a1 admin admin] The token cache is being invalidate because project 316d0f23ba504eccb0fbce93cd63d278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:32:14.666774 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8941453e-cdd0-4781-aad1-4803c37c60a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:14.667390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8941453e-cdd0-4781-aad1-4803c37c60a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:14.669949 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1360/2732] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:32:14 2022] DELETE /identity/v3/projects/316d0f23ba504eccb0fbce93cd63d278 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:32:14.674271 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea4b54-362e-43cf-89e6-53f795c46144 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:14.675837 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-14ea4b54-362e-43cf-89e6-53f795c46144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:14.688598 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea4b54-362e-43cf-89e6-53f795c46144 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:14.745861 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2074d-ed99-4517-aab1-57a985f6bcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:14.746491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2074d-ed99-4517-aab1-57a985f6bcb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:14.746766 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2074d-ed99-4517-aab1-57a985f6bcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:14.747036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2074d-ed99-4517-aab1-57a985f6bcb1 admin admin] PATH_INFO: `/v3/users/5f9851cce829497b8ee1aac2cc51c9f0` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:14.748171 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2074d-ed99-4517-aab1-57a985f6bcb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f9851cce829497b8ee1aac2cc51c9f0)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:14.750097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2074d-ed99-4517-aab1-57a985f6bcb1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:14.795948 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2eb2074d-ed99-4517-aab1-57a985f6bcb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f9851cce829497b8ee1aac2cc51c9f0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:14.807951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2eb2074d-ed99-4517-aab1-57a985f6bcb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f9851cce829497b8ee1aac2cc51c9f0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:14.815429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2eb2074d-ed99-4517-aab1-57a985f6bcb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f9851cce829497b8ee1aac2cc51c9f0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:14.817971 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:14.825219 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2eb2074d-ed99-4517-aab1-57a985f6bcb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f9851cce829497b8ee1aac2cc51c9f0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:14.826032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2eb2074d-ed99-4517-aab1-57a985f6bcb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f9851cce829497b8ee1aac2cc51c9f0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:14.832669 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1373/2733] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:32:14 2022] DELETE /identity/v3/users/5f9851cce829497b8ee1aac2cc51c9f0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:32:15.001217 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941453e-cdd0-4781-aad1-4803c37c60a1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:15.002740 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8941453e-cdd0-4781-aad1-4803c37c60a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:15.016055 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941453e-cdd0-4781-aad1-4803c37c60a1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:15.082146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5cf07-fc4f-4fba-bb42-f031689c9ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:15.082777 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5cf07-fc4f-4fba-bb42-f031689c9ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:15.083053 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5cf07-fc4f-4fba-bb42-f031689c9ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:15.083326 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5cf07-fc4f-4fba-bb42-f031689c9ae5 admin admin] PATH_INFO: `/v3/projects/122348d3f18a4ae8911a3152b4d9d961` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:15.085103 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5cf07-fc4f-4fba-bb42-f031689c9ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=122348d3f18a4ae8911a3152b4d9d961)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:15.086982 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5cf07-fc4f-4fba-bb42-f031689c9ae5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:15.135041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-04a5cf07-fc4f-4fba-bb42-f031689c9ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122348d3f18a4ae8911a3152b4d9d961', 'request_id': 'req-04a5cf07-fc4f-4fba-bb42-f031689c9ae5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:15.142475 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-04a5cf07-fc4f-4fba-bb42-f031689c9ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122348d3f18a4ae8911a3152b4d9d961', 'request_id': 'req-04a5cf07-fc4f-4fba-bb42-f031689c9ae5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:15.149640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-04a5cf07-fc4f-4fba-bb42-f031689c9ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122348d3f18a4ae8911a3152b4d9d961', 'request_id': 'req-04a5cf07-fc4f-4fba-bb42-f031689c9ae5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:15.151826 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:15.162762 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-04a5cf07-fc4f-4fba-bb42-f031689c9ae5 admin admin] The token cache is being invalidate because project 122348d3f18a4ae8911a3152b4d9d961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:32:15.163401 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-04a5cf07-fc4f-4fba-bb42-f031689c9ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:15.164279 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-04a5cf07-fc4f-4fba-bb42-f031689c9ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:15.165902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1361/2734] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:32:15 2022] DELETE /identity/v3/projects/122348d3f18a4ae8911a3152b4d9d961 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:32:15.170644 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0ae48-1dce-4859-824a-908d5d3c2557 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:15.170928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0ae48-1dce-4859-824a-908d5d3c2557 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:15.171201 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0ae48-1dce-4859-824a-908d5d3c2557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:15.197524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1ce0ae48-1dce-4859-824a-908d5d3c2557 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:15.198745 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1ce0ae48-1dce-4859-824a-908d5d3c2557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:15.257697 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1374/2735] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:15.265411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868597-52fe-4d8a-94e4-6a96ddf27984 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:15.265698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868597-52fe-4d8a-94e4-6a96ddf27984 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:15.265975 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868597-52fe-4d8a-94e4-6a96ddf27984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:15.286062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-76868597-52fe-4d8a-94e4-6a96ddf27984 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:15.287857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-76868597-52fe-4d8a-94e4-6a96ddf27984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:15.295754 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1362/2736] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:15.299977 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0ae48-1dce-4859-824a-908d5d3c2557 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:15.309649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0ae48-1dce-4859-824a-908d5d3c2557 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:15.314152 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d45c68-e812-4d5c-b241-6dcdef31501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:15.314748 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d45c68-e812-4d5c-b241-6dcdef31501a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:15.315028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d45c68-e812-4d5c-b241-6dcdef31501a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:15.315446 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d45c68-e812-4d5c-b241-6dcdef31501a admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:15.315943 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d45c68-e812-4d5c-b241-6dcdef31501a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:32:15.316244 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d45c68-e812-4d5c-b241-6dcdef31501a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:15.317905 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d45c68-e812-4d5c-b241-6dcdef31501a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:15.329671 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1375/2737] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:32:15.334595 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76868597-52fe-4d8a-94e4-6a96ddf27984 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:15.357287 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76868597-52fe-4d8a-94e4-6a96ddf27984 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:15.362393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923e8e9-a627-462d-933d-330955aa5219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:15.363000 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923e8e9-a627-462d-933d-330955aa5219 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:15.363409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923e8e9-a627-462d-933d-330955aa5219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:15.363688 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923e8e9-a627-462d-933d-330955aa5219 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:15.364326 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923e8e9-a627-462d-933d-330955aa5219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:15.366291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923e8e9-a627-462d-933d-330955aa5219 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:15.398441 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1363/2738] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:32:15 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:32:15.402900 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d45c68-e812-4d5c-b241-6dcdef31501a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:15.415026 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d45c68-e812-4d5c-b241-6dcdef31501a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:15.491967 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5901683-b19b-4574-ae98-1653e86670a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:15.492579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5901683-b19b-4574-ae98-1653e86670a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:15.492888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5901683-b19b-4574-ae98-1653e86670a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:15.493165 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5901683-b19b-4574-ae98-1653e86670a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:15.493789 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5901683-b19b-4574-ae98-1653e86670a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:15.495696 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5901683-b19b-4574-ae98-1653e86670a0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:15.517292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1376/2739] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:32:15 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:32:15.521767 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923e8e9-a627-462d-933d-330955aa5219 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:15.532757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923e8e9-a627-462d-933d-330955aa5219 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:15.538568 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c3525-9c33-46de-ad5d-0efeafd6f475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:15.539173 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c3525-9c33-46de-ad5d-0efeafd6f475 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:15.539451 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c3525-9c33-46de-ad5d-0efeafd6f475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:15.539725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c3525-9c33-46de-ad5d-0efeafd6f475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:15.540365 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c3525-9c33-46de-ad5d-0efeafd6f475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:15.542024 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c3525-9c33-46de-ad5d-0efeafd6f475 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:15.553730 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1364/2740] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:32:15.557834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5901683-b19b-4574-ae98-1653e86670a0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:15.568331 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5901683-b19b-4574-ae98-1653e86670a0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:15.573388 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c3e5e-44b9-4b3f-8e9f-6741e0083988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:15.574080 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c3e5e-44b9-4b3f-8e9f-6741e0083988 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:15.574430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c3e5e-44b9-4b3f-8e9f-6741e0083988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:15.574772 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c3e5e-44b9-4b3f-8e9f-6741e0083988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:15.575495 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c3e5e-44b9-4b3f-8e9f-6741e0083988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:15.577564 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c3e5e-44b9-4b3f-8e9f-6741e0083988 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:15.588933 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1377/2741] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:32:15.593050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c3525-9c33-46de-ad5d-0efeafd6f475 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:15.605140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c3525-9c33-46de-ad5d-0efeafd6f475 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:15.611377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87301614-2612-4041-b1a8-b31bbf3e9fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:15.612042 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301614-2612-4041-b1a8-b31bbf3e9fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:15.612870 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301614-2612-4041-b1a8-b31bbf3e9fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:15.612870 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301614-2612-4041-b1a8-b31bbf3e9fc4 admin admin] PATH_INFO: `/v3/projects/007e4385959d48cd918b2f0a518af4e4/users/9ecc5b2e3ac14b9185f6c85edad9e404/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:15.628138 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87301614-2612-4041-b1a8-b31bbf3e9fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=007e4385959d48cd918b2f0a518af4e4, user_id=9ecc5b2e3ac14b9185f6c85edad9e404, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:15.630822 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87301614-2612-4041-b1a8-b31bbf3e9fc4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:15.643321 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1365/2742] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:32:15 2022] PUT /identity/v3/projects/007e4385959d48cd918b2f0a518af4e4/users/9ecc5b2e3ac14b9185f6c85edad9e404/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:32:15.654573 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2df1d-80fa-471b-b0b2-ccadef713f6b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:15.654857 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2df1d-80fa-471b-b0b2-ccadef713f6b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:15.655127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2df1d-80fa-471b-b0b2-ccadef713f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:15.683840 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-90b2df1d-80fa-471b-b0b2-ccadef713f6b None None] MFA Rules not processed for user `9ecc5b2e3ac14b9185f6c85edad9e404`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:15.685074 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-90b2df1d-80fa-471b-b0b2-ccadef713f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:15.728463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:15.749438 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1378/2743] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:15.760736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87301614-2612-4041-b1a8-b31bbf3e9fc4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:15.762671 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-87301614-2612-4041-b1a8-b31bbf3e9fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:15.833486 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87301614-2612-4041-b1a8-b31bbf3e9fc4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:15.837636 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f7776-15a6-4d1b-8179-aa3ce2398516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:15.838372 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f7776-15a6-4d1b-8179-aa3ce2398516 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:15.838622 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f7776-15a6-4d1b-8179-aa3ce2398516 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:15.838942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f7776-15a6-4d1b-8179-aa3ce2398516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:15.849962 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f7776-15a6-4d1b-8179-aa3ce2398516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:15.851563 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f7776-15a6-4d1b-8179-aa3ce2398516 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:15.861129 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1366/2744] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:32:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:32:25.746539 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:25.856715 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=56,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:27.369406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2df1d-80fa-471b-b0b2-ccadef713f6b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:27.430505 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2df1d-80fa-471b-b0b2-ccadef713f6b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:27.434966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd184b-1d77-4cfa-833c-a7ac030fd0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:27.435579 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd184b-1d77-4cfa-833c-a7ac030fd0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:27.435856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd184b-1d77-4cfa-833c-a7ac030fd0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:27.436127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd184b-1d77-4cfa-833c-a7ac030fd0a5 admin admin] PATH_INFO: `/v3/users/9ecc5b2e3ac14b9185f6c85edad9e404` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:27.437253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd184b-1d77-4cfa-833c-a7ac030fd0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ecc5b2e3ac14b9185f6c85edad9e404)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:27.439145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd184b-1d77-4cfa-833c-a7ac030fd0a5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:27.485746 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c4fd184b-1d77-4cfa-833c-a7ac030fd0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ecc5b2e3ac14b9185f6c85edad9e404'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:27.497738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c4fd184b-1d77-4cfa-833c-a7ac030fd0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ecc5b2e3ac14b9185f6c85edad9e404'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:27.504755 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c4fd184b-1d77-4cfa-833c-a7ac030fd0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ecc5b2e3ac14b9185f6c85edad9e404'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:27.511646 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c4fd184b-1d77-4cfa-833c-a7ac030fd0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ecc5b2e3ac14b9185f6c85edad9e404'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:27.512258 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c4fd184b-1d77-4cfa-833c-a7ac030fd0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ecc5b2e3ac14b9185f6c85edad9e404'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:27.518212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1379/2745] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:32:27 2022] DELETE /identity/v3/users/9ecc5b2e3ac14b9185f6c85edad9e404 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:32:27.522506 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fba1a-17a1-4afd-994c-60872cbd1836 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:27.522982 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fba1a-17a1-4afd-994c-60872cbd1836 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:27.523264 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fba1a-17a1-4afd-994c-60872cbd1836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:27.544358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-842fba1a-17a1-4afd-994c-60872cbd1836 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:27.545593 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-842fba1a-17a1-4afd-994c-60872cbd1836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:27.604060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1367/2746] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:27.614083 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd184b-1d77-4cfa-833c-a7ac030fd0a5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:27.616142 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c4fd184b-1d77-4cfa-833c-a7ac030fd0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:27.675916 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd184b-1d77-4cfa-833c-a7ac030fd0a5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:27.680090 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364ccc7-3e6a-4507-b87d-ce8b36e28a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:27.680740 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364ccc7-3e6a-4507-b87d-ce8b36e28a4f service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:27.681015 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364ccc7-3e6a-4507-b87d-ce8b36e28a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:27.681281 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364ccc7-3e6a-4507-b87d-ce8b36e28a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:27.690170 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364ccc7-3e6a-4507-b87d-ce8b36e28a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:27.691588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364ccc7-3e6a-4507-b87d-ce8b36e28a4f service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:27.700831 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1380/2747] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:32:27.970195 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fba1a-17a1-4afd-994c-60872cbd1836 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:27.971596 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-842fba1a-17a1-4afd-994c-60872cbd1836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:27.988180 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fba1a-17a1-4afd-994c-60872cbd1836 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:27.994116 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156379a-83d6-4158-92d1-1b1406508e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:27.994676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156379a-83d6-4158-92d1-1b1406508e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:27.994923 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156379a-83d6-4158-92d1-1b1406508e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:27.995190 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156379a-83d6-4158-92d1-1b1406508e67 admin admin] PATH_INFO: `/v3/projects/007e4385959d48cd918b2f0a518af4e4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:27.996522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156379a-83d6-4158-92d1-1b1406508e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=007e4385959d48cd918b2f0a518af4e4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:27.998476 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156379a-83d6-4158-92d1-1b1406508e67 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:28.047063 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0156379a-83d6-4158-92d1-1b1406508e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007e4385959d48cd918b2f0a518af4e4', 'request_id': 'req-0156379a-83d6-4158-92d1-1b1406508e67'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:28.053946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0156379a-83d6-4158-92d1-1b1406508e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007e4385959d48cd918b2f0a518af4e4', 'request_id': 'req-0156379a-83d6-4158-92d1-1b1406508e67'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:28.060016 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0156379a-83d6-4158-92d1-1b1406508e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007e4385959d48cd918b2f0a518af4e4', 'request_id': 'req-0156379a-83d6-4158-92d1-1b1406508e67'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:28.070133 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0156379a-83d6-4158-92d1-1b1406508e67 admin admin] The token cache is being invalidate because project 007e4385959d48cd918b2f0a518af4e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:32:28.070452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0156379a-83d6-4158-92d1-1b1406508e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:28.071078 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0156379a-83d6-4158-92d1-1b1406508e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:32:28.072580 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1368/2748] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:32:27 2022] DELETE /identity/v3/projects/007e4385959d48cd918b2f0a518af4e4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:32:28.077520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1cbb7-9308-458b-a32b-a0a6dc068189 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:28.077897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1cbb7-9308-458b-a32b-a0a6dc068189 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:28.078188 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1cbb7-9308-458b-a32b-a0a6dc068189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:28.097322 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c8f1cbb7-9308-458b-a32b-a0a6dc068189 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:28.098491 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c8f1cbb7-9308-458b-a32b-a0a6dc068189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:28.115255 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:28.158137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1381/2749] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:28.166398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6fc0f-8e3c-4103-9d46-cfd11bb01f26 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:28.166685 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6fc0f-8e3c-4103-9d46-cfd11bb01f26 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:28.166960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6fc0f-8e3c-4103-9d46-cfd11bb01f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:28.193977 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6ac6fc0f-8e3c-4103-9d46-cfd11bb01f26 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:28.195709 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6ac6fc0f-8e3c-4103-9d46-cfd11bb01f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:28.203723 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1369/2750] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:28.207871 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1cbb7-9308-458b-a32b-a0a6dc068189 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:28.218024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1cbb7-9308-458b-a32b-a0a6dc068189 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:28.222803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b0c9c-c891-4b37-a127-af2fb70b85c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:28.223393 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b0c9c-c891-4b37-a127-af2fb70b85c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:28.223665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b0c9c-c891-4b37-a127-af2fb70b85c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:28.224555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b0c9c-c891-4b37-a127-af2fb70b85c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:28.225224 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b0c9c-c891-4b37-a127-af2fb70b85c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:32:28.225524 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b0c9c-c891-4b37-a127-af2fb70b85c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:28.227094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b0c9c-c891-4b37-a127-af2fb70b85c3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:28.238764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1382/2751] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:32:28.243769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6fc0f-8e3c-4103-9d46-cfd11bb01f26 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:28.253691 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6fc0f-8e3c-4103-9d46-cfd11bb01f26 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:28.258865 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a1016-0741-4796-91b8-21245463a183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:28.259441 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1016-0741-4796-91b8-21245463a183 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:28.259714 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1016-0741-4796-91b8-21245463a183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:28.259981 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1016-0741-4796-91b8-21245463a183 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:28.260633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a1016-0741-4796-91b8-21245463a183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:28.262497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a1016-0741-4796-91b8-21245463a183 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:28.289074 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1370/2752] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:32:28 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:32:28.293276 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b0c9c-c891-4b37-a127-af2fb70b85c3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:28.303135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b0c9c-c891-4b37-a127-af2fb70b85c3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:28.357878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fdb5b-c224-48b7-8dbc-18c26ab2bc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:28.358474 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fdb5b-c224-48b7-8dbc-18c26ab2bc01 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:28.358754 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fdb5b-c224-48b7-8dbc-18c26ab2bc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:28.359027 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fdb5b-c224-48b7-8dbc-18c26ab2bc01 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:28.359647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fdb5b-c224-48b7-8dbc-18c26ab2bc01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:28.361587 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fdb5b-c224-48b7-8dbc-18c26ab2bc01 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:28.382616 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1383/2753] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:32:28 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:32:28.386802 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a1016-0741-4796-91b8-21245463a183 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:28.397143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a1016-0741-4796-91b8-21245463a183 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:28.401957 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d00ee-443b-49d2-9d2e-83126ea1ff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:28.402532 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d00ee-443b-49d2-9d2e-83126ea1ff27 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:28.402803 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d00ee-443b-49d2-9d2e-83126ea1ff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:28.403069 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d00ee-443b-49d2-9d2e-83126ea1ff27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:28.403693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d00ee-443b-49d2-9d2e-83126ea1ff27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:28.405299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d00ee-443b-49d2-9d2e-83126ea1ff27 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:28.415546 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1371/2754] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:32:28.419300 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fdb5b-c224-48b7-8dbc-18c26ab2bc01 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:28.429692 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fdb5b-c224-48b7-8dbc-18c26ab2bc01 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:28.434332 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf9394-0472-423b-85f0-ce6dec861057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:28.434944 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf9394-0472-423b-85f0-ce6dec861057 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:28.435221 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf9394-0472-423b-85f0-ce6dec861057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:28.435490 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf9394-0472-423b-85f0-ce6dec861057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:28.436124 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf9394-0472-423b-85f0-ce6dec861057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:28.437742 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf9394-0472-423b-85f0-ce6dec861057 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:28.448034 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1384/2755] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:32:28.452022 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d00ee-443b-49d2-9d2e-83126ea1ff27 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:28.462868 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d00ee-443b-49d2-9d2e-83126ea1ff27 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:28.467501 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beeb7b-9932-4ac7-bad7-58cc43768fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:28.468176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beeb7b-9932-4ac7-bad7-58cc43768fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:28.468563 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beeb7b-9932-4ac7-bad7-58cc43768fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:28.468872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beeb7b-9932-4ac7-bad7-58cc43768fb8 admin admin] PATH_INFO: `/v3/projects/a5365c17505d428da514ffb093aa1f0f/users/785507e46b88491dbc6e88e23cde79c5/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:28.484475 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85beeb7b-9932-4ac7-bad7-58cc43768fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5365c17505d428da514ffb093aa1f0f, user_id=785507e46b88491dbc6e88e23cde79c5, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:28.487118 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85beeb7b-9932-4ac7-bad7-58cc43768fb8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:28.499490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1372/2756] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:32:28 2022] PUT /identity/v3/projects/a5365c17505d428da514ffb093aa1f0f/users/785507e46b88491dbc6e88e23cde79c5/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:32:28.504725 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40180f2-8d1f-4a95-a2c9-fd19fba64a41 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:28.505010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40180f2-8d1f-4a95-a2c9-fd19fba64a41 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:28.505302 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40180f2-8d1f-4a95-a2c9-fd19fba64a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:28.523734 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e40180f2-8d1f-4a95-a2c9-fd19fba64a41 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:28.524977 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e40180f2-8d1f-4a95-a2c9-fd19fba64a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:28.582146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1385/2757] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:28.592114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beeb7b-9932-4ac7-bad7-58cc43768fb8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:28.593953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-85beeb7b-9932-4ac7-bad7-58cc43768fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:28.616573 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:28.663791 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beeb7b-9932-4ac7-bad7-58cc43768fb8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:28.667435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c4c9e-6519-4995-8f48-c4b8590e067c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:28.667949 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c4c9e-6519-4995-8f48-c4b8590e067c service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:28.668223 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c4c9e-6519-4995-8f48-c4b8590e067c service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:28.668488 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c4c9e-6519-4995-8f48-c4b8590e067c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:28.677159 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c4c9e-6519-4995-8f48-c4b8590e067c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:28.678574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c4c9e-6519-4995-8f48-c4b8590e067c service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:28.689139 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1373/2758] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:32:29.291429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f21258-7f92-4fce-96fc-11109f59636d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:29.291761 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f21258-7f92-4fce-96fc-11109f59636d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:29.292010 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f21258-7f92-4fce-96fc-11109f59636d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:29.319416 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-85f21258-7f92-4fce-96fc-11109f59636d None None] MFA Rules not processed for user `785507e46b88491dbc6e88e23cde79c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:29.320654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-85f21258-7f92-4fce-96fc-11109f59636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:29.337280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:29.385853 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1386/2759] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:29.396805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c4c9e-6519-4995-8f48-c4b8590e067c service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:29.398742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f65c4c9e-6519-4995-8f48-c4b8590e067c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:29.459349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c4c9e-6519-4995-8f48-c4b8590e067c service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:29.463009 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d0e1c-56cd-49f8-8a12-a0885545038a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:29.463711 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d0e1c-56cd-49f8-8a12-a0885545038a service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:29.463889 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d0e1c-56cd-49f8-8a12-a0885545038a service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:29.464158 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d0e1c-56cd-49f8-8a12-a0885545038a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:29.476640 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d0e1c-56cd-49f8-8a12-a0885545038a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:29.478110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d0e1c-56cd-49f8-8a12-a0885545038a service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:29.487275 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1374/2760] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:32:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:32:30.895403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f9110-0b06-438b-9e07-70a31f7e993a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:30.896056 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f9110-0b06-438b-9e07-70a31f7e993a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:30.896056 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f9110-0b06-438b-9e07-70a31f7e993a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:30.917312 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f30f9110-0b06-438b-9e07-70a31f7e993a None None] MFA Rules not processed for user `785507e46b88491dbc6e88e23cde79c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:30.918521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f30f9110-0b06-438b-9e07-70a31f7e993a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:30.925647 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1387/2761] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:33.776269 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b24d41-fbc6-48bf-b6d9-ce6a4ac83590 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:33.776906 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b24d41-fbc6-48bf-b6d9-ce6a4ac83590 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:33.776906 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b24d41-fbc6-48bf-b6d9-ce6a4ac83590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:33.799495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-05b24d41-fbc6-48bf-b6d9-ce6a4ac83590 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:33.800754 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-05b24d41-fbc6-48bf-b6d9-ce6a4ac83590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:33.810235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1375/2762] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 16:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:33.831510 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f9110-0b06-438b-9e07-70a31f7e993a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:33.833732 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f30f9110-0b06-438b-9e07-70a31f7e993a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:33.917102 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f9110-0b06-438b-9e07-70a31f7e993a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:33.924940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb3bef-490c-47a2-9de7-0a856bd77ac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:33.925874 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb3bef-490c-47a2-9de7-0a856bd77ac9 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:33.926181 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb3bef-490c-47a2-9de7-0a856bd77ac9 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:33.926457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb3bef-490c-47a2-9de7-0a856bd77ac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:33.936476 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb3bef-490c-47a2-9de7-0a856bd77ac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:33.938307 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb3bef-490c-47a2-9de7-0a856bd77ac9 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:33.949662 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1388/2763] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:32:36.822076 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dfedb-29a1-4e19-9ba6-e0c41b1c0129 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:36.822612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dfedb-29a1-4e19-9ba6-e0c41b1c0129 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:36.822612 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dfedb-29a1-4e19-9ba6-e0c41b1c0129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:36.842163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-002dfedb-29a1-4e19-9ba6-e0c41b1c0129 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:36.843359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-002dfedb-29a1-4e19-9ba6-e0c41b1c0129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:36.851167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1376/2764] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 16:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:36.865578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb3bef-490c-47a2-9de7-0a856bd77ac9 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:36.866973 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-21eb3bef-490c-47a2-9de7-0a856bd77ac9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:36.881851 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb3bef-490c-47a2-9de7-0a856bd77ac9 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:36.887233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f3ee6-321b-46f4-b253-14d074bbfcd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:36.887819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f3ee6-321b-46f4-b253-14d074bbfcd8 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:36.888097 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f3ee6-321b-46f4-b253-14d074bbfcd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:36.888372 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f3ee6-321b-46f4-b253-14d074bbfcd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:36.897198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f3ee6-321b-46f4-b253-14d074bbfcd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:36.898764 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f3ee6-321b-46f4-b253-14d074bbfcd8 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:36.908291 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1389/2765] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:32:40.074116 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa35ea-79c9-4ec1-a39b-99ff7b79f7c0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:40.074521 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa35ea-79c9-4ec1-a39b-99ff7b79f7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:40.074660 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa35ea-79c9-4ec1-a39b-99ff7b79f7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:40.097513 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c5aa35ea-79c9-4ec1-a39b-99ff7b79f7c0 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:40.098770 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c5aa35ea-79c9-4ec1-a39b-99ff7b79f7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:40.106759 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1377/2766] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 16:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:40.127098 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f3ee6-321b-46f4-b253-14d074bbfcd8 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:40.138691 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f3ee6-321b-46f4-b253-14d074bbfcd8 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:40.144094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120da29-856a-40d0-a2df-42a96f91bac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:40.144710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120da29-856a-40d0-a2df-42a96f91bac9 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:40.144990 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120da29-856a-40d0-a2df-42a96f91bac9 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:40.145260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120da29-856a-40d0-a2df-42a96f91bac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:40.153400 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120da29-856a-40d0-a2df-42a96f91bac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:40.154961 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120da29-856a-40d0-a2df-42a96f91bac9 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:40.164101 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1390/2767] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:32:43.168110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f95ff-2e9a-4150-9553-364f1e9b3469 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:43.168735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f95ff-2e9a-4150-9553-364f1e9b3469 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:43.168846 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f95ff-2e9a-4150-9553-364f1e9b3469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:43.188108 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5b4f95ff-2e9a-4150-9553-364f1e9b3469 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:43.189328 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5b4f95ff-2e9a-4150-9553-364f1e9b3469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:43.197959 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1378/2768] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 16:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:43.223824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120da29-856a-40d0-a2df-42a96f91bac9 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:43.236146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120da29-856a-40d0-a2df-42a96f91bac9 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:43.243128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284ba89-47cd-46f3-8da4-53a92b4839ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:43.243698 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284ba89-47cd-46f3-8da4-53a92b4839ce service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:43.243957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284ba89-47cd-46f3-8da4-53a92b4839ce service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:43.244238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284ba89-47cd-46f3-8da4-53a92b4839ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:43.252418 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284ba89-47cd-46f3-8da4-53a92b4839ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:43.254021 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284ba89-47cd-46f3-8da4-53a92b4839ce service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:43.263972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1391/2769] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:32:47.356485 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17526bd7-146b-4a74-ba95-5073d8bd8f27 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:47.357030 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17526bd7-146b-4a74-ba95-5073d8bd8f27 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:47.357146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17526bd7-146b-4a74-ba95-5073d8bd8f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:47.376427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-17526bd7-146b-4a74-ba95-5073d8bd8f27 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:47.377659 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-17526bd7-146b-4a74-ba95-5073d8bd8f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:47.385469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1379/2770] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 16:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:47.415677 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284ba89-47cd-46f3-8da4-53a92b4839ce service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:47.426636 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284ba89-47cd-46f3-8da4-53a92b4839ce service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:47.431938 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438eb4c2-3470-4d9f-ba17-4cc4f9849cc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:47.432521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438eb4c2-3470-4d9f-ba17-4cc4f9849cc0 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:47.432852 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438eb4c2-3470-4d9f-ba17-4cc4f9849cc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:47.433122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438eb4c2-3470-4d9f-ba17-4cc4f9849cc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:47.441016 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438eb4c2-3470-4d9f-ba17-4cc4f9849cc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:47.442576 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438eb4c2-3470-4d9f-ba17-4cc4f9849cc0 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:47.451758 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1392/2771] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:32:47.671836 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd01dc0-9ff6-4013-a86a-30b782be6c35 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:47.672152 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd01dc0-9ff6-4013-a86a-30b782be6c35 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:47.672431 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd01dc0-9ff6-4013-a86a-30b782be6c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:47.691349 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2bd01dc0-9ff6-4013-a86a-30b782be6c35 None None] MFA Rules not processed for user `785507e46b88491dbc6e88e23cde79c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:47.692541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2bd01dc0-9ff6-4013-a86a-30b782be6c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:47.699997 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1380/2772] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:32:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:50.536064 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fd3a2-7c4c-4d5f-bd4f-01816075b838 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:50.538121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fd3a2-7c4c-4d5f-bd4f-01816075b838 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:50.538121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fd3a2-7c4c-4d5f-bd4f-01816075b838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:50.566389 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3d2fd3a2-7c4c-4d5f-bd4f-01816075b838 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:32:50.567481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3d2fd3a2-7c4c-4d5f-bd4f-01816075b838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:32:50.576989 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1393/2773] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 16:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:32:50.593426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd01dc0-9ff6-4013-a86a-30b782be6c35 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:32:50.606727 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd01dc0-9ff6-4013-a86a-30b782be6c35 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:32:50.612980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fda7ef-0a1e-4c48-a3fe-bed9d8026190 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:32:50.613666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda7ef-0a1e-4c48-a3fe-bed9d8026190 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:32:50.614180 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda7ef-0a1e-4c48-a3fe-bed9d8026190 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:32:50.614415 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda7ef-0a1e-4c48-a3fe-bed9d8026190 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:32:50.626052 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fda7ef-0a1e-4c48-a3fe-bed9d8026190 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:32:50.627881 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fda7ef-0a1e-4c48-a3fe-bed9d8026190 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:32:50.642926 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1381/2774] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:33:00.553964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=83 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:00.633955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=67 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:05.711611 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19a168-89b4-4719-b063-31ef84b97a1c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:05.712110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19a168-89b4-4719-b063-31ef84b97a1c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:05.712215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19a168-89b4-4719-b063-31ef84b97a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:05.731801 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7d19a168-89b4-4719-b063-31ef84b97a1c None None] MFA Rules not processed for user `b72bf39aca224ce7bf50bbb19279959f`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:33:05.732964 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7d19a168-89b4-4719-b063-31ef84b97a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:05.791159 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1394/2775] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:33:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:33:06.769374 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb29c77-80f5-4664-9447-f1c52580d7b0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:06.769930 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb29c77-80f5-4664-9447-f1c52580d7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:06.770235 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb29c77-80f5-4664-9447-f1c52580d7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:06.791649 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-bbb29c77-80f5-4664-9447-f1c52580d7b0 None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:33:06.792890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bbb29c77-80f5-4664-9447-f1c52580d7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:06.848918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1382/2776] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Aug 11 16:33:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:33:06.897815 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19a168-89b4-4719-b063-31ef84b97a1c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:06.899253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7d19a168-89b4-4719-b063-31ef84b97a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:06.966893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19a168-89b4-4719-b063-31ef84b97a1c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:06.971780 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dac65-b08a-4f69-a202-bed9819aa8d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:06.972371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dac65-b08a-4f69-a202-bed9819aa8d1 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:06.972738 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dac65-b08a-4f69-a202-bed9819aa8d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:06.973011 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dac65-b08a-4f69-a202-bed9819aa8d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:06.981311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424dac65-b08a-4f69-a202-bed9819aa8d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:06.982860 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424dac65-b08a-4f69-a202-bed9819aa8d1 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:06.991154 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1395/2777] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:33:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:33:16.842989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=25 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:16.987506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=57 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:18.165497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a7c51-2bc3-4f86-9a1b-fea83289c0de None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:18.166239 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a7c51-2bc3-4f86-9a1b-fea83289c0de None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:18.166239 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a7c51-2bc3-4f86-9a1b-fea83289c0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:18.199218 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-de9a7c51-2bc3-4f86-9a1b-fea83289c0de None None] MFA Rules not processed for user `73f4899822d64aa0972702d6a1a735e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:33:18.200778 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-de9a7c51-2bc3-4f86-9a1b-fea83289c0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:18.288491 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1383/2778] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:33:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:33:20.128774 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dac65-b08a-4f69-a202-bed9819aa8d1 service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:20.130850 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-424dac65-b08a-4f69-a202-bed9819aa8d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:20.309203 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dac65-b08a-4f69-a202-bed9819aa8d1 service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:20.315592 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b558fb8-8eb9-4f76-86e3-e3b8f6b99e0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e1c7e6ee814b47912760cf7daf54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:20.316220 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b558fb8-8eb9-4f76-86e3-e3b8f6b99e0f service placement] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:20.316498 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b558fb8-8eb9-4f76-86e3-e3b8f6b99e0f service placement] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:20.316873 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b558fb8-8eb9-4f76-86e3-e3b8f6b99e0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:20.318628 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7b558fb8-8eb9-4f76-86e3-e3b8f6b99e0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:20.340057 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b558fb8-8eb9-4f76-86e3-e3b8f6b99e0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:20.341690 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b558fb8-8eb9-4f76-86e3-e3b8f6b99e0f service placement] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:20.358880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1396/2779] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:33:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:33:22.054938 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d3ed2-1a91-4d6c-9dce-0adf1fb5bec3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:22.055528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d3ed2-1a91-4d6c-9dce-0adf1fb5bec3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:22.055718 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d3ed2-1a91-4d6c-9dce-0adf1fb5bec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:22.162894 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1e6d3ed2-1a91-4d6c-9dce-0adf1fb5bec3 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:33:22.164735 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1e6d3ed2-1a91-4d6c-9dce-0adf1fb5bec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:22.206520 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1384/2780] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:33:22.216112 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b558fb8-8eb9-4f76-86e3-e3b8f6b99e0f service placement] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:22.250075 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b558fb8-8eb9-4f76-86e3-e3b8f6b99e0f service placement] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:22.257304 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3ac3f-9530-44e7-a207-bb5be89fe66b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:22.258290 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3ac3f-9530-44e7-a207-bb5be89fe66b service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:22.258591 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3ac3f-9530-44e7-a207-bb5be89fe66b service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:22.258832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3ac3f-9530-44e7-a207-bb5be89fe66b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:22.269602 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3ac3f-9530-44e7-a207-bb5be89fe66b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:22.272079 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3ac3f-9530-44e7-a207-bb5be89fe66b service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:22.283796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1397/2781] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:33:24.648060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce372d0a-a4c1-4821-a55b-efb7807622f8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:24.648483 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce372d0a-a4c1-4821-a55b-efb7807622f8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:24.648623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce372d0a-a4c1-4821-a55b-efb7807622f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:24.677607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ce372d0a-a4c1-4821-a55b-efb7807622f8 None None] MFA Rules not processed for user `732213990cf84fc198db9c47866fb687`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:33:24.679368 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ce372d0a-a4c1-4821-a55b-efb7807622f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:24.686406 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1385/2782] 10.222.0.40 () {58 vars in 967 bytes} [Thu Aug 11 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:33:24.698366 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3ac3f-9530-44e7-a207-bb5be89fe66b service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:24.709722 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3ac3f-9530-44e7-a207-bb5be89fe66b service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:24.714684 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891f0fb-fac2-4e77-a250-c0b20f22126b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b629970ca1a4d7fa4c4f2365e671a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:24.715264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891f0fb-fac2-4e77-a250-c0b20f22126b service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:24.715536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891f0fb-fac2-4e77-a250-c0b20f22126b service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:24.715806 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891f0fb-fac2-4e77-a250-c0b20f22126b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:24.723729 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891f0fb-fac2-4e77-a250-c0b20f22126b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:24.725833 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891f0fb-fac2-4e77-a250-c0b20f22126b service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:24.733599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1398/2783] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Aug 11 16:33:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 16:33:25.412358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bdf34-5566-43f0-81cf-9c7abd310a6e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:25.412678 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bdf34-5566-43f0-81cf-9c7abd310a6e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:25.412952 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bdf34-5566-43f0-81cf-9c7abd310a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:25.431787 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b17bdf34-5566-43f0-81cf-9c7abd310a6e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:33:25.433021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b17bdf34-5566-43f0-81cf-9c7abd310a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:25.440764 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1386/2784] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:33:25.482358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891f0fb-fac2-4e77-a250-c0b20f22126b service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:25.494122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891f0fb-fac2-4e77-a250-c0b20f22126b service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:25.499354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df71d3-e8c2-4098-9059-5fa31de390e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:25.499934 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df71d3-e8c2-4098-9059-5fa31de390e4 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:25.500207 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df71d3-e8c2-4098-9059-5fa31de390e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:25.500474 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df71d3-e8c2-4098-9059-5fa31de390e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:25.508886 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df71d3-e8c2-4098-9059-5fa31de390e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:25.510440 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df71d3-e8c2-4098-9059-5fa31de390e4 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:25.519709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1399/2785] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:33:26.762237 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bdf34-5566-43f0-81cf-9c7abd310a6e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:26.773725 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bdf34-5566-43f0-81cf-9c7abd310a6e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:26.779058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736abf5-17d8-467c-a58e-539d242f2d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:26.779689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736abf5-17d8-467c-a58e-539d242f2d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:26.779952 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736abf5-17d8-467c-a58e-539d242f2d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:26.780225 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736abf5-17d8-467c-a58e-539d242f2d6c admin admin] PATH_INFO: `/v3/users/785507e46b88491dbc6e88e23cde79c5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:26.781411 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736abf5-17d8-467c-a58e-539d242f2d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=785507e46b88491dbc6e88e23cde79c5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:26.783300 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736abf5-17d8-467c-a58e-539d242f2d6c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:26.831360 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:26.833116 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0736abf5-17d8-467c-a58e-539d242f2d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '785507e46b88491dbc6e88e23cde79c5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:26.843512 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0736abf5-17d8-467c-a58e-539d242f2d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '785507e46b88491dbc6e88e23cde79c5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:26.855937 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0736abf5-17d8-467c-a58e-539d242f2d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '785507e46b88491dbc6e88e23cde79c5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:26.862937 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0736abf5-17d8-467c-a58e-539d242f2d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '785507e46b88491dbc6e88e23cde79c5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:26.863585 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0736abf5-17d8-467c-a58e-539d242f2d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '785507e46b88491dbc6e88e23cde79c5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:26.869266 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1387/2786] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:33:26 2022] DELETE /identity/v3/users/785507e46b88491dbc6e88e23cde79c5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:33:27.040538 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df71d3-e8c2-4098-9059-5fa31de390e4 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:27.051899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df71d3-e8c2-4098-9059-5fa31de390e4 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:27.089134 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:27.114819 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b8ebd-a49d-4ed1-aefd-f311bbbe6a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:27.115447 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b8ebd-a49d-4ed1-aefd-f311bbbe6a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:27.116228 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b8ebd-a49d-4ed1-aefd-f311bbbe6a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:27.116511 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b8ebd-a49d-4ed1-aefd-f311bbbe6a50 admin admin] PATH_INFO: `/v3/projects/a5365c17505d428da514ffb093aa1f0f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:27.117665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b8ebd-a49d-4ed1-aefd-f311bbbe6a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5365c17505d428da514ffb093aa1f0f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:27.119567 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b8ebd-a49d-4ed1-aefd-f311bbbe6a50 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:27.164899 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a84b8ebd-a49d-4ed1-aefd-f311bbbe6a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5365c17505d428da514ffb093aa1f0f', 'request_id': 'req-a84b8ebd-a49d-4ed1-aefd-f311bbbe6a50'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:27.170209 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a84b8ebd-a49d-4ed1-aefd-f311bbbe6a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5365c17505d428da514ffb093aa1f0f', 'request_id': 'req-a84b8ebd-a49d-4ed1-aefd-f311bbbe6a50'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:27.177084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a84b8ebd-a49d-4ed1-aefd-f311bbbe6a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5365c17505d428da514ffb093aa1f0f', 'request_id': 'req-a84b8ebd-a49d-4ed1-aefd-f311bbbe6a50'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:27.188577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a84b8ebd-a49d-4ed1-aefd-f311bbbe6a50 admin admin] The token cache is being invalidate because project a5365c17505d428da514ffb093aa1f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:33:27.188893 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a84b8ebd-a49d-4ed1-aefd-f311bbbe6a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:27.189506 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a84b8ebd-a49d-4ed1-aefd-f311bbbe6a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:27.191057 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1400/2787] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:33:27 2022] DELETE /identity/v3/projects/a5365c17505d428da514ffb093aa1f0f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:33:27.196390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf34d8-ce5e-4aeb-9788-c6e05ad01c13 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:27.196719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf34d8-ce5e-4aeb-9788-c6e05ad01c13 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:27.196999 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf34d8-ce5e-4aeb-9788-c6e05ad01c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:27.215872 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ffbf34d8-ce5e-4aeb-9788-c6e05ad01c13 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:33:27.217109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ffbf34d8-ce5e-4aeb-9788-c6e05ad01c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:27.277519 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1388/2788] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:33:27.285354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674572c0-3851-430d-ba50-2482ede9293f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:27.285768 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674572c0-3851-430d-ba50-2482ede9293f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:27.286056 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674572c0-3851-430d-ba50-2482ede9293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:27.306056 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-674572c0-3851-430d-ba50-2482ede9293f None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:33:27.307263 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-674572c0-3851-430d-ba50-2482ede9293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:27.315597 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1401/2789] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:33:27.320333 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf34d8-ce5e-4aeb-9788-c6e05ad01c13 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:27.330130 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf34d8-ce5e-4aeb-9788-c6e05ad01c13 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:27.334820 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c79b88-2804-46be-93f2-f87e3036fa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:27.335409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c79b88-2804-46be-93f2-f87e3036fa33 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:27.335687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c79b88-2804-46be-93f2-f87e3036fa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:27.335955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c79b88-2804-46be-93f2-f87e3036fa33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:27.336609 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c79b88-2804-46be-93f2-f87e3036fa33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:33:27.336928 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c79b88-2804-46be-93f2-f87e3036fa33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:27.338539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c79b88-2804-46be-93f2-f87e3036fa33 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:27.349946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1389/2790] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:33:27.354232 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674572c0-3851-430d-ba50-2482ede9293f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:27.363691 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674572c0-3851-430d-ba50-2482ede9293f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:27.368828 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84144ba0-54fc-45f7-a061-c8904979138f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:27.369406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84144ba0-54fc-45f7-a061-c8904979138f admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:27.369678 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84144ba0-54fc-45f7-a061-c8904979138f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:27.369974 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84144ba0-54fc-45f7-a061-c8904979138f admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:27.370592 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84144ba0-54fc-45f7-a061-c8904979138f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:27.372459 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84144ba0-54fc-45f7-a061-c8904979138f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:27.398854 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1402/2791] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:33:27 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:33:27.403438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c79b88-2804-46be-93f2-f87e3036fa33 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:27.414780 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c79b88-2804-46be-93f2-f87e3036fa33 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:27.481780 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41731fd-b93e-4f70-b43a-8b6d5c04de11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:27.482388 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41731fd-b93e-4f70-b43a-8b6d5c04de11 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:27.482664 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41731fd-b93e-4f70-b43a-8b6d5c04de11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:27.482935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41731fd-b93e-4f70-b43a-8b6d5c04de11 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:27.483557 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41731fd-b93e-4f70-b43a-8b6d5c04de11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:27.485960 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41731fd-b93e-4f70-b43a-8b6d5c04de11 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:27.508417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1390/2792] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:33:27 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:33:27.512567 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84144ba0-54fc-45f7-a061-c8904979138f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:27.522896 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84144ba0-54fc-45f7-a061-c8904979138f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:27.528160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ab02a-7c4b-42cb-9710-1dad9a2e287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:27.528793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ab02a-7c4b-42cb-9710-1dad9a2e287b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:27.529099 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ab02a-7c4b-42cb-9710-1dad9a2e287b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:27.529368 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ab02a-7c4b-42cb-9710-1dad9a2e287b admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:27.530046 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ab02a-7c4b-42cb-9710-1dad9a2e287b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:27.531632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ab02a-7c4b-42cb-9710-1dad9a2e287b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:27.542265 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1403/2793] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:33:27.546122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41731fd-b93e-4f70-b43a-8b6d5c04de11 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:27.556786 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41731fd-b93e-4f70-b43a-8b6d5c04de11 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:27.561537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51d03b-37ec-4c27-a9f0-60ce411af187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:27.562122 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51d03b-37ec-4c27-a9f0-60ce411af187 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:27.562397 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51d03b-37ec-4c27-a9f0-60ce411af187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:27.562666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51d03b-37ec-4c27-a9f0-60ce411af187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:27.563408 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51d03b-37ec-4c27-a9f0-60ce411af187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:27.565024 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51d03b-37ec-4c27-a9f0-60ce411af187 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:27.575672 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1391/2794] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:33:27.579998 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ab02a-7c4b-42cb-9710-1dad9a2e287b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:27.590474 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ab02a-7c4b-42cb-9710-1dad9a2e287b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:27.595510 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed979de-5059-4d7d-b91b-1ae4a7420529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:27.596174 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed979de-5059-4d7d-b91b-1ae4a7420529 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:27.596454 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed979de-5059-4d7d-b91b-1ae4a7420529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:27.596781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed979de-5059-4d7d-b91b-1ae4a7420529 admin admin] PATH_INFO: `/v3/projects/3b8c1c45b6874dcdb75011e530551862/users/0f8b081430bd42148176417181bd4420/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:27.612414 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed979de-5059-4d7d-b91b-1ae4a7420529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8c1c45b6874dcdb75011e530551862, user_id=0f8b081430bd42148176417181bd4420, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:27.615091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed979de-5059-4d7d-b91b-1ae4a7420529 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:27.628834 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1404/2795] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:33:27 2022] PUT /identity/v3/projects/3b8c1c45b6874dcdb75011e530551862/users/0f8b081430bd42148176417181bd4420/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:33:27.639539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50079b8b-cf90-41b5-8d93-1ebd94220349 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:27.639895 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50079b8b-cf90-41b5-8d93-1ebd94220349 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:27.640163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50079b8b-cf90-41b5-8d93-1ebd94220349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:27.668923 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-50079b8b-cf90-41b5-8d93-1ebd94220349 None None] MFA Rules not processed for user `0f8b081430bd42148176417181bd4420`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:33:27.670120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-50079b8b-cf90-41b5-8d93-1ebd94220349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:27.687061 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:27.734086 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1392/2796] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:33:27.745816 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed979de-5059-4d7d-b91b-1ae4a7420529 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:27.747462 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5ed979de-5059-4d7d-b91b-1ae4a7420529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:27.802906 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed979de-5059-4d7d-b91b-1ae4a7420529 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:27.807233 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f4bf4-2a89-4216-aa2d-326827aeca81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:27.807831 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f4bf4-2a89-4216-aa2d-326827aeca81 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:27.808108 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f4bf4-2a89-4216-aa2d-326827aeca81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:27.808407 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f4bf4-2a89-4216-aa2d-326827aeca81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:27.817292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f4bf4-2a89-4216-aa2d-326827aeca81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:27.818743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f4bf4-2a89-4216-aa2d-326827aeca81 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:27.827957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1405/2797] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:33:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:33:27.854961 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50079b8b-cf90-41b5-8d93-1ebd94220349 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:27.919870 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50079b8b-cf90-41b5-8d93-1ebd94220349 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:27.924522 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f9b73-3df4-419c-88c5-51b9f1cce08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:27.925186 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f9b73-3df4-419c-88c5-51b9f1cce08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:27.925465 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f9b73-3df4-419c-88c5-51b9f1cce08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:27.925736 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f9b73-3df4-419c-88c5-51b9f1cce08f admin admin] PATH_INFO: `/v3/users/0f8b081430bd42148176417181bd4420` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:27.926861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f9b73-3df4-419c-88c5-51b9f1cce08f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8b081430bd42148176417181bd4420)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:27.928935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f9b73-3df4-419c-88c5-51b9f1cce08f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:27.982670 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d51f9b73-3df4-419c-88c5-51b9f1cce08f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8b081430bd42148176417181bd4420'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:27.991103 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d51f9b73-3df4-419c-88c5-51b9f1cce08f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8b081430bd42148176417181bd4420'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:28.003801 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d51f9b73-3df4-419c-88c5-51b9f1cce08f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8b081430bd42148176417181bd4420'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:28.010590 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d51f9b73-3df4-419c-88c5-51b9f1cce08f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8b081430bd42148176417181bd4420'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:28.011284 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d51f9b73-3df4-419c-88c5-51b9f1cce08f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8b081430bd42148176417181bd4420'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:28.017977 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1393/2798] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:33:27 2022] DELETE /identity/v3/users/0f8b081430bd42148176417181bd4420 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:33:28.022990 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef591de4-1754-4f13-84a3-fcd3fd5e310e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:28.023478 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef591de4-1754-4f13-84a3-fcd3fd5e310e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:28.023910 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef591de4-1754-4f13-84a3-fcd3fd5e310e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:28.035375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:28.052810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ef591de4-1754-4f13-84a3-fcd3fd5e310e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:33:28.054370 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ef591de4-1754-4f13-84a3-fcd3fd5e310e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:28.113909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1406/2799] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:33:28.123217 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f9b73-3df4-419c-88c5-51b9f1cce08f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:28.124800 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d51f9b73-3df4-419c-88c5-51b9f1cce08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:28.171989 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:28.211441 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f9b73-3df4-419c-88c5-51b9f1cce08f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:28.215394 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b4a6e-1ec2-4ddd-be5e-dc3e1f7c721e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:28.216005 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b4a6e-1ec2-4ddd-be5e-dc3e1f7c721e service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:28.216283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b4a6e-1ec2-4ddd-be5e-dc3e1f7c721e service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:28.216555 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b4a6e-1ec2-4ddd-be5e-dc3e1f7c721e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:28.227051 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b4a6e-1ec2-4ddd-be5e-dc3e1f7c721e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:28.228481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b4a6e-1ec2-4ddd-be5e-dc3e1f7c721e service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:28.238175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1394/2800] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:33:28.481848 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db225616-ba2e-41d4-81a7-d0f7acc41090 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:28.482137 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db225616-ba2e-41d4-81a7-d0f7acc41090 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:28.482469 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db225616-ba2e-41d4-81a7-d0f7acc41090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:28.501871 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-db225616-ba2e-41d4-81a7-d0f7acc41090 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:33:28.503074 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-db225616-ba2e-41d4-81a7-d0f7acc41090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:28.509427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b4a6e-1ec2-4ddd-be5e-dc3e1f7c721e service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:28.510642 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-891b4a6e-1ec2-4ddd-be5e-dc3e1f7c721e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:28.511968 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1407/2801] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 16:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:33:28.524295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b4a6e-1ec2-4ddd-be5e-dc3e1f7c721e service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:28.530229 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422227f-cc1c-47b4-82a7-06016746424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:28.531283 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422227f-cc1c-47b4-82a7-06016746424a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:28.531765 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422227f-cc1c-47b4-82a7-06016746424a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:28.532249 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422227f-cc1c-47b4-82a7-06016746424a admin admin] PATH_INFO: `/v3/projects/3b8c1c45b6874dcdb75011e530551862` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:28.534208 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422227f-cc1c-47b4-82a7-06016746424a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8c1c45b6874dcdb75011e530551862)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:28.537378 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422227f-cc1c-47b4-82a7-06016746424a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:28.555352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db225616-ba2e-41d4-81a7-d0f7acc41090 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:28.557217 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-db225616-ba2e-41d4-81a7-d0f7acc41090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:28.597161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5422227f-cc1c-47b4-82a7-06016746424a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8c1c45b6874dcdb75011e530551862', 'request_id': 'req-5422227f-cc1c-47b4-82a7-06016746424a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:28.605494 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5422227f-cc1c-47b4-82a7-06016746424a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8c1c45b6874dcdb75011e530551862', 'request_id': 'req-5422227f-cc1c-47b4-82a7-06016746424a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:28.614254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5422227f-cc1c-47b4-82a7-06016746424a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8c1c45b6874dcdb75011e530551862', 'request_id': 'req-5422227f-cc1c-47b4-82a7-06016746424a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:28.628123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5422227f-cc1c-47b4-82a7-06016746424a admin admin] The token cache is being invalidate because project 3b8c1c45b6874dcdb75011e530551862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:33:28.628427 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5422227f-cc1c-47b4-82a7-06016746424a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:28.629105 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5422227f-cc1c-47b4-82a7-06016746424a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:33:28.630859 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1395/2802] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:33:28 2022] DELETE /identity/v3/projects/3b8c1c45b6874dcdb75011e530551862 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:33:28.676461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db225616-ba2e-41d4-81a7-d0f7acc41090 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:28.760850 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3ea82-ede4-48c6-ad7d-a38056a3f472 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:28.761876 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3ea82-ede4-48c6-ad7d-a38056a3f472 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:28.762248 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3ea82-ede4-48c6-ad7d-a38056a3f472 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:28.762695 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3ea82-ede4-48c6-ad7d-a38056a3f472 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:28.764654 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9fa3ea82-ede4-48c6-ad7d-a38056a3f472 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:28.788360 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:28.840940 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3ea82-ede4-48c6-ad7d-a38056a3f472 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:28.842771 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3ea82-ede4-48c6-ad7d-a38056a3f472 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:28.854895 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1408/2803] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:33:31.664544 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c3021-1c02-4ace-8e98-d7a694f28389 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:31.665089 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c3021-1c02-4ace-8e98-d7a694f28389 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:31.665201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c3021-1c02-4ace-8e98-d7a694f28389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:31.685918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4d0c3021-1c02-4ace-8e98-d7a694f28389 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:33:31.687138 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4d0c3021-1c02-4ace-8e98-d7a694f28389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:31.695965 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1396/2804] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 16:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:33:31.727028 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3ea82-ede4-48c6-ad7d-a38056a3f472 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:31.728536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9fa3ea82-ede4-48c6-ad7d-a38056a3f472 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:31.743916 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3ea82-ede4-48c6-ad7d-a38056a3f472 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:31.749981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12285bd9-0377-47a7-807f-fb00b4a7cdeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:31.750625 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12285bd9-0377-47a7-807f-fb00b4a7cdeb service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:31.750969 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12285bd9-0377-47a7-807f-fb00b4a7cdeb service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:31.751310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12285bd9-0377-47a7-807f-fb00b4a7cdeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:31.760836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12285bd9-0377-47a7-807f-fb00b4a7cdeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:31.762529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12285bd9-0377-47a7-807f-fb00b4a7cdeb service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:31.772951 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1409/2805] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:33:34.830267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a4fa5-70cb-4edf-9827-da048351496a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:34.830784 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a4fa5-70cb-4edf-9827-da048351496a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:34.830784 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a4fa5-70cb-4edf-9827-da048351496a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:34.849942 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ab7a4fa5-70cb-4edf-9827-da048351496a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:33:34.851641 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ab7a4fa5-70cb-4edf-9827-da048351496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:34.860604 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1397/2806] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:33:34.897479 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12285bd9-0377-47a7-807f-fb00b4a7cdeb service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:33:34.898949 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-12285bd9-0377-47a7-807f-fb00b4a7cdeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:33:34.914127 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12285bd9-0377-47a7-807f-fb00b4a7cdeb service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:33:34.919461 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f13b24-b414-4f60-a5ab-c52837023620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e91f3fbe098459dba0acf8ec1fb7098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:33:34.920039 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f13b24-b414-4f60-a5ab-c52837023620 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:33:34.920311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f13b24-b414-4f60-a5ab-c52837023620 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:33:34.920577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f13b24-b414-4f60-a5ab-c52837023620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:33:34.928338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f13b24-b414-4f60-a5ab-c52837023620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:33:34.930470 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f13b24-b414-4f60-a5ab-c52837023620 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:33:34.939504 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1410/2807] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:33:44.844831 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:44.935481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=31 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:02.776029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a4fa5-70cb-4edf-9827-da048351496a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:02.778130 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ab7a4fa5-70cb-4edf-9827-da048351496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:02.847562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f13b24-b414-4f60-a5ab-c52837023620 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:02.849167 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-94f13b24-b414-4f60-a5ab-c52837023620 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:02.863500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f13b24-b414-4f60-a5ab-c52837023620 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:02.864108 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a4fa5-70cb-4edf-9827-da048351496a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:02.868313 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a6c4c-86af-4f15-90c1-5f7890baff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:02.868882 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a6c4c-86af-4f15-90c1-5f7890baff5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:02.869160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a6c4c-86af-4f15-90c1-5f7890baff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:02.869428 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a6c4c-86af-4f15-90c1-5f7890baff5e admin admin] PATH_INFO: `/v3/users/b72bf39aca224ce7bf50bbb19279959f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:02.871215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f26008-ddd0-49b5-a664-b02a595ba71b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e1c7e6ee814b47912760cf7daf54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:02.871375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a6c4c-86af-4f15-90c1-5f7890baff5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b72bf39aca224ce7bf50bbb19279959f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:02.871499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f26008-ddd0-49b5-a664-b02a595ba71b service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:02.871499 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f26008-ddd0-49b5-a664-b02a595ba71b service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:02.871758 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f26008-ddd0-49b5-a664-b02a595ba71b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:02.872468 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a6c4c-86af-4f15-90c1-5f7890baff5e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:02.873574 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-38f26008-ddd0-49b5-a664-b02a595ba71b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:02.888980 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f26008-ddd0-49b5-a664-b02a595ba71b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:02.891209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f26008-ddd0-49b5-a664-b02a595ba71b service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:02.907053 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1398/2808] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:34:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:34:02.926915 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f45a6c4c-86af-4f15-90c1-5f7890baff5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b72bf39aca224ce7bf50bbb19279959f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:02.939574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f45a6c4c-86af-4f15-90c1-5f7890baff5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b72bf39aca224ce7bf50bbb19279959f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:02.947796 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f45a6c4c-86af-4f15-90c1-5f7890baff5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b72bf39aca224ce7bf50bbb19279959f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:02.954642 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f45a6c4c-86af-4f15-90c1-5f7890baff5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b72bf39aca224ce7bf50bbb19279959f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:02.955260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f45a6c4c-86af-4f15-90c1-5f7890baff5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b72bf39aca224ce7bf50bbb19279959f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:02.961606 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1411/2809] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:34:02 2022] DELETE /identity/v3/users/b72bf39aca224ce7bf50bbb19279959f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:34:03.137733 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f26008-ddd0-49b5-a664-b02a595ba71b service placement] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:03.149212 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f26008-ddd0-49b5-a664-b02a595ba71b service placement] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:03.207431 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:03.208060 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:03.208337 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:03.209206 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf admin admin] PATH_INFO: `/v3/projects/bc32fa91e63540a99db1f2164315496d` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:03.210335 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc32fa91e63540a99db1f2164315496d)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:03.212215 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:03.259702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc32fa91e63540a99db1f2164315496d', 'request_id': 'req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:03.267265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc32fa91e63540a99db1f2164315496d', 'request_id': 'req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:03.273551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc32fa91e63540a99db1f2164315496d', 'request_id': 'req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:03.284085 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf admin admin] The token cache is being invalidate because project bc32fa91e63540a99db1f2164315496d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:34:03.284371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:03.285021 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:03.286490 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1399/2810] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:34:03 2022] DELETE /identity/v3/projects/bc32fa91e63540a99db1f2164315496d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:12.957529 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:13.281029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:23.862599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a6c4c-86af-4f15-90c1-5f7890baff5e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:23.864294 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f45a6c4c-86af-4f15-90c1-5f7890baff5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:23.877418 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a6c4c-86af-4f15-90c1-5f7890baff5e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:23.933715 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7f1bb-b3e1-4b28-a70a-651d95f722fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:23.934345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7f1bb-b3e1-4b28-a70a-651d95f722fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:23.934624 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7f1bb-b3e1-4b28-a70a-651d95f722fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:23.934901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7f1bb-b3e1-4b28-a70a-651d95f722fe admin admin] PATH_INFO: `/v3/users/73f4899822d64aa0972702d6a1a735e2` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:23.936036 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7f1bb-b3e1-4b28-a70a-651d95f722fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f4899822d64aa0972702d6a1a735e2)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:23.938049 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7f1bb-b3e1-4b28-a70a-651d95f722fe admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:23.982429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-57a7f1bb-b3e1-4b28-a70a-651d95f722fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f4899822d64aa0972702d6a1a735e2'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:23.995374 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-57a7f1bb-b3e1-4b28-a70a-651d95f722fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f4899822d64aa0972702d6a1a735e2'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:24.002824 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-57a7f1bb-b3e1-4b28-a70a-651d95f722fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f4899822d64aa0972702d6a1a735e2'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:24.009981 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-57a7f1bb-b3e1-4b28-a70a-651d95f722fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f4899822d64aa0972702d6a1a735e2'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:24.010594 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-57a7f1bb-b3e1-4b28-a70a-651d95f722fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f4899822d64aa0972702d6a1a735e2'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:24.016341 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1412/2811] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:34:23 2022] DELETE /identity/v3/users/73f4899822d64aa0972702d6a1a735e2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:24.447500 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:24.449029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:24.462840 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4f3c4-760a-4fde-893c-e8f1bd32bfbf admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:24.522110 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af7bb1-28e9-49f1-9709-8e71147f570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:24.522729 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af7bb1-28e9-49f1-9709-8e71147f570b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:24.523005 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af7bb1-28e9-49f1-9709-8e71147f570b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:24.523273 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af7bb1-28e9-49f1-9709-8e71147f570b admin admin] PATH_INFO: `/v3/projects/d1ca98e5c1f14b7681c7b58ba09e7cc3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:24.524629 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af7bb1-28e9-49f1-9709-8e71147f570b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ca98e5c1f14b7681c7b58ba09e7cc3)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:24.526515 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af7bb1-28e9-49f1-9709-8e71147f570b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:24.570043 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-41af7bb1-28e9-49f1-9709-8e71147f570b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ca98e5c1f14b7681c7b58ba09e7cc3', 'request_id': 'req-41af7bb1-28e9-49f1-9709-8e71147f570b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:24.577418 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-41af7bb1-28e9-49f1-9709-8e71147f570b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ca98e5c1f14b7681c7b58ba09e7cc3', 'request_id': 'req-41af7bb1-28e9-49f1-9709-8e71147f570b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:24.584038 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-41af7bb1-28e9-49f1-9709-8e71147f570b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ca98e5c1f14b7681c7b58ba09e7cc3', 'request_id': 'req-41af7bb1-28e9-49f1-9709-8e71147f570b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:24.594352 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-41af7bb1-28e9-49f1-9709-8e71147f570b admin admin] The token cache is being invalidate because project d1ca98e5c1f14b7681c7b58ba09e7cc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:34:24.594643 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-41af7bb1-28e9-49f1-9709-8e71147f570b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:24.595304 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-41af7bb1-28e9-49f1-9709-8e71147f570b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:24.596849 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1400/2812] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:34:24 2022] DELETE /identity/v3/projects/d1ca98e5c1f14b7681c7b58ba09e7cc3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:24.601699 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3727-8e6c-4c8d-a5c3-d4026d14e582 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:24.601985 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3727-8e6c-4c8d-a5c3-d4026d14e582 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:24.602310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3727-8e6c-4c8d-a5c3-d4026d14e582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:24.621282 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a99e3727-8e6c-4c8d-a5c3-d4026d14e582 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:24.622482 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a99e3727-8e6c-4c8d-a5c3-d4026d14e582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:24.680930 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1413/2813] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:34:24.689113 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c43a9a-39db-42ed-93ef-99fce1278a53 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:24.689395 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c43a9a-39db-42ed-93ef-99fce1278a53 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:24.689666 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c43a9a-39db-42ed-93ef-99fce1278a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:24.710699 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f8c43a9a-39db-42ed-93ef-99fce1278a53 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:24.711895 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f8c43a9a-39db-42ed-93ef-99fce1278a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:24.719771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1401/2814] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:34:24.724215 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e3727-8e6c-4c8d-a5c3-d4026d14e582 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:24.734238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e3727-8e6c-4c8d-a5c3-d4026d14e582 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:24.739369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b14e47-d224-4d35-aa36-8bdb084ad458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:24.740836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b14e47-d224-4d35-aa36-8bdb084ad458 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:24.740836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b14e47-d224-4d35-aa36-8bdb084ad458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:24.740836 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b14e47-d224-4d35-aa36-8bdb084ad458 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:24.741191 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b14e47-d224-4d35-aa36-8bdb084ad458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:34:24.741467 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b14e47-d224-4d35-aa36-8bdb084ad458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:24.743053 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b14e47-d224-4d35-aa36-8bdb084ad458 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:24.756068 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1414/2815] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 16:34:24.760606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c43a9a-39db-42ed-93ef-99fce1278a53 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:24.770182 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c43a9a-39db-42ed-93ef-99fce1278a53 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:24.775537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c4229-7a5c-4f81-af8f-ee70e3f66673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:24.776130 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c4229-7a5c-4f81-af8f-ee70e3f66673 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:24.776405 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c4229-7a5c-4f81-af8f-ee70e3f66673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:24.776706 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c4229-7a5c-4f81-af8f-ee70e3f66673 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:24.777350 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c4229-7a5c-4f81-af8f-ee70e3f66673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:24.779393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c4229-7a5c-4f81-af8f-ee70e3f66673 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:24.809093 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1402/2816] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:34:24 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:34:24.813209 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b14e47-d224-4d35-aa36-8bdb084ad458 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:24.823632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b14e47-d224-4d35-aa36-8bdb084ad458 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:24.827160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:24.883371 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c27bda-48e8-4e57-b06a-acd85a829e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:24.884025 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c27bda-48e8-4e57-b06a-acd85a829e15 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:24.884260 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c27bda-48e8-4e57-b06a-acd85a829e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:24.884520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c27bda-48e8-4e57-b06a-acd85a829e15 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:24.885192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c27bda-48e8-4e57-b06a-acd85a829e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:24.887086 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c27bda-48e8-4e57-b06a-acd85a829e15 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:24.907088 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1415/2817] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:34:24 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:34:24.911187 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c4229-7a5c-4f81-af8f-ee70e3f66673 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:24.921322 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c4229-7a5c-4f81-af8f-ee70e3f66673 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:24.925967 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e472aa4-da03-4af3-8127-60299a85e991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:24.927039 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e472aa4-da03-4af3-8127-60299a85e991 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:24.927314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e472aa4-da03-4af3-8127-60299a85e991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:24.927581 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e472aa4-da03-4af3-8127-60299a85e991 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:24.928208 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e472aa4-da03-4af3-8127-60299a85e991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:24.929874 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e472aa4-da03-4af3-8127-60299a85e991 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:24.939485 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1403/2818] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:34:24.943781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c27bda-48e8-4e57-b06a-acd85a829e15 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:24.953379 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c27bda-48e8-4e57-b06a-acd85a829e15 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:24.958252 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b784729-2635-4dee-8b48-d0347fce3628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:24.958847 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b784729-2635-4dee-8b48-d0347fce3628 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:24.959128 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b784729-2635-4dee-8b48-d0347fce3628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:24.959405 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b784729-2635-4dee-8b48-d0347fce3628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:24.960065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b784729-2635-4dee-8b48-d0347fce3628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:24.961682 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b784729-2635-4dee-8b48-d0347fce3628 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:24.972031 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1416/2819] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:34:24.975933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e472aa4-da03-4af3-8127-60299a85e991 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:24.986040 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e472aa4-da03-4af3-8127-60299a85e991 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:24.991167 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670305d8-2c0c-4ed7-a93e-ec98afdbba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:24.991797 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670305d8-2c0c-4ed7-a93e-ec98afdbba7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:24.992079 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670305d8-2c0c-4ed7-a93e-ec98afdbba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:24.992359 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670305d8-2c0c-4ed7-a93e-ec98afdbba7c admin admin] PATH_INFO: `/v3/projects/57205acfeeba4087b482779e4628c27a/users/905c3a57ff1e4ac296372ce50ac67fc7/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:25.007327 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670305d8-2c0c-4ed7-a93e-ec98afdbba7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=57205acfeeba4087b482779e4628c27a, user_id=905c3a57ff1e4ac296372ce50ac67fc7, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:25.009992 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670305d8-2c0c-4ed7-a93e-ec98afdbba7c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:25.022738 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1404/2820] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:34:24 2022] PUT /identity/v3/projects/57205acfeeba4087b482779e4628c27a/users/905c3a57ff1e4ac296372ce50ac67fc7/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:25.033415 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706043c6-0d07-4aaf-a784-4e731e88b6c1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:25.033747 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706043c6-0d07-4aaf-a784-4e731e88b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:25.034044 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706043c6-0d07-4aaf-a784-4e731e88b6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:25.061003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-706043c6-0d07-4aaf-a784-4e731e88b6c1 None None] MFA Rules not processed for user `905c3a57ff1e4ac296372ce50ac67fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:25.062205 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-706043c6-0d07-4aaf-a784-4e731e88b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:25.123902 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1417/2821] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:34:25.135155 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670305d8-2c0c-4ed7-a93e-ec98afdbba7c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:25.136841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-670305d8-2c0c-4ed7-a93e-ec98afdbba7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:25.167253 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:25.214687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670305d8-2c0c-4ed7-a93e-ec98afdbba7c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:25.218278 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf624548-9306-4a5a-8540-100ae3591589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:25.218864 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf624548-9306-4a5a-8540-100ae3591589 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:25.219140 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf624548-9306-4a5a-8540-100ae3591589 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:25.219416 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf624548-9306-4a5a-8540-100ae3591589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:25.227440 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf624548-9306-4a5a-8540-100ae3591589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:25.228890 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf624548-9306-4a5a-8540-100ae3591589 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:25.237425 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1405/2822] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:34:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:34:33.527328 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706043c6-0d07-4aaf-a784-4e731e88b6c1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:33.586561 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706043c6-0d07-4aaf-a784-4e731e88b6c1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:33.590977 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0e5bc-30d7-4159-b8ed-5c5f59592b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:33.591581 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0e5bc-30d7-4159-b8ed-5c5f59592b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:33.591856 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0e5bc-30d7-4159-b8ed-5c5f59592b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:33.592125 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0e5bc-30d7-4159-b8ed-5c5f59592b26 admin admin] PATH_INFO: `/v3/users/905c3a57ff1e4ac296372ce50ac67fc7` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:33.593242 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0e5bc-30d7-4159-b8ed-5c5f59592b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=905c3a57ff1e4ac296372ce50ac67fc7)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:33.595145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0e5bc-30d7-4159-b8ed-5c5f59592b26 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:33.610823 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:33.646829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f6c0e5bc-30d7-4159-b8ed-5c5f59592b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905c3a57ff1e4ac296372ce50ac67fc7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:33.659227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f6c0e5bc-30d7-4159-b8ed-5c5f59592b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905c3a57ff1e4ac296372ce50ac67fc7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:33.667100 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f6c0e5bc-30d7-4159-b8ed-5c5f59592b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905c3a57ff1e4ac296372ce50ac67fc7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:33.673829 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f6c0e5bc-30d7-4159-b8ed-5c5f59592b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905c3a57ff1e4ac296372ce50ac67fc7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:33.674446 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f6c0e5bc-30d7-4159-b8ed-5c5f59592b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905c3a57ff1e4ac296372ce50ac67fc7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:33.680799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1418/2823] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:34:33 2022] DELETE /identity/v3/users/905c3a57ff1e4ac296372ce50ac67fc7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:33.685256 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf990fac-ad14-4634-99a3-3fb92de7721f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:33.685748 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf990fac-ad14-4634-99a3-3fb92de7721f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:33.685857 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf990fac-ad14-4634-99a3-3fb92de7721f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:33.704124 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-cf990fac-ad14-4634-99a3-3fb92de7721f None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:33.705342 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cf990fac-ad14-4634-99a3-3fb92de7721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:33.762752 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1406/2824] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:34:33.772929 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0e5bc-30d7-4159-b8ed-5c5f59592b26 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:33.774572 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f6c0e5bc-30d7-4159-b8ed-5c5f59592b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:33.831876 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0e5bc-30d7-4159-b8ed-5c5f59592b26 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:33.835907 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd9b69-1e69-4e89-8aa3-82555cc68aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:33.836551 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd9b69-1e69-4e89-8aa3-82555cc68aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:33.836957 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd9b69-1e69-4e89-8aa3-82555cc68aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:33.837177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd9b69-1e69-4e89-8aa3-82555cc68aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:33.846580 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd9b69-1e69-4e89-8aa3-82555cc68aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:33.848552 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd9b69-1e69-4e89-8aa3-82555cc68aa3 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:33.857889 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1419/2825] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:34:34.125177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf990fac-ad14-4634-99a3-3fb92de7721f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:34.126603 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cf990fac-ad14-4634-99a3-3fb92de7721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:34.141377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf990fac-ad14-4634-99a3-3fb92de7721f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:34.146586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e5c1d-3431-49ec-9fec-0f0d1ea6f87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:34.147214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e5c1d-3431-49ec-9fec-0f0d1ea6f87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:34.147489 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e5c1d-3431-49ec-9fec-0f0d1ea6f87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:34.147760 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e5c1d-3431-49ec-9fec-0f0d1ea6f87f admin admin] PATH_INFO: `/v3/projects/57205acfeeba4087b482779e4628c27a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:34.149033 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e5c1d-3431-49ec-9fec-0f0d1ea6f87f admin admin] RBAC: Authorizing `identity:delete_project(project_id=57205acfeeba4087b482779e4628c27a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:34.151045 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e5c1d-3431-49ec-9fec-0f0d1ea6f87f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:34.198454 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-cd5e5c1d-3431-49ec-9fec-0f0d1ea6f87f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57205acfeeba4087b482779e4628c27a', 'request_id': 'req-cd5e5c1d-3431-49ec-9fec-0f0d1ea6f87f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:34.205329 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-cd5e5c1d-3431-49ec-9fec-0f0d1ea6f87f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57205acfeeba4087b482779e4628c27a', 'request_id': 'req-cd5e5c1d-3431-49ec-9fec-0f0d1ea6f87f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:34.213077 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-cd5e5c1d-3431-49ec-9fec-0f0d1ea6f87f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57205acfeeba4087b482779e4628c27a', 'request_id': 'req-cd5e5c1d-3431-49ec-9fec-0f0d1ea6f87f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:34.223254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-cd5e5c1d-3431-49ec-9fec-0f0d1ea6f87f admin admin] The token cache is being invalidate because project 57205acfeeba4087b482779e4628c27a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:34:34.223539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-cd5e5c1d-3431-49ec-9fec-0f0d1ea6f87f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:34.224184 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-cd5e5c1d-3431-49ec-9fec-0f0d1ea6f87f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:34.225676 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1407/2826] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:34:34 2022] DELETE /identity/v3/projects/57205acfeeba4087b482779e4628c27a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:34.231613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e86e77-cf4a-4bb0-b7ba-fa8f90da0998 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:34.231974 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e86e77-cf4a-4bb0-b7ba-fa8f90da0998 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:34.232255 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e86e77-cf4a-4bb0-b7ba-fa8f90da0998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:34.251361 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-21e86e77-cf4a-4bb0-b7ba-fa8f90da0998 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:34.252562 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-21e86e77-cf4a-4bb0-b7ba-fa8f90da0998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:34.311828 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1420/2827] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:34:34.321294 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8dc3e-921f-4078-922e-39473421987a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:34.321582 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8dc3e-921f-4078-922e-39473421987a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:34.321854 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8dc3e-921f-4078-922e-39473421987a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:34.341916 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-dac8dc3e-921f-4078-922e-39473421987a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:34.343089 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dac8dc3e-921f-4078-922e-39473421987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:34.350796 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1408/2828] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:34:34.354798 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e86e77-cf4a-4bb0-b7ba-fa8f90da0998 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:34.364310 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e86e77-cf4a-4bb0-b7ba-fa8f90da0998 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:34.368966 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b861f3-52c0-41c8-9a2a-52149284a8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:34.369500 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b861f3-52c0-41c8-9a2a-52149284a8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:34.369780 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b861f3-52c0-41c8-9a2a-52149284a8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:34.370054 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b861f3-52c0-41c8-9a2a-52149284a8e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:34.370700 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b861f3-52c0-41c8-9a2a-52149284a8e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:34:34.371001 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b861f3-52c0-41c8-9a2a-52149284a8e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:34.372604 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b861f3-52c0-41c8-9a2a-52149284a8e6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:34.384354 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1421/2829] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:34:34.388507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8dc3e-921f-4078-922e-39473421987a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:34.398793 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8dc3e-921f-4078-922e-39473421987a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:34.404175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c0852-4844-4ecc-939e-b21c23bed31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:34.404953 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c0852-4844-4ecc-939e-b21c23bed31b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:34.405234 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c0852-4844-4ecc-939e-b21c23bed31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:34.405500 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c0852-4844-4ecc-939e-b21c23bed31b admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:34.406105 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c0852-4844-4ecc-939e-b21c23bed31b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:34.407955 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c0852-4844-4ecc-939e-b21c23bed31b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:34.434293 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1409/2830] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:34:34 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:34:34.438683 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b861f3-52c0-41c8-9a2a-52149284a8e6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:34.449038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b861f3-52c0-41c8-9a2a-52149284a8e6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:34.469382 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:34.507477 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416bfc7-cea3-489b-8114-9cdc682a7673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:34.508079 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416bfc7-cea3-489b-8114-9cdc682a7673 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:34.508351 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416bfc7-cea3-489b-8114-9cdc682a7673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:34.508652 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416bfc7-cea3-489b-8114-9cdc682a7673 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:34.509273 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416bfc7-cea3-489b-8114-9cdc682a7673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:34.511177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416bfc7-cea3-489b-8114-9cdc682a7673 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:34.531704 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1422/2831] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:34:34 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:34:34.535873 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c0852-4844-4ecc-939e-b21c23bed31b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:34.542358 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:34.546721 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c0852-4844-4ecc-939e-b21c23bed31b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:34.553519 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870e2b1-551c-4e89-929c-35d1759d4c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:34.554332 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870e2b1-551c-4e89-929c-35d1759d4c9b admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:34.554790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870e2b1-551c-4e89-929c-35d1759d4c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:34.555121 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870e2b1-551c-4e89-929c-35d1759d4c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:34.555905 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870e2b1-551c-4e89-929c-35d1759d4c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:34.557541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870e2b1-551c-4e89-929c-35d1759d4c9b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:34.567939 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1410/2832] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:34:34.571702 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416bfc7-cea3-489b-8114-9cdc682a7673 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:34.581387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416bfc7-cea3-489b-8114-9cdc682a7673 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:34.585992 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2681c-2217-4700-9a08-fff328e9d163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:34.586565 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2681c-2217-4700-9a08-fff328e9d163 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:34.586841 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2681c-2217-4700-9a08-fff328e9d163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:34.587110 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2681c-2217-4700-9a08-fff328e9d163 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:34.587747 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2681c-2217-4700-9a08-fff328e9d163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:34.589353 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2681c-2217-4700-9a08-fff328e9d163 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:34.599528 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1423/2833] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:34:34.603323 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870e2b1-551c-4e89-929c-35d1759d4c9b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:34.613166 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870e2b1-551c-4e89-929c-35d1759d4c9b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:34.618354 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b58da-fb94-44c2-92ec-6c81d4dd4327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:34.619073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b58da-fb94-44c2-92ec-6c81d4dd4327 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:34.619299 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b58da-fb94-44c2-92ec-6c81d4dd4327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:34.619570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b58da-fb94-44c2-92ec-6c81d4dd4327 admin admin] PATH_INFO: `/v3/projects/09a7270bad374f90b9ddd546a495af19/users/78935dbc62104d4bb18e869f8fa205e4/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:34.635205 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b58da-fb94-44c2-92ec-6c81d4dd4327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a7270bad374f90b9ddd546a495af19, user_id=78935dbc62104d4bb18e869f8fa205e4, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:34.637877 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b58da-fb94-44c2-92ec-6c81d4dd4327 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:34.650579 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1411/2834] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:34:34 2022] PUT /identity/v3/projects/09a7270bad374f90b9ddd546a495af19/users/78935dbc62104d4bb18e869f8fa205e4/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:34.660749 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501058d-bf53-4a81-bf50-7e388a845453 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:34.661032 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501058d-bf53-4a81-bf50-7e388a845453 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:34.661329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501058d-bf53-4a81-bf50-7e388a845453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:34.689525 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8501058d-bf53-4a81-bf50-7e388a845453 None None] MFA Rules not processed for user `78935dbc62104d4bb18e869f8fa205e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:34.690743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8501058d-bf53-4a81-bf50-7e388a845453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:34.755183 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1424/2835] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:34:34.759601 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b58da-fb94-44c2-92ec-6c81d4dd4327 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:34.821268 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b58da-fb94-44c2-92ec-6c81d4dd4327 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:34.825901 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecec46-a56d-42ac-99e3-2959c0bcf235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:34.826494 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecec46-a56d-42ac-99e3-2959c0bcf235 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:34.826771 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecec46-a56d-42ac-99e3-2959c0bcf235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:34.827039 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecec46-a56d-42ac-99e3-2959c0bcf235 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:34.827652 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecec46-a56d-42ac-99e3-2959c0bcf235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:34.829601 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecec46-a56d-42ac-99e3-2959c0bcf235 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:34.856157 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1412/2836] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:34:34 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:34:34.860164 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501058d-bf53-4a81-bf50-7e388a845453 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:34.871805 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501058d-bf53-4a81-bf50-7e388a845453 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:34.928008 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34830e-c3cd-4b0e-b834-27647c1a4a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:34.928634 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34830e-c3cd-4b0e-b834-27647c1a4a1c admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:34.928917 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34830e-c3cd-4b0e-b834-27647c1a4a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:34.929189 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34830e-c3cd-4b0e-b834-27647c1a4a1c admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:34.929809 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34830e-c3cd-4b0e-b834-27647c1a4a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:34.931707 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34830e-c3cd-4b0e-b834-27647c1a4a1c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:34.952329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1425/2837] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:34:34 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:34:34.956334 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecec46-a56d-42ac-99e3-2959c0bcf235 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:34.967229 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecec46-a56d-42ac-99e3-2959c0bcf235 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:34.971927 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba39fe-861f-4461-a27f-eeaaae21022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:34.972519 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba39fe-861f-4461-a27f-eeaaae21022e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:34.972833 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba39fe-861f-4461-a27f-eeaaae21022e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:34.973107 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba39fe-861f-4461-a27f-eeaaae21022e admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:34.973734 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba39fe-861f-4461-a27f-eeaaae21022e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:34.975314 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba39fe-861f-4461-a27f-eeaaae21022e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:34.985528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1413/2838] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:34:34.989411 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34830e-c3cd-4b0e-b834-27647c1a4a1c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:34.999293 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34830e-c3cd-4b0e-b834-27647c1a4a1c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:35.003759 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f930ebf-7ad7-4cfe-a22d-076fa3e9d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:35.005005 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f930ebf-7ad7-4cfe-a22d-076fa3e9d23d admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:35.005280 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f930ebf-7ad7-4cfe-a22d-076fa3e9d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:35.005550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f930ebf-7ad7-4cfe-a22d-076fa3e9d23d admin admin] PATH_INFO: `/v3/projects/a9385403fe73486a9df9294669d802f3/users/4f1b95226e11432d8e8dc71c8ac32ee9/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:35.020387 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f930ebf-7ad7-4cfe-a22d-076fa3e9d23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9385403fe73486a9df9294669d802f3, user_id=4f1b95226e11432d8e8dc71c8ac32ee9, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:35.023038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f930ebf-7ad7-4cfe-a22d-076fa3e9d23d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:35.031165 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:35.037258 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1426/2839] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:34:34 2022] PUT /identity/v3/projects/a9385403fe73486a9df9294669d802f3/users/4f1b95226e11432d8e8dc71c8ac32ee9/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:35.041526 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba39fe-861f-4461-a27f-eeaaae21022e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:35.051539 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba39fe-861f-4461-a27f-eeaaae21022e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:35.106211 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d190a0-0048-4c48-9d7f-269027bb364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:35.106805 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d190a0-0048-4c48-9d7f-269027bb364b admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:35.107083 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d190a0-0048-4c48-9d7f-269027bb364b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:35.107352 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d190a0-0048-4c48-9d7f-269027bb364b admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:35.107979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d190a0-0048-4c48-9d7f-269027bb364b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:35.109596 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d190a0-0048-4c48-9d7f-269027bb364b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:35.118950 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1414/2840] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:34:35.123177 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f930ebf-7ad7-4cfe-a22d-076fa3e9d23d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:35.133822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f930ebf-7ad7-4cfe-a22d-076fa3e9d23d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:35.138291 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749edea8-80eb-4823-8119-3656b9493baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:35.138916 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749edea8-80eb-4823-8119-3656b9493baa admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:35.139192 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749edea8-80eb-4823-8119-3656b9493baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:35.139463 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749edea8-80eb-4823-8119-3656b9493baa admin admin] PATH_INFO: `/v3/projects/a9385403fe73486a9df9294669d802f3/users/4f1b95226e11432d8e8dc71c8ac32ee9/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:35.141355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749edea8-80eb-4823-8119-3656b9493baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9385403fe73486a9df9294669d802f3, user_id=4f1b95226e11432d8e8dc71c8ac32ee9, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:35.143928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749edea8-80eb-4823-8119-3656b9493baa admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:35.154648 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1427/2841] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:34:35 2022] PUT /identity/v3/projects/a9385403fe73486a9df9294669d802f3/users/4f1b95226e11432d8e8dc71c8ac32ee9/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:35.165083 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb106e03-d422-4d8b-8f9e-4c6e5c49871f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:35.165370 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb106e03-d422-4d8b-8f9e-4c6e5c49871f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:35.165644 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb106e03-d422-4d8b-8f9e-4c6e5c49871f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:35.192752 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fb106e03-d422-4d8b-8f9e-4c6e5c49871f None None] MFA Rules not processed for user `4f1b95226e11432d8e8dc71c8ac32ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:35.193954 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fb106e03-d422-4d8b-8f9e-4c6e5c49871f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:35.223034 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:35.268417 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1415/2842] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:34:35.281088 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749edea8-80eb-4823-8119-3656b9493baa admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:35.282878 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-749edea8-80eb-4823-8119-3656b9493baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:35.338613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749edea8-80eb-4823-8119-3656b9493baa admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:35.342238 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91140b59-ae0c-4adc-8c12-7d0656005353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:35.342822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91140b59-ae0c-4adc-8c12-7d0656005353 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:35.343094 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91140b59-ae0c-4adc-8c12-7d0656005353 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:35.343362 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91140b59-ae0c-4adc-8c12-7d0656005353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:35.352069 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91140b59-ae0c-4adc-8c12-7d0656005353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:35.353496 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91140b59-ae0c-4adc-8c12-7d0656005353 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:35.362575 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1428/2843] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:34:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:34:35.662592 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb106e03-d422-4d8b-8f9e-4c6e5c49871f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:35.671633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb106e03-d422-4d8b-8f9e-4c6e5c49871f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:35.676811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f58b40-4c79-4298-97f6-bac6609f3534 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1b95226e11432d8e8dc71c8ac32ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9385403fe73486a9df9294669d802f3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:35.677413 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f58b40-4c79-4298-97f6-bac6609f3534 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:35.677695 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f58b40-4c79-4298-97f6-bac6609f3534 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:35.677969 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f58b40-4c79-4298-97f6-bac6609f3534 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:35.678607 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f58b40-4c79-4298-97f6-bac6609f3534 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:34:35.678910 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f58b40-4c79-4298-97f6-bac6609f3534 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:35.680501 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f58b40-4c79-4298-97f6-bac6609f3534 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:35.691952 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1416/2844] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:34:35.695891 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91140b59-ae0c-4adc-8c12-7d0656005353 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:35.704792 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91140b59-ae0c-4adc-8c12-7d0656005353 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:35.709312 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d08034-1f2f-488c-a039-2a44cb8596bd tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1b95226e11432d8e8dc71c8ac32ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9385403fe73486a9df9294669d802f3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:35.709897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08034-1f2f-488c-a039-2a44cb8596bd tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:35.710176 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08034-1f2f-488c-a039-2a44cb8596bd tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:35.710449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08034-1f2f-488c-a039-2a44cb8596bd tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:35.711065 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d08034-1f2f-488c-a039-2a44cb8596bd tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:35.712993 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d08034-1f2f-488c-a039-2a44cb8596bd tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:35.739483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1429/2845] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:34:35 2022] POST /identity/v3/projects => generated 354 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:34:35.743783 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f58b40-4c79-4298-97f6-bac6609f3534 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:35.753543 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f58b40-4c79-4298-97f6-bac6609f3534 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:35.809297 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f8982-16f1-4ebb-899f-8b86aa57c448 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1b95226e11432d8e8dc71c8ac32ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9385403fe73486a9df9294669d802f3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:35.809932 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f8982-16f1-4ebb-899f-8b86aa57c448 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:35.810153 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f8982-16f1-4ebb-899f-8b86aa57c448 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:35.810423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f8982-16f1-4ebb-899f-8b86aa57c448 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:35.811054 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f8982-16f1-4ebb-899f-8b86aa57c448 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:34:35.811348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f8982-16f1-4ebb-899f-8b86aa57c448 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:35.813020 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f8982-16f1-4ebb-899f-8b86aa57c448 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:35.824531 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1417/2846] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:34:35.859890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d08034-1f2f-488c-a039-2a44cb8596bd tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:35.870693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d08034-1f2f-488c-a039-2a44cb8596bd tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:35.875244 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a6f65-8f1d-4bd8-a3ef-a724530418d6 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1b95226e11432d8e8dc71c8ac32ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9385403fe73486a9df9294669d802f3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:35.875855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6f65-8f1d-4bd8-a3ef-a724530418d6 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:35.876135 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6f65-8f1d-4bd8-a3ef-a724530418d6 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:35.876408 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6f65-8f1d-4bd8-a3ef-a724530418d6 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] PATH_INFO: `/v3/projects/9729ee3e6997454da2ca1501cc339541` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:35.877570 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a6f65-8f1d-4bd8-a3ef-a724530418d6 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9729ee3e6997454da2ca1501cc339541)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:35.879456 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a6f65-8f1d-4bd8-a3ef-a724530418d6 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:35.924156 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-eb1a6f65-8f1d-4bd8-a3ef-a724530418d6 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9729ee3e6997454da2ca1501cc339541', 'request_id': 'req-eb1a6f65-8f1d-4bd8-a3ef-a724530418d6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:35.930038 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-eb1a6f65-8f1d-4bd8-a3ef-a724530418d6 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9729ee3e6997454da2ca1501cc339541', 'request_id': 'req-eb1a6f65-8f1d-4bd8-a3ef-a724530418d6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:35.936924 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-eb1a6f65-8f1d-4bd8-a3ef-a724530418d6 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9729ee3e6997454da2ca1501cc339541', 'request_id': 'req-eb1a6f65-8f1d-4bd8-a3ef-a724530418d6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:35.948759 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-eb1a6f65-8f1d-4bd8-a3ef-a724530418d6 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] The token cache is being invalidate because project 9729ee3e6997454da2ca1501cc339541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:34:35.949043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-eb1a6f65-8f1d-4bd8-a3ef-a724530418d6 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:35.949675 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-eb1a6f65-8f1d-4bd8-a3ef-a724530418d6 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:35.951121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1430/2847] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:34:35 2022] DELETE /identity/v3/projects/9729ee3e6997454da2ca1501cc339541 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:36.139371 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f8982-16f1-4ebb-899f-8b86aa57c448 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:36.141123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-641f8982-16f1-4ebb-899f-8b86aa57c448 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:36.204495 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f8982-16f1-4ebb-899f-8b86aa57c448 tempest-VolumeQuotaClassesTest-1040681581 tempest-VolumeQuotaClassesTest-1040681581-project-admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:36.250586 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:36.267811 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7895d6-0962-497f-88d3-97a5b3fa98bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:36.268824 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7895d6-0962-497f-88d3-97a5b3fa98bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:36.269214 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7895d6-0962-497f-88d3-97a5b3fa98bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:36.269551 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7895d6-0962-497f-88d3-97a5b3fa98bc admin admin] PATH_INFO: `/v3/users/78935dbc62104d4bb18e869f8fa205e4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:36.271008 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7895d6-0962-497f-88d3-97a5b3fa98bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=78935dbc62104d4bb18e869f8fa205e4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:36.273003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7895d6-0962-497f-88d3-97a5b3fa98bc admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:36.318596 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6c7895d6-0962-497f-88d3-97a5b3fa98bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78935dbc62104d4bb18e869f8fa205e4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:36.325834 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6c7895d6-0962-497f-88d3-97a5b3fa98bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78935dbc62104d4bb18e869f8fa205e4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:36.337533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6c7895d6-0962-497f-88d3-97a5b3fa98bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78935dbc62104d4bb18e869f8fa205e4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:36.344456 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6c7895d6-0962-497f-88d3-97a5b3fa98bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78935dbc62104d4bb18e869f8fa205e4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:36.345114 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6c7895d6-0962-497f-88d3-97a5b3fa98bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78935dbc62104d4bb18e869f8fa205e4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:36.351385 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1418/2848] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:34:36 2022] DELETE /identity/v3/users/78935dbc62104d4bb18e869f8fa205e4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:36.355958 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbbad2-bef1-4771-a633-c8a8285e1d87 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:36.356262 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbbad2-bef1-4771-a633-c8a8285e1d87 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:36.356538 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbbad2-bef1-4771-a633-c8a8285e1d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:36.375198 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8fcbbad2-bef1-4771-a633-c8a8285e1d87 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:36.376395 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8fcbbad2-bef1-4771-a633-c8a8285e1d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:36.419373 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:36.435403 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1431/2849] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:34:36.445484 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7895d6-0962-497f-88d3-97a5b3fa98bc admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:36.446883 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6c7895d6-0962-497f-88d3-97a5b3fa98bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:36.505537 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7895d6-0962-497f-88d3-97a5b3fa98bc admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:36.509199 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa0676-41d6-4b12-b215-3f6257e69cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:36.509820 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa0676-41d6-4b12-b215-3f6257e69cbc service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:36.510095 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa0676-41d6-4b12-b215-3f6257e69cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:36.510364 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa0676-41d6-4b12-b215-3f6257e69cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:36.519213 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa0676-41d6-4b12-b215-3f6257e69cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:36.521311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa0676-41d6-4b12-b215-3f6257e69cbc service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:36.530903 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1419/2850] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:34:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:34:36.794366 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbbad2-bef1-4771-a633-c8a8285e1d87 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:36.795803 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8fcbbad2-bef1-4771-a633-c8a8285e1d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:36.808810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbbad2-bef1-4771-a633-c8a8285e1d87 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:36.813757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec8e58-92a0-406d-8700-b12ab43535b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:36.814452 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec8e58-92a0-406d-8700-b12ab43535b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:36.814790 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec8e58-92a0-406d-8700-b12ab43535b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:36.815620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec8e58-92a0-406d-8700-b12ab43535b3 admin admin] PATH_INFO: `/v3/projects/09a7270bad374f90b9ddd546a495af19` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:36.817617 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec8e58-92a0-406d-8700-b12ab43535b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a7270bad374f90b9ddd546a495af19)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:36.819613 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec8e58-92a0-406d-8700-b12ab43535b3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:36.865359 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9dec8e58-92a0-406d-8700-b12ab43535b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a7270bad374f90b9ddd546a495af19', 'request_id': 'req-9dec8e58-92a0-406d-8700-b12ab43535b3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:36.870586 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9dec8e58-92a0-406d-8700-b12ab43535b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a7270bad374f90b9ddd546a495af19', 'request_id': 'req-9dec8e58-92a0-406d-8700-b12ab43535b3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:36.877483 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9dec8e58-92a0-406d-8700-b12ab43535b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a7270bad374f90b9ddd546a495af19', 'request_id': 'req-9dec8e58-92a0-406d-8700-b12ab43535b3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:36.888460 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9dec8e58-92a0-406d-8700-b12ab43535b3 admin admin] The token cache is being invalidate because project 09a7270bad374f90b9ddd546a495af19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:34:36.888781 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9dec8e58-92a0-406d-8700-b12ab43535b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:36.889401 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9dec8e58-92a0-406d-8700-b12ab43535b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:36.890860 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1432/2851] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:34:36 2022] DELETE /identity/v3/projects/09a7270bad374f90b9ddd546a495af19 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:36.895598 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa0676-41d6-4b12-b215-3f6257e69cbc service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:36.905556 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa0676-41d6-4b12-b215-3f6257e69cbc service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:36.964548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5f18b-37ed-4db3-a3d3-a83443adc089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:36.965199 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5f18b-37ed-4db3-a3d3-a83443adc089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:36.965474 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5f18b-37ed-4db3-a3d3-a83443adc089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:36.965743 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5f18b-37ed-4db3-a3d3-a83443adc089 admin admin] PATH_INFO: `/v3/users/4f1b95226e11432d8e8dc71c8ac32ee9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:36.966837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5f18b-37ed-4db3-a3d3-a83443adc089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f1b95226e11432d8e8dc71c8ac32ee9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:36.968752 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5f18b-37ed-4db3-a3d3-a83443adc089 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:36.984966 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:37.014897 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-72b5f18b-37ed-4db3-a3d3-a83443adc089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f1b95226e11432d8e8dc71c8ac32ee9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:37.022203 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-72b5f18b-37ed-4db3-a3d3-a83443adc089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f1b95226e11432d8e8dc71c8ac32ee9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:37.034238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-72b5f18b-37ed-4db3-a3d3-a83443adc089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f1b95226e11432d8e8dc71c8ac32ee9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:37.041509 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-72b5f18b-37ed-4db3-a3d3-a83443adc089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f1b95226e11432d8e8dc71c8ac32ee9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:37.042146 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-72b5f18b-37ed-4db3-a3d3-a83443adc089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f1b95226e11432d8e8dc71c8ac32ee9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:37.048137 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1420/2852] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:34:36 2022] DELETE /identity/v3/users/4f1b95226e11432d8e8dc71c8ac32ee9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:37.314880 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec8e58-92a0-406d-8700-b12ab43535b3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:37.316431 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9dec8e58-92a0-406d-8700-b12ab43535b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:37.329523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec8e58-92a0-406d-8700-b12ab43535b3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:37.385873 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5b706-dd14-4e2c-848d-bf7aa482c2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:37.386499 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5b706-dd14-4e2c-848d-bf7aa482c2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:37.386785 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5b706-dd14-4e2c-848d-bf7aa482c2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:37.387059 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5b706-dd14-4e2c-848d-bf7aa482c2a8 admin admin] PATH_INFO: `/v3/projects/a9385403fe73486a9df9294669d802f3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:37.388179 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5b706-dd14-4e2c-848d-bf7aa482c2a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9385403fe73486a9df9294669d802f3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:37.390153 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5b706-dd14-4e2c-848d-bf7aa482c2a8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:37.436266 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5cf5b706-dd14-4e2c-848d-bf7aa482c2a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9385403fe73486a9df9294669d802f3', 'request_id': 'req-5cf5b706-dd14-4e2c-848d-bf7aa482c2a8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:37.441588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5cf5b706-dd14-4e2c-848d-bf7aa482c2a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9385403fe73486a9df9294669d802f3', 'request_id': 'req-5cf5b706-dd14-4e2c-848d-bf7aa482c2a8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:37.448249 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5cf5b706-dd14-4e2c-848d-bf7aa482c2a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9385403fe73486a9df9294669d802f3', 'request_id': 'req-5cf5b706-dd14-4e2c-848d-bf7aa482c2a8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:37.458799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5cf5b706-dd14-4e2c-848d-bf7aa482c2a8 admin admin] The token cache is being invalidate because project a9385403fe73486a9df9294669d802f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:34:37.459078 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5cf5b706-dd14-4e2c-848d-bf7aa482c2a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:37.459686 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5cf5b706-dd14-4e2c-848d-bf7aa482c2a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:37.461325 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1433/2853] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:34:37 2022] DELETE /identity/v3/projects/a9385403fe73486a9df9294669d802f3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:34:37.466221 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b661b1-936e-43f9-8716-78e3ef271c9a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:37.466513 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b661b1-936e-43f9-8716-78e3ef271c9a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:37.466790 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b661b1-936e-43f9-8716-78e3ef271c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:37.487794 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-89b661b1-936e-43f9-8716-78e3ef271c9a None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:37.489608 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-89b661b1-936e-43f9-8716-78e3ef271c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:37.547507 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1421/2854] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:34:37.556571 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6578b-0c20-45ac-bf9f-93fb1d98abf0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:37.556887 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6578b-0c20-45ac-bf9f-93fb1d98abf0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:37.557156 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6578b-0c20-45ac-bf9f-93fb1d98abf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:37.564576 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:37.577832 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9dd6578b-0c20-45ac-bf9f-93fb1d98abf0 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:37.579015 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9dd6578b-0c20-45ac-bf9f-93fb1d98abf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:37.587188 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1434/2855] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:34:37.591516 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b661b1-936e-43f9-8716-78e3ef271c9a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:37.601896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b661b1-936e-43f9-8716-78e3ef271c9a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:37.606489 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d469c-2e84-40a3-9a0e-33f96f12b4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:37.607073 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d469c-2e84-40a3-9a0e-33f96f12b4de admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:37.607348 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d469c-2e84-40a3-9a0e-33f96f12b4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:37.607619 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d469c-2e84-40a3-9a0e-33f96f12b4de admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:37.608254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d469c-2e84-40a3-9a0e-33f96f12b4de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:34:37.608638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d469c-2e84-40a3-9a0e-33f96f12b4de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:37.610204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d469c-2e84-40a3-9a0e-33f96f12b4de admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:37.621570 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1422/2856] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:34:37.625909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6578b-0c20-45ac-bf9f-93fb1d98abf0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:37.635034 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6578b-0c20-45ac-bf9f-93fb1d98abf0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:37.639588 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e95561-9cd5-4813-af3f-353286ad240b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:37.640167 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e95561-9cd5-4813-af3f-353286ad240b admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:37.640443 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e95561-9cd5-4813-af3f-353286ad240b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:37.640743 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e95561-9cd5-4813-af3f-353286ad240b admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:37.641360 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e95561-9cd5-4813-af3f-353286ad240b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:37.643229 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e95561-9cd5-4813-af3f-353286ad240b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:37.670182 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1435/2857] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:34:37 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:34:37.674201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d469c-2e84-40a3-9a0e-33f96f12b4de admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:37.683837 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d469c-2e84-40a3-9a0e-33f96f12b4de admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:37.737742 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8c4b5-865b-4085-a718-0f657b7e839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:37.738357 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8c4b5-865b-4085-a718-0f657b7e839e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:37.738633 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8c4b5-865b-4085-a718-0f657b7e839e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:37.738902 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8c4b5-865b-4085-a718-0f657b7e839e admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:37.739513 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8c4b5-865b-4085-a718-0f657b7e839e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:37.741423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8c4b5-865b-4085-a718-0f657b7e839e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:37.761487 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1423/2858] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:34:37 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:34:37.765509 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e95561-9cd5-4813-af3f-353286ad240b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:37.776268 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e95561-9cd5-4813-af3f-353286ad240b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:37.780773 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad2a3b-2914-4c86-b19f-409a690b7d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:37.781358 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad2a3b-2914-4c86-b19f-409a690b7d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:37.781631 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad2a3b-2914-4c86-b19f-409a690b7d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:37.781901 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad2a3b-2914-4c86-b19f-409a690b7d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:37.782536 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad2a3b-2914-4c86-b19f-409a690b7d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:37.784107 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad2a3b-2914-4c86-b19f-409a690b7d94 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:37.794250 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1436/2859] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:34:37.797963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8c4b5-865b-4085-a718-0f657b7e839e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:37.807878 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8c4b5-865b-4085-a718-0f657b7e839e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:37.812335 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418021a-f964-41f8-b0d6-871da135873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:37.812951 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418021a-f964-41f8-b0d6-871da135873f admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:37.813227 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418021a-f964-41f8-b0d6-871da135873f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:37.813493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418021a-f964-41f8-b0d6-871da135873f admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:37.814117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418021a-f964-41f8-b0d6-871da135873f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:37.815719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418021a-f964-41f8-b0d6-871da135873f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:37.821014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:37.827461 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1424/2860] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:34:37.831651 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad2a3b-2914-4c86-b19f-409a690b7d94 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:37.842113 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad2a3b-2914-4c86-b19f-409a690b7d94 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:37.846691 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3c93e-efdd-4428-9fc1-0f5606874d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:37.847327 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3c93e-efdd-4428-9fc1-0f5606874d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:37.848169 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3c93e-efdd-4428-9fc1-0f5606874d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:37.848449 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3c93e-efdd-4428-9fc1-0f5606874d87 admin admin] PATH_INFO: `/v3/projects/cf31071ddb5441179e65db7c4256f8c7/users/f68f2646cd4846199da06fa45af873a5/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:37.863145 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3c93e-efdd-4428-9fc1-0f5606874d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf31071ddb5441179e65db7c4256f8c7, user_id=f68f2646cd4846199da06fa45af873a5, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:37.865839 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3c93e-efdd-4428-9fc1-0f5606874d87 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:37.877885 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1437/2861] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:34:37 2022] PUT /identity/v3/projects/cf31071ddb5441179e65db7c4256f8c7/users/f68f2646cd4846199da06fa45af873a5/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:37.888611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a032e75-d36d-45f6-8257-f8af35bd703b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:37.888901 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a032e75-d36d-45f6-8257-f8af35bd703b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:37.889175 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a032e75-d36d-45f6-8257-f8af35bd703b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:37.916933 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9a032e75-d36d-45f6-8257-f8af35bd703b None None] MFA Rules not processed for user `f68f2646cd4846199da06fa45af873a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:37.918123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9a032e75-d36d-45f6-8257-f8af35bd703b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:37.980363 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1425/2862] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:34:37.984877 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3c93e-efdd-4428-9fc1-0f5606874d87 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:38.045148 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3c93e-efdd-4428-9fc1-0f5606874d87 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:38.049765 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b45c49-3586-4f84-8861-2c7e820850f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:38.050356 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b45c49-3586-4f84-8861-2c7e820850f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:38.050662 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b45c49-3586-4f84-8861-2c7e820850f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:38.050935 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b45c49-3586-4f84-8861-2c7e820850f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:38.051550 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b45c49-3586-4f84-8861-2c7e820850f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:38.053481 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b45c49-3586-4f84-8861-2c7e820850f3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:38.079548 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1438/2863] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:34:37 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:34:38.084200 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a032e75-d36d-45f6-8257-f8af35bd703b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:38.094855 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a032e75-d36d-45f6-8257-f8af35bd703b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:38.150643 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29474250-b054-4a29-8271-be63079b36e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:38.151276 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29474250-b054-4a29-8271-be63079b36e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:38.151530 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29474250-b054-4a29-8271-be63079b36e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:38.151795 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29474250-b054-4a29-8271-be63079b36e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:38.152398 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29474250-b054-4a29-8271-be63079b36e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:38.154311 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29474250-b054-4a29-8271-be63079b36e8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:38.174061 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1426/2864] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:34:38 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:34:38.178091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b45c49-3586-4f84-8861-2c7e820850f3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:38.188375 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b45c49-3586-4f84-8861-2c7e820850f3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:38.193465 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b4880-89ce-429b-8f20-e398b2b06ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:38.194051 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b4880-89ce-429b-8f20-e398b2b06ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:38.194329 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b4880-89ce-429b-8f20-e398b2b06ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:38.194597 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b4880-89ce-429b-8f20-e398b2b06ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:38.195227 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b4880-89ce-429b-8f20-e398b2b06ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:38.196826 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b4880-89ce-429b-8f20-e398b2b06ff6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:38.207730 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1439/2865] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:34:38.211457 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29474250-b054-4a29-8271-be63079b36e8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:38.221280 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29474250-b054-4a29-8271-be63079b36e8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:38.225841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09557d08-a13a-4264-b512-7e500480d8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:38.226503 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09557d08-a13a-4264-b512-7e500480d8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:38.226782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09557d08-a13a-4264-b512-7e500480d8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:38.227058 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09557d08-a13a-4264-b512-7e500480d8e4 admin admin] PATH_INFO: `/v3/projects/ad1af97aa715464c90664192fd4881e4/users/badd85b12c7841abaa63d9e30ac60516/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:38.242182 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09557d08-a13a-4264-b512-7e500480d8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1af97aa715464c90664192fd4881e4, user_id=badd85b12c7841abaa63d9e30ac60516, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:38.244954 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09557d08-a13a-4264-b512-7e500480d8e4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:38.258479 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1427/2866] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:34:38 2022] PUT /identity/v3/projects/ad1af97aa715464c90664192fd4881e4/users/badd85b12c7841abaa63d9e30ac60516/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 16:34:38.262357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b4880-89ce-429b-8f20-e398b2b06ff6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:38.272286 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b4880-89ce-429b-8f20-e398b2b06ff6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:38.327218 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6209c-c9c3-486b-b93e-ed5506aba675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:38.327817 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6209c-c9c3-486b-b93e-ed5506aba675 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:38.328091 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6209c-c9c3-486b-b93e-ed5506aba675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:38.328359 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6209c-c9c3-486b-b93e-ed5506aba675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:38.329024 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6209c-c9c3-486b-b93e-ed5506aba675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:38.330649 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6209c-c9c3-486b-b93e-ed5506aba675 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:38.339972 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1440/2867] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:34:38.344295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09557d08-a13a-4264-b512-7e500480d8e4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:38.354290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09557d08-a13a-4264-b512-7e500480d8e4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:38.358808 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09747b-a3f2-415c-8f64-e0a29c77124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:38.359435 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09747b-a3f2-415c-8f64-e0a29c77124a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:38.359707 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09747b-a3f2-415c-8f64-e0a29c77124a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:38.359977 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09747b-a3f2-415c-8f64-e0a29c77124a admin admin] PATH_INFO: `/v3/projects/ad1af97aa715464c90664192fd4881e4/users/badd85b12c7841abaa63d9e30ac60516/roles/4a2cfbf9ab624a6699c018217006b8d8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:38.361886 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09747b-a3f2-415c-8f64-e0a29c77124a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1af97aa715464c90664192fd4881e4, user_id=badd85b12c7841abaa63d9e30ac60516, role_id=4a2cfbf9ab624a6699c018217006b8d8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:38.365033 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09747b-a3f2-415c-8f64-e0a29c77124a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:38.374880 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1428/2868] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:34:38 2022] PUT /identity/v3/projects/ad1af97aa715464c90664192fd4881e4/users/badd85b12c7841abaa63d9e30ac60516/roles/4a2cfbf9ab624a6699c018217006b8d8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:38.385728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5a76b-0a49-4a19-8c82-ee3ac0015ce4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:38.386017 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5a76b-0a49-4a19-8c82-ee3ac0015ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:38.386293 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5a76b-0a49-4a19-8c82-ee3ac0015ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:38.405421 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:38.415342 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8de5a76b-0a49-4a19-8c82-ee3ac0015ce4 None None] MFA Rules not processed for user `badd85b12c7841abaa63d9e30ac60516`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:38.416537 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8de5a76b-0a49-4a19-8c82-ee3ac0015ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:38.483115 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1441/2869] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:34:38.495452 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09747b-a3f2-415c-8f64-e0a29c77124a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:38.497161 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6e09747b-a3f2-415c-8f64-e0a29c77124a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:38.542062 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:38.554330 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09747b-a3f2-415c-8f64-e0a29c77124a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:38.558107 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ea18e-63ba-4c49-876a-24ed4881322d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:38.558702 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ea18e-63ba-4c49-876a-24ed4881322d service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:38.558979 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ea18e-63ba-4c49-876a-24ed4881322d service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:38.559252 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ea18e-63ba-4c49-876a-24ed4881322d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:38.568865 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ea18e-63ba-4c49-876a-24ed4881322d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:38.570306 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ea18e-63ba-4c49-876a-24ed4881322d service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:38.579594 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1429/2870] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:34:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:34:38.683991 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5a76b-0a49-4a19-8c82-ee3ac0015ce4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:38.693728 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5a76b-0a49-4a19-8c82-ee3ac0015ce4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:38.697268 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae74a75-5035-474d-adb3-e7178036baa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:38.697863 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae74a75-5035-474d-adb3-e7178036baa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:38.698144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae74a75-5035-474d-adb3-e7178036baa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:38.698414 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae74a75-5035-474d-adb3-e7178036baa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:38.753807 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae74a75-5035-474d-adb3-e7178036baa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:38.755224 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae74a75-5035-474d-adb3-e7178036baa2 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:38.763822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1442/2871] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:34:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:34:41.330841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ea18e-63ba-4c49-876a-24ed4881322d service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:41.395123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ea18e-63ba-4c49-876a-24ed4881322d service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:41.400041 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982502c-5186-4d30-a194-4594d036438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:41.400687 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982502c-5186-4d30-a194-4594d036438f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:41.400963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982502c-5186-4d30-a194-4594d036438f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:41.401228 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982502c-5186-4d30-a194-4594d036438f admin admin] PATH_INFO: `/v3/users/f68f2646cd4846199da06fa45af873a5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:41.402331 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982502c-5186-4d30-a194-4594d036438f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68f2646cd4846199da06fa45af873a5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:41.404209 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982502c-5186-4d30-a194-4594d036438f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:41.454431 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3982502c-5186-4d30-a194-4594d036438f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68f2646cd4846199da06fa45af873a5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:41.461362 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3982502c-5186-4d30-a194-4594d036438f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68f2646cd4846199da06fa45af873a5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:41.476891 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3982502c-5186-4d30-a194-4594d036438f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68f2646cd4846199da06fa45af873a5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:41.483741 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3982502c-5186-4d30-a194-4594d036438f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68f2646cd4846199da06fa45af873a5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:41.484438 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3982502c-5186-4d30-a194-4594d036438f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68f2646cd4846199da06fa45af873a5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:41.490757 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1430/2872] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:34:41 2022] DELETE /identity/v3/users/f68f2646cd4846199da06fa45af873a5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:41.495100 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8779dc-b4c8-42fc-81b9-93c610aa64fb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:41.495545 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8779dc-b4c8-42fc-81b9-93c610aa64fb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:41.495645 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8779dc-b4c8-42fc-81b9-93c610aa64fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:41.514710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6b8779dc-b4c8-42fc-81b9-93c610aa64fb None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:41.515921 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6b8779dc-b4c8-42fc-81b9-93c610aa64fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:41.573674 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1443/2873] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:34:41.583153 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982502c-5186-4d30-a194-4594d036438f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:41.584533 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3982502c-5186-4d30-a194-4594d036438f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:41.641014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982502c-5186-4d30-a194-4594d036438f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:41.644721 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fd772-7aae-45cc-8077-cbd3660fe00d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:41.645318 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fd772-7aae-45cc-8077-cbd3660fe00d service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:41.645593 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fd772-7aae-45cc-8077-cbd3660fe00d service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:41.645861 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fd772-7aae-45cc-8077-cbd3660fe00d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:41.655710 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fd772-7aae-45cc-8077-cbd3660fe00d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:41.657177 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fd772-7aae-45cc-8077-cbd3660fe00d service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:41.667572 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1431/2874] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:34:41.947003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8779dc-b4c8-42fc-81b9-93c610aa64fb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:41.948706 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6b8779dc-b4c8-42fc-81b9-93c610aa64fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:41.962574 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8779dc-b4c8-42fc-81b9-93c610aa64fb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:41.968212 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862acb5c-f964-4268-ab01-8705a69d999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:41.969061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862acb5c-f964-4268-ab01-8705a69d999b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:41.969457 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862acb5c-f964-4268-ab01-8705a69d999b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:41.969793 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862acb5c-f964-4268-ab01-8705a69d999b admin admin] PATH_INFO: `/v3/projects/cf31071ddb5441179e65db7c4256f8c7` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:41.971656 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862acb5c-f964-4268-ab01-8705a69d999b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf31071ddb5441179e65db7c4256f8c7)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:41.974465 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862acb5c-f964-4268-ab01-8705a69d999b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:42.007577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:42.024047 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-862acb5c-f964-4268-ab01-8705a69d999b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf31071ddb5441179e65db7c4256f8c7', 'request_id': 'req-862acb5c-f964-4268-ab01-8705a69d999b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:42.030007 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-862acb5c-f964-4268-ab01-8705a69d999b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf31071ddb5441179e65db7c4256f8c7', 'request_id': 'req-862acb5c-f964-4268-ab01-8705a69d999b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:42.037668 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-862acb5c-f964-4268-ab01-8705a69d999b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf31071ddb5441179e65db7c4256f8c7', 'request_id': 'req-862acb5c-f964-4268-ab01-8705a69d999b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:42.050988 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-862acb5c-f964-4268-ab01-8705a69d999b admin admin] The token cache is being invalidate because project cf31071ddb5441179e65db7c4256f8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:34:42.051278 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-862acb5c-f964-4268-ab01-8705a69d999b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:42.051909 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-862acb5c-f964-4268-ab01-8705a69d999b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:42.053439 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1444/2875] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:34:41 2022] DELETE /identity/v3/projects/cf31071ddb5441179e65db7c4256f8c7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:42.057473 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fd772-7aae-45cc-8077-cbd3660fe00d service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:42.066921 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fd772-7aae-45cc-8077-cbd3660fe00d service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:42.070556 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:42.124957 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd98c6-588c-475c-a854-657413171ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:42.125497 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd98c6-588c-475c-a854-657413171ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:42.125774 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd98c6-588c-475c-a854-657413171ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:42.126044 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd98c6-588c-475c-a854-657413171ed4 admin admin] PATH_INFO: `/v3/users/badd85b12c7841abaa63d9e30ac60516` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:42.127143 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd98c6-588c-475c-a854-657413171ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=badd85b12c7841abaa63d9e30ac60516)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:42.129095 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd98c6-588c-475c-a854-657413171ed4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:42.176126 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-12bd98c6-588c-475c-a854-657413171ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'badd85b12c7841abaa63d9e30ac60516'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:42.183426 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-12bd98c6-588c-475c-a854-657413171ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'badd85b12c7841abaa63d9e30ac60516'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:42.195165 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-12bd98c6-588c-475c-a854-657413171ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'badd85b12c7841abaa63d9e30ac60516'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:42.202016 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-12bd98c6-588c-475c-a854-657413171ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'badd85b12c7841abaa63d9e30ac60516'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:42.202646 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-12bd98c6-588c-475c-a854-657413171ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'badd85b12c7841abaa63d9e30ac60516'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:42.208946 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1432/2876] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:34:42 2022] DELETE /identity/v3/users/badd85b12c7841abaa63d9e30ac60516 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:42.471842 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862acb5c-f964-4268-ab01-8705a69d999b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:42.473426 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-862acb5c-f964-4268-ab01-8705a69d999b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:42.487599 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862acb5c-f964-4268-ab01-8705a69d999b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:42.545422 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea13e2-4511-466d-8ab4-2eceea994d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:42.546037 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea13e2-4511-466d-8ab4-2eceea994d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:42.546314 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea13e2-4511-466d-8ab4-2eceea994d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:42.546591 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea13e2-4511-466d-8ab4-2eceea994d52 admin admin] PATH_INFO: `/v3/projects/ad1af97aa715464c90664192fd4881e4` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:42.547709 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea13e2-4511-466d-8ab4-2eceea994d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1af97aa715464c90664192fd4881e4)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:42.549642 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea13e2-4511-466d-8ab4-2eceea994d52 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:42.595143 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-55ea13e2-4511-466d-8ab4-2eceea994d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1af97aa715464c90664192fd4881e4', 'request_id': 'req-55ea13e2-4511-466d-8ab4-2eceea994d52'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:42.600425 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-55ea13e2-4511-466d-8ab4-2eceea994d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1af97aa715464c90664192fd4881e4', 'request_id': 'req-55ea13e2-4511-466d-8ab4-2eceea994d52'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:42.607609 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-55ea13e2-4511-466d-8ab4-2eceea994d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1af97aa715464c90664192fd4881e4', 'request_id': 'req-55ea13e2-4511-466d-8ab4-2eceea994d52'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:42.618223 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-55ea13e2-4511-466d-8ab4-2eceea994d52 admin admin] The token cache is being invalidate because project ad1af97aa715464c90664192fd4881e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:34:42.618508 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-55ea13e2-4511-466d-8ab4-2eceea994d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:42.619122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-55ea13e2-4511-466d-8ab4-2eceea994d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:34:42.620555 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1445/2877] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:34:42 2022] DELETE /identity/v3/projects/ad1af97aa715464c90664192fd4881e4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:42.625382 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37b5b4-476a-4a45-ac2d-c0ca14290180 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:42.625838 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37b5b4-476a-4a45-ac2d-c0ca14290180 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:42.625935 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37b5b4-476a-4a45-ac2d-c0ca14290180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:42.645896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6d37b5b4-476a-4a45-ac2d-c0ca14290180 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:42.647019 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6d37b5b4-476a-4a45-ac2d-c0ca14290180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:42.704109 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1433/2878] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:34:42.764855 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b38d0-c1d1-4024-a051-7927bd2b830e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:42.765138 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b38d0-c1d1-4024-a051-7927bd2b830e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:42.765415 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b38d0-c1d1-4024-a051-7927bd2b830e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:42.785146 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2d4b38d0-c1d1-4024-a051-7927bd2b830e None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:42.786345 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2d4b38d0-c1d1-4024-a051-7927bd2b830e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:42.794158 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1446/2879] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:34:42.798335 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37b5b4-476a-4a45-ac2d-c0ca14290180 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:42.808553 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37b5b4-476a-4a45-ac2d-c0ca14290180 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:42.813141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c89e3-8c32-4d01-9ff5-5ec2493f7366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:42.813716 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c89e3-8c32-4d01-9ff5-5ec2493f7366 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:42.813998 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c89e3-8c32-4d01-9ff5-5ec2493f7366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:42.814265 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c89e3-8c32-4d01-9ff5-5ec2493f7366 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:42.814896 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c89e3-8c32-4d01-9ff5-5ec2493f7366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:34:42.815193 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c89e3-8c32-4d01-9ff5-5ec2493f7366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:42.817458 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c89e3-8c32-4d01-9ff5-5ec2493f7366 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:42.828658 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1434/2880] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:34:42.832739 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b38d0-c1d1-4024-a051-7927bd2b830e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:42.842095 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b38d0-c1d1-4024-a051-7927bd2b830e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:42.846799 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514780f-af2c-4581-b35a-a8a123848853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:42.847413 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514780f-af2c-4581-b35a-a8a123848853 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:42.847708 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514780f-af2c-4581-b35a-a8a123848853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:42.847982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514780f-af2c-4581-b35a-a8a123848853 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:42.848631 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514780f-af2c-4581-b35a-a8a123848853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:42.850521 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514780f-af2c-4581-b35a-a8a123848853 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:42.877610 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1447/2881] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:34:42 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:34:42.882253 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c89e3-8c32-4d01-9ff5-5ec2493f7366 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:42.892295 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c89e3-8c32-4d01-9ff5-5ec2493f7366 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:42.901290 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:42.950541 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b678e6-f387-4cf8-bb3f-d028a3fc6a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:42.951141 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b678e6-f387-4cf8-bb3f-d028a3fc6a36 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:42.951423 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b678e6-f387-4cf8-bb3f-d028a3fc6a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:42.951696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b678e6-f387-4cf8-bb3f-d028a3fc6a36 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:42.952308 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b678e6-f387-4cf8-bb3f-d028a3fc6a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:42.954254 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b678e6-f387-4cf8-bb3f-d028a3fc6a36 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:42.975595 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1435/2882] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:34:42 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:34:42.979711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514780f-af2c-4581-b35a-a8a123848853 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:42.990527 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514780f-af2c-4581-b35a-a8a123848853 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:42.995144 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a541ff1-db8f-4151-a604-2029fcd93790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:42.995736 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541ff1-db8f-4151-a604-2029fcd93790 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:42.996015 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541ff1-db8f-4151-a604-2029fcd93790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:42.996315 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541ff1-db8f-4151-a604-2029fcd93790 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:42.997020 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a541ff1-db8f-4151-a604-2029fcd93790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:42.998601 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a541ff1-db8f-4151-a604-2029fcd93790 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:43.009163 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1448/2883] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:34:43.012920 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b678e6-f387-4cf8-bb3f-d028a3fc6a36 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:43.022931 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b678e6-f387-4cf8-bb3f-d028a3fc6a36 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:43.027752 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a443dd-c32a-4470-ac99-aa76476c03e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:43.028332 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a443dd-c32a-4470-ac99-aa76476c03e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:43.028637 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a443dd-c32a-4470-ac99-aa76476c03e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:43.028911 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a443dd-c32a-4470-ac99-aa76476c03e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:43.029536 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a443dd-c32a-4470-ac99-aa76476c03e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:43.031100 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a443dd-c32a-4470-ac99-aa76476c03e4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:43.041373 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1436/2884] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:34:43.045473 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a541ff1-db8f-4151-a604-2029fcd93790 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:43.056082 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a541ff1-db8f-4151-a604-2029fcd93790 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:43.060953 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202252-5c1a-483c-89bc-bed3fd551309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:43.061620 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202252-5c1a-483c-89bc-bed3fd551309 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:43.061897 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202252-5c1a-483c-89bc-bed3fd551309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:43.062172 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202252-5c1a-483c-89bc-bed3fd551309 admin admin] PATH_INFO: `/v3/projects/4f36a308cb69443dbd7e87abc67a167f/users/5b088bf73e9a4a1ab1941566ff04bfc3/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:43.064338 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:43.080284 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e202252-5c1a-483c-89bc-bed3fd551309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f36a308cb69443dbd7e87abc67a167f, user_id=5b088bf73e9a4a1ab1941566ff04bfc3, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:43.083005 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e202252-5c1a-483c-89bc-bed3fd551309 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:43.095373 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1449/2885] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:34:43 2022] PUT /identity/v3/projects/4f36a308cb69443dbd7e87abc67a167f/users/5b088bf73e9a4a1ab1941566ff04bfc3/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:34:43.105918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c6015-0b9a-4caa-acc2-e03e6fbc53bb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:43.106201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c6015-0b9a-4caa-acc2-e03e6fbc53bb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:43.106471 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c6015-0b9a-4caa-acc2-e03e6fbc53bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:43.134384 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5b5c6015-0b9a-4caa-acc2-e03e6fbc53bb None None] MFA Rules not processed for user `5b088bf73e9a4a1ab1941566ff04bfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:34:43.135577 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5b5c6015-0b9a-4caa-acc2-e03e6fbc53bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:43.199689 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1437/2886] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:34:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:34:43.212043 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202252-5c1a-483c-89bc-bed3fd551309 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:34:43.213780 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9e202252-5c1a-483c-89bc-bed3fd551309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:34:43.268968 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202252-5c1a-483c-89bc-bed3fd551309 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:34:43.273292 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fdd1c-ef5d-44d7-a051-e072fd17f2db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9158ce9d8a4aadbf86405657958c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:34:43.273828 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fdd1c-ef5d-44d7-a051-e072fd17f2db service glance] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:34:43.274360 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fdd1c-ef5d-44d7-a051-e072fd17f2db service glance] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:34:43.274623 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fdd1c-ef5d-44d7-a051-e072fd17f2db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:34:43.283003 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fdd1c-ef5d-44d7-a051-e072fd17f2db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:34:43.284430 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fdd1c-ef5d-44d7-a051-e072fd17f2db service glance] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:34:43.293087 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1450/2887] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:34:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:34:53.196693 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=60,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:53.289254 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:06.054869 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c6015-0b9a-4caa-acc2-e03e6fbc53bb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:35:06.115498 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c6015-0b9a-4caa-acc2-e03e6fbc53bb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:35:06.120003 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0a99e-0368-420c-b7a6-d03f3bd780ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:35:06.120638 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0a99e-0368-420c-b7a6-d03f3bd780ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:06.120918 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0a99e-0368-420c-b7a6-d03f3bd780ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:06.121188 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0a99e-0368-420c-b7a6-d03f3bd780ed admin admin] PATH_INFO: `/v3/users/5b088bf73e9a4a1ab1941566ff04bfc3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:06.122326 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0a99e-0368-420c-b7a6-d03f3bd780ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b088bf73e9a4a1ab1941566ff04bfc3)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:35:06.124216 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0a99e-0368-420c-b7a6-d03f3bd780ed admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:35:06.169648 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a9c0a99e-0368-420c-b7a6-d03f3bd780ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b088bf73e9a4a1ab1941566ff04bfc3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:06.176817 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a9c0a99e-0368-420c-b7a6-d03f3bd780ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b088bf73e9a4a1ab1941566ff04bfc3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:06.188289 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a9c0a99e-0368-420c-b7a6-d03f3bd780ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b088bf73e9a4a1ab1941566ff04bfc3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:06.195587 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a9c0a99e-0368-420c-b7a6-d03f3bd780ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b088bf73e9a4a1ab1941566ff04bfc3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:06.196204 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a9c0a99e-0368-420c-b7a6-d03f3bd780ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b088bf73e9a4a1ab1941566ff04bfc3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:06.201841 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1438/2888] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:35:06 2022] DELETE /identity/v3/users/5b088bf73e9a4a1ab1941566ff04bfc3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:35:06.206253 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91661867-e513-4fc2-9ad8-38dfd2469509 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:06.206710 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91661867-e513-4fc2-9ad8-38dfd2469509 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:06.206822 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91661867-e513-4fc2-9ad8-38dfd2469509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:06.224890 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-91661867-e513-4fc2-9ad8-38dfd2469509 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:35:06.226070 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-91661867-e513-4fc2-9ad8-38dfd2469509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:35:06.283523 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1451/2889] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 16:35:06.293123 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0a99e-0368-420c-b7a6-d03f3bd780ed admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:35:06.294500 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a9c0a99e-0368-420c-b7a6-d03f3bd780ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:35:06.350588 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0a99e-0368-420c-b7a6-d03f3bd780ed admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:35:06.354210 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cfb8f-28f3-4f9a-91f9-99914be0bf69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:35:06.354796 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cfb8f-28f3-4f9a-91f9-99914be0bf69 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:06.355068 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cfb8f-28f3-4f9a-91f9-99914be0bf69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:06.355335 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cfb8f-28f3-4f9a-91f9-99914be0bf69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:06.364812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cfb8f-28f3-4f9a-91f9-99914be0bf69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:35:06.366238 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cfb8f-28f3-4f9a-91f9-99914be0bf69 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:35:06.375626 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1439/2890] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 16:35:06.637664 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91661867-e513-4fc2-9ad8-38dfd2469509 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:35:06.639134 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-91661867-e513-4fc2-9ad8-38dfd2469509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:35:06.652054 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91661867-e513-4fc2-9ad8-38dfd2469509 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:35:06.656810 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196dc53-44c7-4bd7-9a9f-40de987b71db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:35:06.657435 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196dc53-44c7-4bd7-9a9f-40de987b71db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:06.657711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196dc53-44c7-4bd7-9a9f-40de987b71db admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:06.657982 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196dc53-44c7-4bd7-9a9f-40de987b71db admin admin] PATH_INFO: `/v3/projects/4f36a308cb69443dbd7e87abc67a167f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:06.659605 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196dc53-44c7-4bd7-9a9f-40de987b71db admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f36a308cb69443dbd7e87abc67a167f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:35:06.661578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196dc53-44c7-4bd7-9a9f-40de987b71db admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:35:06.708293 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5196dc53-44c7-4bd7-9a9f-40de987b71db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f36a308cb69443dbd7e87abc67a167f', 'request_id': 'req-5196dc53-44c7-4bd7-9a9f-40de987b71db'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:06.713663 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5196dc53-44c7-4bd7-9a9f-40de987b71db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f36a308cb69443dbd7e87abc67a167f', 'request_id': 'req-5196dc53-44c7-4bd7-9a9f-40de987b71db'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:06.720907 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5196dc53-44c7-4bd7-9a9f-40de987b71db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f36a308cb69443dbd7e87abc67a167f', 'request_id': 'req-5196dc53-44c7-4bd7-9a9f-40de987b71db'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:06.732578 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5196dc53-44c7-4bd7-9a9f-40de987b71db admin admin] The token cache is being invalidate because project 4f36a308cb69443dbd7e87abc67a167f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:35:06.732895 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5196dc53-44c7-4bd7-9a9f-40de987b71db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:06.733520 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5196dc53-44c7-4bd7-9a9f-40de987b71db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:06.734984 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1452/2891] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:35:06 2022] DELETE /identity/v3/projects/4f36a308cb69443dbd7e87abc67a167f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:35:06.739776 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff1414-50e0-4218-bead-fff34437db18 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:06.740061 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff1414-50e0-4218-bead-fff34437db18 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:06.740333 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff1414-50e0-4218-bead-fff34437db18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:06.759120 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4dff1414-50e0-4218-bead-fff34437db18 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:35:06.760335 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4dff1414-50e0-4218-bead-fff34437db18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:35:06.778080 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:06.820875 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1440/2892] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:35:06.829632 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502e7f1-03d8-4006-988f-b091ef23a361 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:06.829923 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502e7f1-03d8-4006-988f-b091ef23a361 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:06.830199 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502e7f1-03d8-4006-988f-b091ef23a361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:06.850406 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8502e7f1-03d8-4006-988f-b091ef23a361 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:35:06.851608 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8502e7f1-03d8-4006-988f-b091ef23a361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:35:06.859357 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1453/2893] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:35:06.863623 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff1414-50e0-4218-bead-fff34437db18 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:35:06.873160 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff1414-50e0-4218-bead-fff34437db18 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:35:06.877698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3aec6d-acbc-4c75-b803-8487272e570e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:35:06.878282 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3aec6d-acbc-4c75-b803-8487272e570e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:06.878558 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3aec6d-acbc-4c75-b803-8487272e570e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:06.878830 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3aec6d-acbc-4c75-b803-8487272e570e admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:06.879469 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3aec6d-acbc-4c75-b803-8487272e570e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 16:35:06.879769 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3aec6d-acbc-4c75-b803-8487272e570e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:35:06.881377 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3aec6d-acbc-4c75-b803-8487272e570e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:35:06.892493 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1441/2894] 10.222.0.40 () {58 vars in 1153 bytes} [Thu Aug 11 16:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 16:35:06.897131 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502e7f1-03d8-4006-988f-b091ef23a361 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:35:06.906505 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502e7f1-03d8-4006-988f-b091ef23a361 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:35:06.911078 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e85415-b62a-47c0-8fec-6c889f56c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:35:06.911660 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e85415-b62a-47c0-8fec-6c889f56c3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:06.911937 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e85415-b62a-47c0-8fec-6c889f56c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:06.912208 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e85415-b62a-47c0-8fec-6c889f56c3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:06.912877 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e85415-b62a-47c0-8fec-6c889f56c3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:35:06.914767 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e85415-b62a-47c0-8fec-6c889f56c3d7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:35:06.950742 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1454/2895] 10.222.0.40 () {60 vars in 1153 bytes} [Thu Aug 11 16:35:06 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 16:35:06.954963 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3aec6d-acbc-4c75-b803-8487272e570e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:35:06.964812 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3aec6d-acbc-4c75-b803-8487272e570e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:35:07.019528 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df63d5-e6fa-4c16-8f2c-47c42225aef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:35:07.020117 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df63d5-e6fa-4c16-8f2c-47c42225aef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:07.020393 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df63d5-e6fa-4c16-8f2c-47c42225aef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:07.020694 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df63d5-e6fa-4c16-8f2c-47c42225aef1 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:07.021317 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df63d5-e6fa-4c16-8f2c-47c42225aef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:35:07.023201 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df63d5-e6fa-4c16-8f2c-47c42225aef1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:35:07.043954 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1442/2896] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Aug 11 16:35:06 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 16:35:07.048187 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e85415-b62a-47c0-8fec-6c889f56c3d7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:35:07.058711 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e85415-b62a-47c0-8fec-6c889f56c3d7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:35:07.063178 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244d3a8-9a79-46ee-9eca-eba91c915260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:35:07.063757 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244d3a8-9a79-46ee-9eca-eba91c915260 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:07.064030 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244d3a8-9a79-46ee-9eca-eba91c915260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:07.064297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244d3a8-9a79-46ee-9eca-eba91c915260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:07.064962 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244d3a8-9a79-46ee-9eca-eba91c915260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:35:07.067133 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244d3a8-9a79-46ee-9eca-eba91c915260 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:35:07.076689 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1455/2897] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 16:35:07.080409 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df63d5-e6fa-4c16-8f2c-47c42225aef1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:35:07.090267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df63d5-e6fa-4c16-8f2c-47c42225aef1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:35:07.094781 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f11e4a-198a-4baf-8f19-4990ca63ae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:35:07.095338 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f11e4a-198a-4baf-8f19-4990ca63ae87 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:07.095611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f11e4a-198a-4baf-8f19-4990ca63ae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:07.095879 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f11e4a-198a-4baf-8f19-4990ca63ae87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:07.096505 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f11e4a-198a-4baf-8f19-4990ca63ae87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:35:07.098601 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f11e4a-198a-4baf-8f19-4990ca63ae87 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:35:07.108773 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1443/2898] 10.222.0.40 () {58 vars in 1122 bytes} [Thu Aug 11 16:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 16:35:07.113297 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244d3a8-9a79-46ee-9eca-eba91c915260 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:35:07.123061 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244d3a8-9a79-46ee-9eca-eba91c915260 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:35:07.127772 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b457a-31f8-47cc-9e25-7e3fe1e9ff23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:35:07.128429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b457a-31f8-47cc-9e25-7e3fe1e9ff23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:07.128770 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b457a-31f8-47cc-9e25-7e3fe1e9ff23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:07.129045 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b457a-31f8-47cc-9e25-7e3fe1e9ff23 admin admin] PATH_INFO: `/v3/projects/9b695c9f7d354898a5fed309e1b4bf92/users/d19f066798324adfa515e4f4e59cceda/roles/87abba8d76c2420c97d9d5f2dbb6b540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:07.144311 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b457a-31f8-47cc-9e25-7e3fe1e9ff23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b695c9f7d354898a5fed309e1b4bf92, user_id=d19f066798324adfa515e4f4e59cceda, role_id=87abba8d76c2420c97d9d5f2dbb6b540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:35:07.146968 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b457a-31f8-47cc-9e25-7e3fe1e9ff23 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:35:07.160217 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1456/2899] 10.222.0.40 () {60 vars in 1483 bytes} [Thu Aug 11 16:35:07 2022] PUT /identity/v3/projects/9b695c9f7d354898a5fed309e1b4bf92/users/d19f066798324adfa515e4f4e59cceda/roles/87abba8d76c2420c97d9d5f2dbb6b540 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:35:07.170059 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe5244-0c62-44b6-9b7d-a165540cc4cf None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:07.170344 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe5244-0c62-44b6-9b7d-a165540cc4cf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:07.170611 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe5244-0c62-44b6-9b7d-a165540cc4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:07.198284 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-43fe5244-0c62-44b6-9b7d-a165540cc4cf None None] MFA Rules not processed for user `d19f066798324adfa515e4f4e59cceda`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:35:07.199481 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-43fe5244-0c62-44b6-9b7d-a165540cc4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:35:07.261782 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1444/2900] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:35:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:35:07.273121 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b457a-31f8-47cc-9e25-7e3fe1e9ff23 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:35:07.275082 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-215b457a-31f8-47cc-9e25-7e3fe1e9ff23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:35:07.288657 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:07.331547 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b457a-31f8-47cc-9e25-7e3fe1e9ff23 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:35:07.335288 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9972ef-bb2c-49c4-bbf8-1752e0c62c71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e52aae602104cc2b48354b2d75d359c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:35:07.335883 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9972ef-bb2c-49c4-bbf8-1752e0c62c71 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:07.336160 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9972ef-bb2c-49c4-bbf8-1752e0c62c71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:07.336429 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9972ef-bb2c-49c4-bbf8-1752e0c62c71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:07.344712 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9972ef-bb2c-49c4-bbf8-1752e0c62c71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:35:07.346130 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9972ef-bb2c-49c4-bbf8-1752e0c62c71 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:35:07.355355 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1457/2901] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:35:07 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:35:12.308929 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe5244-0c62-44b6-9b7d-a165540cc4cf None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:35:12.327876 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:12.371252 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe5244-0c62-44b6-9b7d-a165540cc4cf None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:35:12.375800 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ccd0b-4140-4077-9f6d-1e3e69e2f817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:35:12.376463 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ccd0b-4140-4077-9f6d-1e3e69e2f817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:12.376761 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ccd0b-4140-4077-9f6d-1e3e69e2f817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:12.377029 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ccd0b-4140-4077-9f6d-1e3e69e2f817 admin admin] PATH_INFO: `/v3/users/d19f066798324adfa515e4f4e59cceda` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:12.378119 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ccd0b-4140-4077-9f6d-1e3e69e2f817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19f066798324adfa515e4f4e59cceda)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:35:12.380128 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ccd0b-4140-4077-9f6d-1e3e69e2f817 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:35:12.425390 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b5ccd0b-4140-4077-9f6d-1e3e69e2f817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19f066798324adfa515e4f4e59cceda'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:12.432291 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b5ccd0b-4140-4077-9f6d-1e3e69e2f817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19f066798324adfa515e4f4e59cceda'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:12.443839 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b5ccd0b-4140-4077-9f6d-1e3e69e2f817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19f066798324adfa515e4f4e59cceda'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:12.450548 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b5ccd0b-4140-4077-9f6d-1e3e69e2f817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19f066798324adfa515e4f4e59cceda'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:12.451163 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b5ccd0b-4140-4077-9f6d-1e3e69e2f817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19f066798324adfa515e4f4e59cceda'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:12.456863 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1445/2902] 10.222.0.40 () {58 vars in 1224 bytes} [Thu Aug 11 16:35:12 2022] DELETE /identity/v3/users/d19f066798324adfa515e4f4e59cceda => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:35:12.461438 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b30b2-a23b-40c7-b3c5-915a676c6119 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:12.461928 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b30b2-a23b-40c7-b3c5-915a676c6119 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:12.462030 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b30b2-a23b-40c7-b3c5-915a676c6119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:12.480888 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a29b30b2-a23b-40c7-b3c5-915a676c6119 None None] MFA Rules not processed for user `c190c69c93f440c9b6a6c24b62b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 16:35:12.482084 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a29b30b2-a23b-40c7-b3c5-915a676c6119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:35:12.539352 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1458/2903] 10.222.0.40 () {58 vars in 958 bytes} [Thu Aug 11 16:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 16:35:12.549028 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ccd0b-4140-4077-9f6d-1e3e69e2f817 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:35:12.550464 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3b5ccd0b-4140-4077-9f6d-1e3e69e2f817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:35:12.605820 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ccd0b-4140-4077-9f6d-1e3e69e2f817 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:35:12.609433 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5120346-8f0e-4e0c-92df-f76ea1003164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d2570f97234d62948762562616000c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:35:12.610014 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5120346-8f0e-4e0c-92df-f76ea1003164 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:12.610288 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5120346-8f0e-4e0c-92df-f76ea1003164 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:12.610555 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5120346-8f0e-4e0c-92df-f76ea1003164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:12.619267 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5120346-8f0e-4e0c-92df-f76ea1003164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:35:12.620698 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5120346-8f0e-4e0c-92df-f76ea1003164 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:35:12.630351 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1446/2904] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:35:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:35:12.901831 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b30b2-a23b-40c7-b3c5-915a676c6119 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:35:12.903369 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a29b30b2-a23b-40c7-b3c5-915a676c6119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:35:12.915122 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b30b2-a23b-40c7-b3c5-915a676c6119 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:35:12.919565 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8d27d-5588-4ab3-b556-c15afd085ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c190c69c93f440c9b6a6c24b62b15091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc786cd53c124382a4c7cfd8b7e41636', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:35:12.920179 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8d27d-5588-4ab3-b556-c15afd085ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:35:12.920451 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8d27d-5588-4ab3-b556-c15afd085ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:35:12.920749 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8d27d-5588-4ab3-b556-c15afd085ceb admin admin] PATH_INFO: `/v3/projects/9b695c9f7d354898a5fed309e1b4bf92` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:35:12.921849 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8d27d-5588-4ab3-b556-c15afd085ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b695c9f7d354898a5fed309e1b4bf92)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:35:12.923733 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8d27d-5588-4ab3-b556-c15afd085ceb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:35:12.970264 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80a8d27d-5588-4ab3-b556-c15afd085ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b695c9f7d354898a5fed309e1b4bf92', 'request_id': 'req-80a8d27d-5588-4ab3-b556-c15afd085ceb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:12.975794 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80a8d27d-5588-4ab3-b556-c15afd085ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b695c9f7d354898a5fed309e1b4bf92', 'request_id': 'req-80a8d27d-5588-4ab3-b556-c15afd085ceb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:12.982325 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80a8d27d-5588-4ab3-b556-c15afd085ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b695c9f7d354898a5fed309e1b4bf92', 'request_id': 'req-80a8d27d-5588-4ab3-b556-c15afd085ceb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:12.993665 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80a8d27d-5588-4ab3-b556-c15afd085ceb admin admin] The token cache is being invalidate because project 9b695c9f7d354898a5fed309e1b4bf92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 16:35:12.993955 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80a8d27d-5588-4ab3-b556-c15afd085ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:12.994577 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80a8d27d-5588-4ab3-b556-c15afd085ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 16:35:12.996057 dv-cinder-852208-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1459/2905] 10.222.0.40 () {58 vars in 1233 bytes} [Thu Aug 11 16:35:12 2022] DELETE /identity/v3/projects/9b695c9f7d354898a5fed309e1b4bf92 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 16:35:22.625719 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:22.990693 dv-cinder-852208-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:38:23.179152 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5120346-8f0e-4e0c-92df-f76ea1003164 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 16:38:23.180527 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b5120346-8f0e-4e0c-92df-f76ea1003164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:38:23.250050 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5120346-8f0e-4e0c-92df-f76ea1003164 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 16:38:23.310557 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3879b2-2e66-4978-986a-511c5bdede62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e1c7e6ee814b47912760cf7daf54c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b0514f7236d42d1955e895adaf41389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 16:38:23.311154 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3879b2-2e66-4978-986a-511c5bdede62 service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 16:38:23.311428 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3879b2-2e66-4978-986a-511c5bdede62 service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 16:38:23.311696 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3879b2-2e66-4978-986a-511c5bdede62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 16:38:23.313424 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9a3879b2-2e66-4978-986a-511c5bdede62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 16:38:23.325064 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3879b2-2e66-4978-986a-511c5bdede62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 16:38:23.326606 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3879b2-2e66-4978-986a-511c5bdede62 service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 16:38:23.336176 dv-cinder-852208-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1447/2906] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Aug 11 16:38:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 16:38:33.332034 dv-cinder-852208-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=58 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}